Automatic Pronunciation Assessment for Mandarin Chinese: Approaches and System Overview

Jiang-Chun Chen ； Jyh-Shing Roger Jang ； Te-Lu Tsai

《中文計算語言學期刊》 12卷4期 (2007/12) Pp. 443-458

https://doi.org/10.30019/IJCLCLP.200712.0005

並列摘要

This paper presents the algorithms used in a prototypical software system for automatic pronunciation assessment of Mandarin Chinese. The system uses forced alignment of HMM (Hidden Markov Models) to identify each syllable and the corresponding log probability for phoneme assessment, through a ranking-based confidence measure. The pitch vector of each syllable is then sent to a GMM (Gaussian Mixture Model) for tone recognition and assessment. We also compute the similarity of scores for intensity and rhythm between the target and test utterances. All four scores for phoneme, tone, intensity, and rhythm are parametric functions with certain free parameters. The overall scoring function was then formulated as a linear combination of these four scoring functions of phoneme, tone, intensity, and rhythm. Since there are both linear and nonlinear parameters involved in the overall scoring function, we employ the downhill Simplex search to fine-tune these parameters in order to approximate the scoring results obtained from a human expert. The experimental results demonstrate that the system can give consistent scores that are close to those of a human's subjective evaluation.

並列關鍵字

CAPT ； CALL ； Speech Recognition ； Tone Recognition ； Speech Assessment ； GMM ； Mandarin Chinese ； Downhill Simplex Method ； Phoneme ； Intensity ； Rhythm ； Forced Alignment

參考文獻

Chen J.C.,J.S. R. Jang(2007).Extended Supratone Modeling for HMM-based Continuous Tone Recognition.(ACM Transaction on Speech and Language Processing).

Chen J.C.,J.S. R. Jang,J.Y. Li,M.C. Wu(2004).Automatic Pronunciation Assessment for Mandarin Chinese.IEEE International Conference on Multimedia & Expo.(IEEE International Conference on Multimedia & Expo).

Chen S.H.,Y.R. Wang(1995).Tone Recognition of Continuous Mandarin Speech Based on Neural Networks.IEEE Transactions on Speech and Audio Processing.3(2),146-150.

Proceedings of Conference on Computational Linguistics and Speech Processing (ROCLING)

Huang S.C.(2006).Improvement and Error Analysis of Tone Recognition for Mandarin Chinese.National Tsing Hua University.