Detecting Emotions in Mandarin Speech

Tsang-Long Pao ； Yu-Te Chen ； Jun-Heng Yeh ； Wen-Yuan Liao

《中文計算語言學期刊》 10卷3期 (2005/09) Pp. 347-361

https://doi.org/10.30019/IJCLCLP.200509.0004

並列摘要

The importance of automatically recognizing emotions in human speech has grown with the increasing role of spoken language interfaces in human-computer interaction applications. In this paper, a Mandarin speech based emotion classification method is presented. Five primary human emotions, including anger, boredom, happiness, neutral and sadness, are investigated. Combining different feature streams to obtain a more accurate result is a well-known statistical technique. For speech emotion recognition, we combined 16 LPC coefficients, 12 LPCC components, 16 LFPC components, 16 PLP coefficients, 20 MFCC components and jitter as the basic features to form the feature vector. Two corpora were employed. The recognizer presented in this paper is based on three cl4ssification techniques: LDA, K-NN and HMMs. Results show that the selected features are robust and effective for the emotion recognition in the valence and arousal dimensions of the two corpora. Using the HMMs emotion classification method, an average accuracy of 88.7% was achieved.

並列關鍵字

Mandarin ； emotion recognition ； LPC ； LFPC ； PLP ； MFCC

參考文獻

Ata, B .S.(1974).Effectiveness of Linear Prediction Characteristics of the Speech Wave for Automatic Speaker Identification and Verification.(Journal of the Acoustical Society of America).

Cheng, P.Y.(2002).Automated Recognition of Emotion in Mandarin.National Cheng Kung University.

Chuang, Z.J.,C.H. Wu(2004).Multi-Modal Emotion Recognition from Speech and Text.(International Journal of Computational Linguistics and Chinese Language Processing).

Cowie, R.,F. Douglas-Cowie,N. Tsapatsoulis,G. Votsis,S. Kollias,W. Fellenz,J.G. Taylor(2000).Emotion Recognition in Human-Computer Interaction.(IEEE Signal Processing Magazine).

Davis, S.,P. Mermelstein(1980).Comparison of Parametric Representations of Monosyllabic Word Recognition in Continuously Spoken Sentences.(IEEE Transactions on Acoustics).