Multi-Modal Emotion Recognition from Speech and Text

Ze-Jing Chuang ； Chung-Hsien Wu

《中文計算語言學期刊》 9卷2期 (2004/08) Pp. 45-62

https://doi.org/10.30019/IJCLCLP.200408.0004

並列摘要

This paper presents an approach to emotion recognition from speech signals and textual content. In the analysis of speech signals, thirty-three acoustic features are extracted from the speech input. After Principle Component Analysis (PCA) is performed, 14 principle components are selected for discriminative representation. In this representation, each principle component is the combination of the 33 original acoustic features and forms a feature subspace. Support Vector Machines (SVMs) are adopted to classify the emotional states. In text analysis, all emotional keywords and emotion modification words are manually defined. The emotion intensity levels of emotional keywords and emotion modification words are estimated based on a collected emotion corpus. The final emotional state is determined based on the emotion outputs from the acoustic and textual analyses. Experimental results show that the emotion recognition accuracy of the integrated system is better than that of either of the two individual approaches.

參考文獻

(2002).Proceedings of IEEE International Conference on spoken Language Processing.

(1990).Emotion, atten Lang tion, and the startle reflex.Psychological Review.97,377-395.

(1990).Emotional Intelligence.Imagination, Cognition, and Personality.9(3),185-211.

Abramowitz, M.,Stegun, I. A.(1972).Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables.

Chen, Y. J.,Wu, C. H.(2001).Multi-Keyword Spotting of Telephone speech using Fuzzy Search Algorithm and Keyword-Driven Two-Level CBSM.Speech Communication.33,197-212.