Automatic Recognition of Cantonese-English Code-Mixing Speech

Joyce Y. C. Chan ； Hou-Wei Cao ； P. C. Ching ； Tan Lee

《中文計算語言學期刊》 14卷3期 (2009/09) Pp. 281-304

https://doi.org/10.30019/IJCLCLP.200909.0003

並列摘要

Code-mixing is a common phenomenon in bilingual societies. It refers to the intra-sentential switching of two different languages in a spoken utterance. This paper presents the first study on automatic recognition of Cantonese-English code-mixing speech, which is common in Hong Kong. This study starts with the design and compilation of code-mixing speech and text corpora. The problems of acoustic modeling, language modeling, and language boundary detection are investigated. Subsequently, a large-vocabulary code-mixing speech recognition system is developed based on a two-pass decoding algorithm. For acoustic modeling, it is shown that cross-lingual acoustic models are more appropriate than language-dependent models. The language models being used are character tri-grams, in which the embedded English words are grouped into a small number of classes. Language boundary detection is done either by exploiting the phonological and lexical differences between the two languages or is done based on the result of cross-lingual speech recognition. The language boundary information is used to re-score the hypothesized syllables or words in the decoding process. The proposed code-mixing speech recognition system attains the accuracies of 56.4% and 53.0% for the Cantonese syllables and English words in code-mixing utterances.

並列關鍵字

Automatic Speech Recognition ； Code-mixing ； Acoustic Modeling ； Language Modeling

參考文獻

Auer, P.(1998).Code-Switching in Conversation: Language, Interaction and Identity.London:Routledge.

Chan, H. S.(1992).Code-mixing in Hong Kong Cantonese-English Bilinguals: Constraints and Processes.Chinese University of Hong Kong.

Chan, J. Y. C.,Ching, P. C.,Lee, T.,Meng, H.(2004).Detection of language boundary in code-switching utterances by bi-phone probabilities.Proceeding of the 5th International Symposium on Chinese Spoken Language Processing.(Proceeding of the 5th International Symposium on Chinese Spoken Language Processing).:

Chan, J. Y. C.(2005).Automatic Speech Recognition of Cantonese-English Code-Mixing Utterances.Chinese University of Hong Kong.

Chan, J. Y. C.,Ching, P. C.,Lee, T.(2005).Development of a Cantonese-English code-mixing speech corpus.Proceeding of Eurospeech.(Proceeding of Eurospeech).: