Preparatory Work on Automatic Extraction of Bilingual Multi-Word Units from Parallel Corpora

Bo-Xing Chen ； Li-Min Du

《中文計算語言學期刊》 8卷2期 (2003/08) Pp. 77-92

https://doi.org/10.30019/IJCLCLP.200308.0004

並列摘要

Automatic extraction of bilingual Multi-Word Units is an important subject of research in the automatic bilingual corpus alignment field. There are many cases of single source words corresponding to target multi-word units. This paper presents an algorithm for the automatic alignment of single source words and target multi-word units from a sentence-aligned parallel spoken language corpus. On the other hand, the output can be also used to extract bilingual multi-word units. The problem with previous approaches is that the retrieval results mainly depend on the identification of suitable Bi-grams to initiate the iterative process. To extract multi-word units, this algorithm utilizes the normalized association score difference of multi target words corresponding to the same single source word, and then utilizes the average association score to align the single source words and target multi-word units. The algorithm is based on the Local Bests algorithm supplemented by two heuristic strategies: excluding words in a stop-list and preferring longer multi-word units.

並列關鍵字

bilingual alignment ； multiword unit ； translation lexicon ； average association score ； normalized association score difference

參考文獻

Chen, X. H.(1999).Automatic Analysis of Contemporary Chinese Using Visual C++.

Fung, P.(1995).Proceedings of the 33rd Annual Meeting of the Association for Computational Linguistics.

Patrick, Kenneth, K. K. W., K. W.(1990).Word Association Norms, Mutual Information and Lexicography.Computational Linguistics.16(1),22-29.

Haruno, M.,Ikehara, S.,Yamazaki, Takio(1996).Proceedings on the 16th International Conference on Computational Linguistics(COLING96).

Hiemstra, D.(1996).Using Statistical Methods to Create a Bilingual Dictionary.