Segmentation Standard for Chinese Natural Language Processing

Chu-Ren Huang ； Keh-Jiann Chen ； Feng-Yi Chen ； Li-Li Chang

《中文計算語言學期刊》 2卷2期 (1997/08) Pp. 47-62

https://doi.org/10.30019/IJCLCLP.199708.0003

並列摘要

This paper proposes a segmentation standard for Chinese natural language processing. The standard is proposed to achieve linguistic felicity, computational feasibility, and data uniformity. Linguistic felicity is maintained by a definition of segmentation unit that is equivalent to the theoretical definition of word, as well as a set of segmentation principles that are equivalent to a functional definition of a word. Computational feasibility is ensured by the fact that the above functional definitions are procedural in nature and can be converted to segmentation algorithms as well as by the implementable heuristic guidelines which deal with specific linguistic categories. Data uniformity is achieved by stratification of the standard itself and by defining a standard lexicon as part of the standard.

參考文獻

Chang, L.、Chen, K. J.、Chen, F. Y.、Wei, W. J.、Huang, C. R.(1997)。The Design Criteria and Content of the Segmentation Standard for Chinese Information Processing。Yuyan Wenzi Ying-yong。1，92-100。

Y. R. Yuen Ren, Yuen Ren(1968).A Grammar of Spoken Chinese.

Chen, K. J.,Ahrens, K.,Huang, C. R.(1993).Proceedings of the International Conference on the Biological Basis of Language.

Chen, K. J.,Hsu, H. L.,Huang, C. R.,Chang, L. P.(1996).Language, Information, and Computation. Selected Papers from the 11th PACLIC.

Chen, K. J.,Huang, C. R.,Chen, C. Y.,Tseng, S. F.(1993).Proceedings of the First Pacific Asia Conference on Formal and Computational Linguistics.