HANSpeller: A Unified Framework for Chinese Spelling Correction

Jinhua Xiong ； Qiao Zhang ； Shuiyuan Zhang ； Jianpeng Hou ； Xueqi Cheng

《中文計算語言學期刊》 20卷1期 (2015/06) Pp. 1-21

並列摘要

The number of people learning Chinese as a Foreign Language (CFL) has been booming in recent decades. The problem of spelling error correction for CFL learners increasingly is becoming important. Compared to the regular text spelling check task, more error types need to be considered in CFL cases. In this paper, we propose a unified framework for Chinese spelling correction. Instead of conventional methods, which focus on rules or statistics separately, our approach is based on extended HMM and ranker-based models, together with a rule-based model for further polishing, and a final decision-making step is adopted to decide whether to output the corrections or not. Experimental results on the test data of foreigner's Chinese essays provided by the SIGHAN 2014 bake-off illustrate the performance of our approach.

並列關鍵字

Chinese Spelling Correction ； HMM ； Ranker-Base Model ； Rule-based Model ； Decision-making

參考文獻

Ahmad, F.,Kondrak, G.(2005).Learning a spelling error model from search query logs.Proceeding of the conference on Human Language Technology and Empirical Methods in Natural Language Processing.(Proceeding of the conference on Human Language Technology and Empirical Methods in Natural Language Processing).

(1987).The Computational Analysis of English: A Corpus-Based Approach.

Bril, E.,Moore, R. C.(2000).An improved error model for noisy channel spelling correction.Proceeding of the 38th Annual Meeting on Association for Computational Linguistics.(Proceeding of the 38th Annual Meeting on Association for Computational Linguistics).

Chang, C. H.(1995).A new approach for automatic Chinese spelling correction.Proceeding of Natural Language Processing Pacific Rim Symposium.(Proceeding of Natural Language Processing Pacific Rim Symposium).

Chang, R. Y.,Wu, C. H.,Prasetyo, P. K.(2012).Error Diagnosis of Chinese Sentences Using Inductive Learning Algorithm and Decomposition-Based Testing Mechanism.ACM Transactions on Asian Language Information Processing(TALIP).11(1),3.