Modeling Human Inference Process for Textual Entailment Recognition

Hen-Hsen Huang ； Kai-Chun Chang ； Hsin-Hsi Chen

《中文計算語言學期刊》 19卷3期 (2014/09) Pp. 39-54

並列摘要

To prepare an evaluation dataset for textual entailment (TE) recognition, human annotators label rich linguistic phenomena on text and hypothesis expressions. These phenomena illustrate implicit human inference process to determine the relations of given text-hypothesis pairs. This paper aims at understanding what human think in TE recognition process and modeling their thinking process to deal with this problem. At first, we analyze a labelled RTE-5 test set which has been annotated with 39 linguistic phenomena of 5 aspects by Mark Sammons et al., and find that the negative entailment phenomena are very effective features for TE recognition. Then, a rule-based method and a machine learning method are proposed to extract this kind of phenomena from text-hypothesis pairs automatically. Though the systems with the machine-extracted knowledge cannot be comparable to the systems with human-labelled knowledge, they provide a new direction to think TE problems. We further annotate the negative entailment phenomena on Chinese text-hypothesis pairs in NTCIR-9 RITE-1 task, and conclude the same findings as that on the English RTE-5 datasets.

並列關鍵字

textual entailment recognition ； Chinese Processing ； semantic

參考文獻

Androutsopoulos, I.,Malakasiotis, P.(2010).A Survey of Paraphrasing and Textual Entailment Methods.Journal of Artificial Intelligence Research.38,135-187.

Bentivogli, L.,Clark, P.,Dagan, I.,Dang, H. T.,Giampiccolo, D.(2011).The seventh PASCAL recognizing textual entailment challenge.Proceedings of the 2011 Text Analysis Conference (TAC 2011).(Proceedings of the 2011 Text Analysis Conference (TAC 2011)).:

Bentivogli, L.,Dagan, I.,Dang, H. T.,Giampiccolo, D.,Magnini, B.(2009).The fifth PASCAL recognizing textual entailment challenge.Proceedings of the 2009 Text Analysis Conference (TAC 2009).(Proceedings of the 2009 Text Analysis Conference (TAC 2009)).:

Bird, S.(2006).NLTK: the natural language toolkit.Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics (COLING-ACL 2006).(Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics (COLING-ACL 2006)).

Chang, P.-C.,Galley, M.,Manning, C.(2008).Optimizing Chinese Word Segmentation for Machine Translation Performance.Proceedings of the Third Workshop on Statistical Machine Translation (StatMT '08).(Proceedings of the Third Workshop on Statistical Machine Translation (StatMT '08)).