Analyzing Information Retrieval Results with a Focus on Named Entities

Thomas Mandl ； Womser-Hacker Christa

《中文計算語言學期刊》 13卷1期 (2008/03) Pp. 121-140

https://doi.org/10.30019/IJCLCLP.200803.0006

並列摘要

Experiments carried out within evaluation initiatives for information retrieval have been building a substantial resource for further detailed research. In this study, we present a comprehensive analysis of the data of the Cross Language Evaluation Forum (CLEF) from the years 2000 to 2004. Features of the topics are related to the detailed results of more than 100 runs. The analysis considers the performance of the systems for each individual topic. Named entities in topics revealed to be a major influencing factor on retrieval performance. They lead to a significant improvement of the retrieval quality in general and also for most systems and tasks. This knowledge, gained by data mining on the evaluation results, can be exploited for the improvement of retrieval systems as well as for the design of topics for future CLEF campaigns.

並列關鍵字

Cross-Lingual Information Retrieval ； Evaluation Issues ； Named Entities NEs

參考文獻

Allan, J.,H. Raghavan(2002).Using part-of-speech Patterns to Reduce Query Ambiguity.Proceedings of the Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR ´02).(Proceedings of the Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR ´02)).:

Braschler, M..CLEF 2002-Overview of Results.(Evaluation of Cross-Language Information Retrieval Systems. Third Workshop of the Cross Language Evaluation Forum CLEF 2003), Trondheim. Springer (Lecture Notes in Computer Science)).

Braschler, M.,C. Peters(2004).Cross-Language Evaluation Forum: Objectives, Results, Achievements.Information Retrieval.7,7-31.

Cahan, P.,C. Nicholas,I. Soboroff(2001).Ranking Retrieval Systems without Relevance Judgments.Proceedings of the Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR `01).(Proceedings of the Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR `01)).:

Cronen-Townsend, S.,Y. Zhou,B. Croft(2002).Predicting Query Ambiguity.Proceedings of the Annual Intl. ACM Conference on Research and Development in Information Retrieval (SIGIR `02).(Proceedings of the Annual Intl. ACM Conference on Research and Development in Information Retrieval (SIGIR `02)).: