應用資訊檢索技術於論文評閱者推薦模式之評估

Evaluation of Information Retrieval Based Models for Recommendation of Paper Reviewers

魏世杰(Shih-Chieh Wei) ； 羅欣瑜(Hsin-Yu Luo)

《教育資料與圖書館學》 45卷4期 (2008/06) Pp. 409-431

https://doi.org/10.6120/JoEMLS.200806_45(4).0233.RS.CM

摘要

隨著傳統期刊逐漸採用電子形式出刊，也帶動投稿及評閱過程愈來愈多採用電子自動化之潮流。目前一般的線上投稿暨評閱系統雖然功能逐漸齊備，但仍少有推薦評閱者功能。為評估現有可推薦評閱者技術之表現，本文分別用標題、關鍵詞、摘要、全文4種不同長度的論文表示方式，搭配7種評閱者匹配法，其中包括向量空間模式下的4種相似度匹配法，及應用於OpenConf線上投稿系統中的3種主題式匹配法，交又組合出4×7=28種推薦模式。測試結果顯示，向量空間模式匹配法優於主題式匹配法。又所有推薦模式中，以摘要為論文表示方式，搭配向量空間模式的餘弦相似度匹配法，其推薦效果最好。

關鍵字

向量空間模式 ； 論文表示方式 ； 評閱者推薦模式

並列摘要

As more e-journals appear and the e-review process becomes more popular, the demand for automatic recommendation of a good peer reviewer has been ever increasing. To automate the process of paper reviewer recommendation, this work evaluates four kinds of paper representations, which include full text, abstract, title, and author defined keywords. To match reviewers with papers, this work evaluates seven scoring methods including three topic-based methods from OpenConf, a popular online submission system with source, and four similarity-based methods from the vector space model of traditional information retrieval. The results of the 28 experiments show that recommendation methods based on the vector space model are better than the three topic-based methods of OpenConf in most document representations. Among them, the abstract paper representation combined with cosine similarity matching measure has the highest average precision.

並列關鍵字

Vector space model ； Paper representation ； Reviewer recommendation

參考文獻

邱炯友(2003)。學術電子期刊同儕評閱之探析。教育資料與圖書館學。40(3)，309-323。

邱炯友、李怡萍(2006)。學術電子期刊編輯整合平台市場與個案：以教育資料與圖書館學季刊為例。教育資料與圖書館學。43(3)，327-345。

顏玉茵(2004)。台灣學術期刊電子化同儕評閱系統建構之評析(碩士論文)。南華大學出版與文化事業管理研究所。

Baeza-Yates, R.,Ribeiro-Neto, B.(1999).Modern information retrieval.New York:Addison Wesley Longman Limited.

Biswas, H. K.,Hasan, M. M.(2007).Using publications and domain knowledge to build research profiles: An application in automatic reviewer assignment.International conference on information and communication technology.(International conference on information and communication technology).