內容探勘技術在教育評鑑研究發展趨勢分析之應用

The Application of Content Mining Techniques to the Analysis of Educational Evaluation Research Trends

曾元顯(Yuen-Hsien Tseng) ； 林瑜一(Yu-I Lin)

《教育科學研究期刊》 56卷1期 (2011/03) Pp. 129-166

摘要

由於大型資料庫時代的來臨，各種教育評鑑研究的數位文件，累積的速度相當快，相關的統計、探勘分析方法，需求漸為殷切。本研究以專家問卷、資料庫搜尋等方式，來界定教育評鑑研究領域的核心期刊。另外，透過引文分析、文字探勘技術等方法，自動從核心期刊中偵測出校長領導、班級大小、評鑑、改革、教師認證、學習機會、留級、教育券等概念，為顯著的研究議題。從評鑑方法的主題中，本研究探勘出Chen、Weiss與Rossi等學者討論的方法，比Cook、Compbell等人的還新，此點從領域學者Alkin（2004）在主題樹中對上述專家的擺設位置，也觀察到相同的現象。最後，本研究透過主題趨勢的分析，發現教育評鑑裡的主要議題，其論文數量有愈來愈少的趨勢。然而，這些結果的意義，仍有待領域專家的深入解讀。本研究所提方法可應用在不同學科領域，不僅能增進內容分析的效率，還可定期追蹤主題的演變，甚至標示出重要學者的位置，提供後續相關研究的線索與素材。

關鍵字

主題偵測 ； 科學計量學 ； 核心期刊 ； 評鑑理論樹 ； 趨勢分析

並列摘要

Due to the mass accumulation of digital documents in nowadays research environment, related statistical or content mining methods for analyzing, organizing, and accessing information from the document collections are in great need. This research aimed to: (1) identify the core journals in the field of educational evaluation research through cross-verification of questionnaire survey and database searching; (2) find out major research topics and their evolutions by analyzing the publications in the core journals based on scientometrics methods such as citation analysis and text mining techniques. Based on the findings, the major salient research topics include principal’s leadership, class size, evaluation, reform, teacher certification, opportunity to learn, retention, and voucher. And as to the issue of the evaluation methods, the studies conducted by Chen, Weiss, and Rossi are identified as newer ones than those by Cook and Compbell, which coincides with the fact shown in the evaluation theory tree (a sort of topical tree) organized by Marvin Alkin, an experienced expert in the field. Besides, with this topic trend analysis, it is also found that the number of papers dealing with the major research topics seems to be decreasing. However, all these results need to be interpreted by domain experts to reveal their true meanings. The methodology presented in this research may be applied not only to improve the efficiency of content analysis, but also to facilitate regular tracing of topic evolution, to spot the positions of important researchers in the field, and therefore to provide relevant clues or materials for further studies.

並列關鍵字

topic detection ； scientometrics ； core journals ； evaluation theory tree ； trend analysis

參考文獻

村田忠禧 （2002）。從《人民日報》元旦社論看中華人民共和國的歷史。2007年7月22日，取自http://www.japanresearch.org.tw/forum-12.asp【Murata, T. (2002). A perspective on the PRC's history based on the People's Daily editorials on the New Year's Days. Retrieved July 22, 2007, from http://www.japanresearch.org.tw/forum-12.asp】

Hearst, M.. (2003). What is text mining? Retrieved January 15, 2010, from http://people.ischool.berkeley.edu/~hearst/text-mining.html

Noyons, E. C. M., & van Raan, A. F. J. (1998), Mapping scientometrics, informetrics, and bibliometrics, CWTS Working papers. Retrieved January 2, 2008, from http://shara.fsw.leidenuniv.nl/ed/sib/home.html.

Tseng, Y.-H.. (2010). Content Analysis Toolkit for Academic Research (CATAR). Retrieved August 10, 2010, from http://web.ntnu.edutw/~samtseng/CATAR/

Alkin, M. C.(2004).Evaluation roots: Tracing theorists' views and influences.London:Sage.