具備智慧型模糊評分機制之線上測驗系統架構

An On-line Test System Framework with Intelligent Fuzzy Scoring Mechanism

楊亨利(Heng-Li Yang) ； 應嗚雄(Ming-Hsiung Ying)

《資訊管理學報》 13卷1期 (2006/01) Pp. 39-71

摘要

線上測驗已成為電子化教育學習的重要議題，少數系統雖可支援填充題及其他非選擇題型測驗，但卻以非對即錯的二元樣形比對進行評分，而影響測驗系統的評分效力。目前系統缺乏提供教師設定個人化評分風格及相似語意詞庫，對於多位教師共用測驗系統平台環境時所產生的評分規則認知衝突，系統並未提供支援與解決，本研究使用模糊理論、相似語意詞庫及人工智慧概念等，發展具備模糊評分機制的線上到測驗系統。此外，本研究結合不同回饋類型，使測驗系統不再只是評量答案對錯及計算總分而已，還能更進一步告知受測者答案的原因，並提供該題目相關的教材內容幫助學習。本研究經由實驗程序發現，本系統的模糊機制的確能提高一般線上測驗系統的評量效力。

關鍵字

線上測驗 ； 電子化學習 ； 填充題 ； 模糊評分機制 ； 回饋訊息

並列摘要

The computer-based or online testing has been one of important topics of information education. Currently, most of on-line testing systems only had selection-type items (single or multiple answers). Though some systems provide short-answer items (completion-type items), they can only recognize the answers either all right or all wrong by simple computer binary pattern matching. In addition, they cannot provide customized grading and thesaurus semantic environments for teachers. In order to solve these problems and have the same evaluation effects as the traditional paper-and-pencil testing, this research has adopted the concepts of fuzzy theory, thesaurus, set concept, and artificial intelligence to develop the fuzzy scoring mechanism. The proposed on-line testing system has true-false, multiple-choice, and fill-in-blank items. The latter will be graded through fuzzy judgment that is naturally endowed by the human teachers. In addition, the prototype system would not only grade the test items, but also explain the answers and provide related materials to the testers. Through experiments, we also proved that the prototype could have the same evaluation effects as the paper-and-pencil testing.

並列關鍵字

Computer On-Line Testing ； Fill-in-Blank Type Items ； Fuzzy Scoring Mechanism ； Feedback Message ； E-Learning

參考文獻

黃國禛、曾秋蓉、朱蕙君、蕭經武(2002)。智慧型線上測驗系統題型之分析與改進。科學教育學刊。10(4)，423-439。

Alderson, J.C.(2000).Technology in Testing: The Present and Future.(Elsevier Science Document System).

Alessi, SM.,Trollip, S.R.(1991).(Computer-Based instruction: Methods and Development).

Bennett, M.G.,Hessinger, J. Kahn, H.,Ligget, J. Marshall, G.,Zack, J.(1999).Using Multimedia in Large-Scale Computer-Based Testing Programs.(Computers in Human Behavior).

Bloom, B. S.,Englehart, M. D.,Furst, E. J.,Hill, W. H.,Krathwohl, D. R.(1956).(A Taxonomy of Educational Objectives: Handbook 1).