醫學系筆試多項選擇題品質分析

Quality Analysis of Multiple-Choice Questions in a Medical School

林朝順(Chaou-Shune Lin) ； 鄒國英(Kuo-Inn Tsou) ； 劉正耀(Cheng-Yao Liu) ； 胡彼得(Peter Woo) ； 楊育純(Yu-Chun Yang)

《輔仁醫學期刊》 3卷4期 (2005/12) Pp. 213-220

摘要

Background and Purpose: The purposes of this study were to assess the quality of multiple-choice questions (MCQs) in a medical school, and to investigate whether the high quality of items was positively related to an item discrimination index. Methods: In 2004, 6 examinations from a single Taiwanese medical school were gathered, and each MCQ was evaluated via a subjective and an objective approach. The subjective evaluation was undertaken by 3 independent experts who rated questions on a 5-point scale developed by Jozefowicz. The objective evaluation was carried out based on item difficulty, an item discrimination index, and kappa agreement using the software, Iteman. Results: In total, 484 questions were analyzed. The mean score for the subjective evaluation was 2.0±0.8, and the objective evaluation revealed a mean item difficulty of 0.72±0.24, and a mean item discrimination index of 0.20±0.20. The high subjective evaluation score was positively related to the item discrimination index. Conclusion: According to the results of this study, faculty members should have better training in the skills of writing good multiple-choice questions in order to improve the quality of examinations.

關鍵字

試題分析 ； 多項選擇題 ； 評量 ； 醫學教育

並列摘要

Background and Purpose: The purposes of this study were to assess the quality of multiple-choice questions (MCQs) in a medical school, and to investigate whether the high quality of items was positively related to an item discrimination index. Methods: In 2004, 6 examinations from a single Taiwanese medical school were gathered, and each MCQ was evaluated via a subjective and an objective approach. The subjective evaluation was undertaken by 3 independent experts who rated questions on a 5-point scale developed by Jozefowicz. The objective evaluation was carried out based on item difficulty, an item discrimination index, and kappa agreement using the software, Iteman. Results: In total, 484 questions were analyzed. The mean score for the subjective evaluation was 2.0±0.8, and the objective evaluation revealed a mean item difficulty of 0.72±0.24, and a mean item discrimination index of 0.20±0.20. The high subjective evaluation score was positively related to the item discrimination index. Conclusion: According to the results of this study, faculty members should have better training in the skills of writing good multiple-choice questions in order to improve the quality of examinations.

並列關鍵字

item analysis ； multiple-choice question ； assessment ； medical education