中學生現代公民核心素養之測驗編製

Development of a Modern Citizen Core Literacy Test for Middle School Students

陳彥君(Yen-Chun Chen) ； 洪素蘋(Su-Pin Hung)

《教育實踐與研究》 32卷2期 (2019/12) Pp. 39-79

摘要

本研究旨在編製一信、效度良好的中學生現代公民核心素養測驗，以評估臺灣中學生現代公民核心素養狀況。測驗編製係參考現代公民核心能力指標以及國際公民教育與素養調查研究（International Civic and Citizenship Education Study [ICCS]）的評量架構，編擬符合中學生生活場域與經驗的試題。試題編製完成後經學科專家確認內容效度與試題預試，於正式施測階段，採分層便利取樣，蒐集來自全臺北、中、南、東（含離島）各區共22所學校的中學生共1479份有效樣本，以多向度部分給分試題反應理論模式（multidimensional partial credit model [MPCM]）進行資料分析。結果發現：中學生現代公民核心素養測驗具有良好試題內部一致性，認知題與情感行為題的試題區分信度係數（item separation reliability）皆高於.9，五向度的受試者區分信度係數（person separation reliability），介於.593至.882之間，測驗折半信度為.883。效度驗證程序採用試題反應理論效度驗證架構進行，結果顯示本測驗符合五向度測量建構，同時並提供測驗的內容、結構、本質、類推效度與效標關聯效度，顯示本研究所發展的測驗工具具有良好信度與效度。

關鍵字

現代公民核心素養 ； 試題反應理論模式 ； 試題差異功能

並列摘要

The purpose of this study was to design the Modern Citizen Core Literacy Test with well reliability and validity for middle school students. To develop the test, the core competency index as well as the assessment framework of the International Civic and Citizenship Education Survey were used as references. The Modern Citizen Core Literacy Test is developed to reflect the life experiences of middle school students. To establish content validity of the test, a panel of experts from middle schools were invited to review the first version of the test. After a pilot study, the test was administered to a total of 1,479 students from 22 middle schools in Taiwan; they were recruited with stratified purposive sampling. Multi-dimensional Partial Credit Model was used to assess the model-data fit. Five-core literacy were identified: moral literacy, democracy literacy, scientific literacy, media literacy and aesthetic literacy. Moreover, the test showed sufficient internal consistency with person separation reliability ranging from .593 to .882. The Split-half reliability is .883. In addition, the present study adopted item response theory based validation procedure. The results revealed that five dimensions of the Modern Citizen Core Literacy Test exhibited an acceptable model-data fit. Criterion-related validity, interpretability evidence, generalizability evidence, and substantive evidence were all supported, indicating that the test has good reliability and validity.

並列關鍵字

differential item functioning ； item response theory ； modern citizen core literacy

參考文獻

Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741-749. doi:10.1037/0003-066X.50.9.741

王文中（2004）。Rasch 測量模式與其在教育與心理之應用。教育與心理研究，27（4），637-694。[Wang, W. -C. (2004). Rasch measurement theory and application in education and psychology. Journal of Education & Psychology, 27(4), 637-694.]

王佳琪、何曉琪、鄭英耀（2014）。「科學創造性問題解決測驗」之發展。測驗學刊，61（3），337-360。[Wang, C. -C., He, H. -C., & Cheng, Y. -Y. (2014). Development of the children scientific creative problem solving test. Psychological Testing, 61(3), 337-360.]

王佳琪、鄭英耀、劉昆夏、何曉琪（2011）。以 Rasch 分析檢驗「多向度幽默感量表」之信效度。測驗學刊，58（4），691-713。[Wang, C. -C., Cheng, Y. -Y., Liu, K. -H., & He, H. -C. (2011). Validation of the multidimensional sense of humor scale using Rasch analyses. Psychological Testing, 58(4), 691-713.]

余民寧（2009）。試題反應理論（IRT）導論與應用。台北：心理。[Yu, M. -N. (2009). Introduction and application of item response theory (IRT). Taipei: Psychological Publishing.]