- 學位論文
Computerized Adaptive Testing for Cognitive Diagnosis in Classroom: A Nonparametric Approach
Computerized Adaptive Testing for Cognitive Diagnosis in Classroom: A Nonparametric Approach
若您是本文的作者，可授權文章由華藝線上圖書館中協助推廣。
摘要
The Cognitive Diagnostic Computerized Adaptive Testing (CD-CAT) has been suggested by researchers as a diagnostic tool for assessment and evaluation. While model-based CD-CAT is relatively well-researched in the context of large-scale assessments, this type of system has not received the same degree of development in small-scale settings, where it would be most useful. The main challenge is that the statistical estimation techniques successfully applied to the parametric CD-CAT require large samples to guarantee the reliable calibration of item parameters and accurate assignments of examinees. In response to the challenge, a nonparametric approach that does not require any parameter calibration, and thus can be used in small educational programs, is proposed. Unlike other CD-CAT algorithms, the proposed nonparametric CD-CAT uses the nonparametric classification (NPC) method to assess and update the student's ability state while the test proceeds. Based on a student's responses, possible proficiency classes are identified, and items which can discriminate them are chosen next. The simulation results show that the proposed nonparametric item selection (NPS) method outperformed the compared parametric CD-CAT algorithms and the differences were more significant when the item parameter calibration was not optimal.
並列摘要
The Cognitive Diagnostic Computerized Adaptive Testing (CD-CAT) has been suggested by researchers as a diagnostic tool for assessment and evaluation. While model-based CD-CAT is relatively well-researched in the context of large-scale assessments, this type of system has not received the same degree of development in small-scale settings, where it would be most useful. The main challenge is that the statistical estimation techniques successfully applied to the parametric CD-CAT require large samples to guarantee the reliable calibration of item parameters and accurate assignments of examinees. In response to the challenge, a nonparametric approach that does not require any parameter calibration, and thus can be used in small educational programs, is proposed. Unlike other CD-CAT algorithms, the proposed nonparametric CD-CAT uses the nonparametric classification (NPC) method to assess and update the student's ability state while the test proceeds. Based on a student's responses, possible proficiency classes are identified, and items which can discriminate them are chosen next. The simulation results show that the proposed nonparametric item selection (NPS) method outperformed the compared parametric CD-CAT algorithms and the differences were more significant when the item parameter calibration was not optimal.
參考文獻
[1] Chang, H.-H. (2015). Psychometrics behind computerized adaptive testing. Psychometrika, 80, 1-20.
[2] Chen, Y., Liu, J., Xu, G., & Ying, Z. (2015). Statistical analysis of Q-matrix based diagnostic classification models. Journal of the American Statistical Association, 110, 850-866.
[3] Cheng, Y. (2009). When cognitive diagnosis meets computerized adaptive test- ing: CD-CAT. Psychometrika, 74, 619- 632.
[4] Chiu, C.-Y., & Douglas, J. (2013). A nonparametric approach to cognitive diagnosis by proximity to ideal response patterns. Journal of Classification, 30, 225-250.
[5] Chiu, C.-Y. (2013). Statistical refinement of the Q-matrix in cognitive diagnosis. Applied Psychological Measurement, 37, 598-618.