Applying the Mantel-Haenszel Method to Exploratory Differential Item Functioning Assessment in Continuous Response Items

應用Mantel-Haenszel法於連續反應試題之差異試題功能檢核

陳俊宏(Jyun-Hong Chen) ； 趙秀怡(Hsiu-Yi Chao) ； 施慶麟(Ching-Lin Shih)

《中華心理學刊》 60卷4期 (2018/12) Pp. 217-231

https://doi.org/10.6129/CJP.201812_60(4).0001

摘要

Differential item functioning (DIF) assessment is critical for ensuring test validity and fairness. Many DIF assessment methods have been proposed in the past several decades, including the Mantel-Haenszel (MH) method. Such methods are applied to DIF assessment for discrete response items; however, no research has been done for continuous response items. Considering the popularity of the MH method in practical applications, its continuous counterpart (called the MHC method) proposed by Rayner and Best (2012) is applied to assess DIF for continuous response items in this study. The scale purification (SP) is further incorporated to improve the performance of the MHC method in DIF assessment. According to the simulation results, the MHC method with the SP procedure can yield high power rates while controlling type I error rates well in DIF assessment. Since the MHC method can be easily implemented with the SP procedure, it is recommended for test practitioners to conduct DIF assessments to improve the test quality for continuous response items.

關鍵字

Mantel-Haenszel method ； differential item functioning ； continuous response items ； scale purification

並列摘要

差異試題功能（differential item functioning, DIF）檢核對於測驗效度與測驗公平性的維護相當重要。在過去數十年，陸續有許多DIF檢核方法被提出，例如Mantel-Haenszel（MH）法等。然而，這些方法皆被應用於間斷反應試題（discrete response items）；對於連續反應試題（continuous response items）的DIF檢核，則尚未有研究提及。考量MH法在實務上的穩健表現，本研究進一步將Rayner與Best（2012）所推導出的連續反應MH統計量（稱之為MHC法），應用於連續反應試題的DIF檢核，並搭配量尺淨化（scale purification, SP）程序以提升DIF檢核效能。透過模擬研究顯示，MHC法搭配SP能有效控制型一誤差，同時具有良好的檢定力。由於此方法在執行上的難度並不高，本研究建議實務測驗應用者利用MHC法搭配SP對連續反應試題進行DIF檢核，以維護測驗品質。

並列關鍵字

Mantel-Haenszel法 ； 差異試題功能 ； 連續反應試題 ； 量尺淨化

參考文獻

Almenberg, J.,Dreber, A.(2011).When does the price affect the taste? Results from a wine experiment.Journal of Wine Economics.6,111-121.

Lord, F. M.(Ed.),Novick, M. R.(Ed.)(1968).Statistical theories of mental test scores.Reading, MA:Addison-Wesley.

Chang, H.-H.,Mazzeo, J.,Roussos, J.(1996).Detecting DIF for polytomously scored items: An adaptation of the SIBTEST procedure.Journal of Educational Measurement.33,333-353.

Chen, J.-H.,Chen, C.-T.,Shih, C.-L.(2014).Improving the control of type I error rate in assessing differential item functioning for hierarchical generalized linear model when impact is presented.Applied Psychological Measurement.38,18-36.

Clauser, B.,Mazor, K.,Hambleton, R. K.(1993).The effects of purification of matching criterion on the identification of DIF using the Mantel-Haenszel procedure.Applied Measurement in Education.6,269-279.