DIF成因之初探：試題特徵與差異試題功能之關聯

Investigating Sources of Differential Item Functioning: the Relationship Between Item Property and Differential Item Functioning

孫國瑋(Guo-Wei Sun) ； 陳承德(Cheng-Te Chen) ； 施慶麟(Ching-Lin Shih)

《教育心理學報》 50卷2期 (2018/12) Pp. 167-188

https://doi.org/10.6251/BEP.201812_50(2).0001

摘要

近年來，研究者對於差異試題功能（differential item functioning, DIF）議題的探討，已由「檢測」DIF轉變為「解釋」DIF。以往對於DIF試題的解釋，多有賴於專家質性審查的方式。然而，如果能有量化分析的證據輔助專家審查，可對DIF成因的判斷有所幫助。本研究透過分析DIF試題之特徵，找出試題特徵與DIF之關聯，作為後續專家審查時判斷DIF成因的參考。為此，本研究採用線性邏輯斯測驗模式（linear logistic test model, LLTM）及隨機效果線性邏輯斯測驗模式（random effects linear logistic test model, LLTM-R）針對測驗中各試題特徵進行所謂的差異層面功能（differential facet functioning, DFF）之檢測，藉以說明試題特徵與DIF之關聯。模擬研究結果顯示試題的DIF程度受到該試題特徵的DFF效果之影響。此外，測驗的Q矩陣密度較高時（例如60%），可能因型一誤差之膨脹而檢測出高比例的DIF試題；本研究另以實徵資料說明如何針對試題進行DFF分析，藉以找出與DIF有關的試題特徵，並作為後續試題修正之方向。根據結果，本研究建議採用LLTM-R進行DFF檢測，可有助於釐清試題特徵與DIF之關聯。

關鍵字

DIF成因 ； 差異試題功能 ； 差異層面功能 ； 線性邏輯斯測驗模式 ； 隨機效果線性邏輯斯測驗模式

並列摘要

Because assessment methods for differential item functioning (DIF) have been developed and thoroughly investigated, the focus in DIF research has shifted to explaining DIF phenomena. Experts in this field are recruited to tap possible sources of DIF. Quantitative analysis results help experts reviewing DIF to locate sources for DIF items. This study aimed to demonstrate the use of the differential facet functioning (DFF) procedure implemented using the linear logistic test model (LLTM) and random effects linear logistic test model (LLTM-R) to explain possible DIF sources. The efficiency of LLTM and LLTM-R in detecting DFF under various conditions was also evaluated. The simulation results indicated that the DIF effect was significantly influenced by the DFF effect of item properties. Moreover, as the design matrices had a high density (e.g., 60%), Type-I error rates of DIF assessment were seriously inflated. We also demonstrated the procedure of DFF analysis with an empirical data. The result showed that most DIF items were related to two item properties, which would be provided as possible DIF sources in the item-review meeting. Researchers should implement DFF assessment using LLTM-R to help explain DIF sources.

並列關鍵字

DIF source ； Differential item functioning ； Differential facet functioning ； Linear logistic test model ； Random effects linear logistic test model

參考文獻

王佳琪、何曉琪、鄭英耀（2014）：「科學創造性問題解決測驗」之發展。測驗學刊，61（3），337-360。[Wang, C. C., Ho, H. C., & Cheng, Y. Y. (2014). Development of the children scientific creative problem solving test. Psychological Testing, 61(3), 337-360.]

林月仙（2013）：中文色塊測驗之認知成分分析：LLTM 與SEM 取向。教育與心理研究，36（2），113-144。[Lin, Y. H. (2013). Validation of cognitive structures for the mandarin token test: The linear logistic test model and structural equation modeling. Journal of Education & Psychology, 36(2), 113-144.]

侯雅齡（2013）：高級中學自然科學術性向測驗編製。科學教育學刊，21（2），189-213。[Hou, Y. L. (2013). The development of natural science academic aptitude tests for high school students. Chinese Journal of Science Education, 21(2), 189-213.]

張銘秋、謝秀月、徐秋月（2010）：PISA 科學素養之試題認知成份分析。課程與教學，13（1），1-20。[Chang, M. C., Hsieh, H. Y., & Shyu, C. Y. (2010). A cognitive component analysis for PISA science literacy. Curriculum & Instruction Quarterly, 13(1), 1-20.]

曾明基、邱皓政（2015）：研究生評鑑教師教學的結果真的可以與大學生一起比較嗎？多群組混合MIMIC-DIF 分析。測驗學刊，62（1），1-23。 [Tseng, M. C., & Chiou, H. J. (2015). Graduate student in SRI can really compare with the university student? Multi-group mixture MIMIC-DIF analysis. Psychological Testing, 62(1), 1-23.]