Incorporating Response Time to Analyze Test Data with Mixture Structural Equation Modeling

利用結構方程混合模型分析具反應時間的測驗資料

詹淑貞(Shu-Chen Chan) ； 呂翠珊(Tsui-Shan Lu) ； 蔡蓉青(Rung-Ching Tsai)

《測驗學刊》 61卷4期 (2014/12) Pp. 463-488

摘要

過去的研究顯示，試題作答的反應時間可以幫助了解考生們不同的測驗作答行為，特別是考慮反應時間所建構的Rasch混合模型（MRM-RT），利用兩個潛在類別來刻劃及區辨快速猜測或真實作答之受試者，比起單純只考慮認真作答的受試者模型，更符合實際的測驗資料。本研究將此MRM-RT模型放在結構方程混合模型的架構下，同時對試題的反應時間及測驗作答反應的資料進行分析，如此一來可以很容易地增加MRM-RT模型中的潛在類別個數，並且對此模型做參數估計。由模擬結果顯示，MRM-RT在試題的參數估計及描述受試者的應試行為上，表現皆優於Rasch混合模型。也發現使用穩健標準誤之最大概似估計所花費的時間，遠少於使用蒙特卡羅馬爾可夫鏈的貝氏估計。因此，採用此架構之作法對研究者來說，將可以更容易地獲得MRM-RT的參數估計。

關鍵字

結構方程混合模型 ； Rasch模型 ； 反應時間

並列摘要

Item response time has been shown valuable in identifying different test behavior of the test takers. In particular, the mixture Rasch model with response time components (MRM-RT) has suggested that a two-class solution representing rapid-guessers and solution behavior examinees could empirically fit the test data better than a one-class solution. In this study, we embed such a simultaneous analysis of item responses and response time into the mixture structural equation model framework, which in turn facilitates the estimation of the model with another additional class. Our simulation results indicate that the MRM-RT outperforms the mixture Rasch model in yielding more accurate item parameter estimates as well as describing better the test-taking behavior. The study shows that maximum likelihood estimation with robust standard errors takes much less time than using Monte Carlo Markov Chains for Bayesian estimation. Therefore, the estimation of MRM-RT is more accessible to researchers.

並列關鍵字

mixture structural equation model ； Rasch model ； response time

參考文獻

DeMars, C. E.,Wise, S. L.(2010).Can differential rapid-guessing behavior lead to differential item functioning.International Journal of Testing.10(3),207-229.

Ferrando, P. J.,Lorenzo-Seva, U.(2007).An item response theory model for incorporating response time data in binary personality items.Applied Psychological Measurement.31(6),525-543.

Klein Entink, R. H.,Fox, J. P.,Hornke, L. F.,Kuhn, J. T.(2009).Evaluating cognitive theory: A joint modeling approach using responses and response times.Psychological Methods.14(1),54-75.

Lee, Y. H.,Chen, H.(2011).A review of recent response-time analysis in educational testing.Psychological Test and Assessment Modeling.53(3),359-379.

Loeys, T.,Rosseel, Y.,Baten, K.(2011).A joint modeling approach for reaction time and accuracy in psycholinguistic experiments.Psychometrika.76(3),487-503.