電腦化適性測驗題庫擴增研究

The Research of Expanding Item Bank for Computerized Adaptive Test

吳慧珉(Huey-Min Wu) ； 蘇少祖(Shau-Tzu Su) ； 趙佑軒(Yu-Hsaun Chao)

《測驗統計年刊》 17期_下 (2009/12) Pp. 19-53

https://doi.org/10.6773/JRMS.200912.0019

摘要

本研究透過模擬研究，分析題庫更新時，如何兼顧試題參數估計的精準度及更新的速率。在試題參數估計穩定後，是否能藉由適性測驗試題與新試題的作答反應，增加能力參數估計的精準度。題庫的維護需耗費許多人力與成本，因此在題庫擴充時，若依照題庫建立之初，對新的試題重新舉行大規模的預試，將加重成本的負擔，本研究主要探討實施電腦適性測驗時，將未校準的試題逐次加入已校準的題庫中，以試題反應理論為基礎，估計未校準的試題參數和能力參數，在不增加成本的情況下，線上更新擴大題庫。 結果顯示如下： 一、新試題題數是5題或10題，對於新試題參數估計並沒有太大的影響。 二、隨著受試者人數的增加，能力參數和試題參數之估計誤差逐漸降低。 三、受試者能力值呈現常態與雙峰分佈時，藉由加入新試題估計能力值，除了可以估計出新試題參數之參數值外，更可估計出更精準的受試者的能力值。但若受試者能力真值呈現偏態分佈時，無法估算出較精準新試題之參數與受試者能力值。 四、受試者能力值呈現常態與雙峰分佈時，當加入新試題題數是10題時，其能力估計誤差比加入新試題題數是5題時較低。

關鍵字

電腦適性測驗 ； 題庫 ； 試題反應理論 ； 參數估計

並列摘要

A simulation study was conducted to evaluate the accuracies of estimating un-calibrated item parameters and how the ability estimate were affected by different factors while expanding the item bank in the process of administrating computerized adaptive test. The main idea of this research was to make examinees answer not only calibrated items but also un-calibrated ones. The abilities obtained from calibrated items were used to estimate un-calibrated items, so the item bank could be expanded without pretest procedures. In the simulation study, three factors and their varied conditions were considered: different distributions of abilities, different number of examinees, and different number of un-calibrated items.
The major findings of this study were summarized as follows:
1. The root mean square errors (RMSEs) of the un-calibrated item parameters were not affected by the number of items.
2. The RMSEs of the item and the ability parameters decrease as the number of the examinees crease.
3. Under normal or binomial distribution for ability, adding un-calibrated items to estimate ability could decrease the RMSEs of ability; under skewed distribution for ability, the RMSEs of both item and ability parameter were higher than normal and binomial distributions.
4. Under normal or binomial distribution for ability, the RMSEs of ability estimated by adding 10 un-calibrated items were lower than the RMSEs of ability estimated by adding 5 un-calibrated items.

並列關鍵字

computerized adaptive test ； item bank ； item response theory ； parameter estimation

參考文獻

王寶墉(1995)。現代測驗理論。台北市:心理出版社。

余民寧(1992)。試題反應的介紹（十二）－電腦化適性測驗。研習資訊。10(5)，5-9。

考選部()。

張雅媛(2007)。融合kernel smoothing之MMLE法於IRT參數估計之應用。國立台中教育大學教育測驗統計研究所碩士論文，未出版。

Ban, J. C.,Hanson, B. A.,Yi, Q.,Harris, D. J.(2001).Data Sparseness and Online Pretest Item Calibration/Scaling Methods in CAT.Annual Meeting of the American Educational Research Association.(Annual Meeting of the American Educational Research Association).