Performance of Item Exposure Control Methods in Computerized Adaptive Testing: Further Explorations

試題曝光率控制法在電腦適性測驗中的特性功能：進階研究

章舜雯(Shun-Wen Chang) ； Timothy N.Ansley ； 涂柏原(Bor-Yaun Twu)

《測驗年刊》 49卷2期 (2002/07) Pp. 235-263

摘要

本研究探討電腦適性測驗中試題曝光率控制法 the Sympson and Heuer conditional procedure（SHC法）對曝光率能有效控制的程度，並與其他兩種常用的方法--the Davey and Parshall procedure（DP法）與the Stocking and Lewis conditional multinomial procedure（SLC 法）的特性與功能作比較。整個研究採用電腦程式模擬電腦適性測驗程序，使用四個不同大小的題庫以及二種最大曝光率期望值進行。評鑑的標準包括最大曝光觀察值、試題重複出現率、題庫使用度、以及測量標準誤。另外，本研究亦針對估計曝光率控制參數所需之最小樣本數進行探討。結果顯示，SHC法最能控制試題曝光率至研究中之期望值以及降低試題重複出現率，其次是SLC法。而DP法對於題庫的使用度整體而言是最佳的。研究的結果提供了對曝光率控制法更清楚的認識。

關鍵字

電腦適性測驗 ； 曝光控制 ； 試題曝光率 ； 試題機密

並列摘要

This study examined the effectiveness of the Sympson and Hetter conditional (SHC) procedure, a modification of the Sympson and Hetter algorithm, in controlling the exposure rates of items in the CAT environment. Its properties were compared with those of the Davey and Parshall (DP) and the Stocking and Lewis conditional multinomial (SLC) procedures. Simulations were used to carry out this research. The advantages and disadvantages of these strategies were considered under four item pool sizes and two desired maximum exposure rates and were evaluated in light of maximum observed exposure rates, test overlap rates, utilization of the item pool, and conditional standard errors of measurement. Also, the issue of the appropriate conditional sample sizes in deriving the exposure control parameters was considered in the present study. The results showed that the SHC procedure best served the purpose of controlling the observed exposure rates to the desired values and yielding the lowest test overlap rates, followed by the SLC method. The DP method utilized the item pools to a satisfactory extent overall. The results of this study have offered a clearer understanding of the properties of the exposure control methods.

並列關鍵字

computerized adaptive tests ； exposure control ； item exposure rate ； test security

參考文獻

Davey, T.,Parshall, C. G.(1995).Annual meeting of the American Educational Research Association.San Francisco:

Featherman, C. M.,Subhiyah, R. G.,Hadadi, A.(1996).Annual meeting of the American Educational Research Association.New York:

Hetter, R. D.,Sympson, J. B.(1997).Computerized adaptive testing: From inquiry to operation.Washington, DC:American Psychological Association.

Kingsbury, G. G.,Zara, A. R.(1989).Procedures for selecting items for computerized adaptive tests.Applied Measurement in Education.2(4),359-375.

McBride, J. R.,Martin, J. T.(1983).New horizons in testing: Latent trait test theory and computerized adaptive testing.New York:Academic Press.