以最大測驗訊息量決定通過分數之研究

Study of the Standard Setting by the Maximum Test Information

謝進昌(Jin-Chang Shieh) ； 余民寧(Min-Ning Yu)

《測驗學刊》 52卷2期 (2005/12) Pp. 149-175

https://doi.org/10.7108/PT.200512.0149

摘要

本研究目的，乃在運用試題反應理論中最大測驗訊息量的概念於精熟標準設定上作為探討的主軸，透過其歷史的演進與發展，衍生出詮釋本研究最大測驗訊息量法的三個概念，分別為：元素的搭配組合與調整、廣義測驗建構流程、多元效度等，並以此概念賦予解釋運用最大測驗訊息量於精熟標準設定時的合理性與適切性。同時，確立最大測驗訊息量法於公式意涵、試題選擇與統計考驗力面向的合理性，建立其在精熟標準上的理論基礎，接續，再輔以精熟／未精熟者分類一致性信度值，以期提供多元效度證據。而在分類的信度指標上，顯示由最大測驗訊息量法求得精熟標準，經交叉驗證後，大致可獲得滿意的結果，皆有高達九成以上的精確分類水準，同時，藉由區間的概念能充分顯現出，以最大測驗訊息量法求得之標準，可作為專家進行精熟標準參考點判斷的優勢。整體而言，乃為一種值得參照的精熟標準設定方法。

關鍵字

精熟測驗 ； 精熟標準設定 ； 最大測驗訊息量法 ； 試題反應理論

並列摘要

The purpose of this study is to adopt the concepts of IRT maximum test information to standard setting. At first, we are trying to discover three facets of interpretation in using the maximum test information to standard setting through the historical movement of standard setting. The three facets are component combination and adjustment, generalized test construction processes, and multiple validities. Based on these three concepts, we can easily explain the reasonableness and appropriateness of maximum test information approach. After that, we further investigate the reasonableness from the dimensions of definition of formula, item selections, and statistical power to establish the basic theory of the maximum test information approach in standard setting. In addition, we also examine the effects of exact classification of mastery/non-mastery based on the maximum test information approach, which is expecting to provide multiple evidences for validity. After analysis, the effect of exact classification of mastery/non-mastery may come to a satisfying result. We may have at least 90% exact classification performance. At the same time, we also find that the mastery standard deriving from the maximum test information approach may have some advantages for a reference point on the confidence interval. In sum, the maximum test information approach is a good method for standard setting.

並列關鍵字

mastery test ； standard setting ； maximum test information approach ； item response theory

參考文獻

謝進昌(2005)。以最大測驗訊息量決定通過分數之研究。

余民寧、謝進昌(2005)。高雄師範大學教育學刊。

Berk, R. A.(1984).A guide to criterion-referenced test construction.Baltimore, MD:The Johns Hopkins University Press.

Berk, R. A.(1986).A consumer's guide to setting performance standards on criterion- referenced tests.Review of Educational Measurement.56(1),137-172.

Berk, R. A.(1996).Standard setting: The next generation (where few psychometricians have gone before!).Applied Measurement in Education.9(3),215-235.