Guttman型異常作答指標偵測力之比較

Comparing the Power of Detecting Aberrant Response Patterns by Four Guttman-Based Indices

盧志明(Chih-Ming Lu) ； 黃財尉(Tsai-Wei Huang) ； 方將任(Jiang-Ren Fan)

《測驗學刊》 54卷1期 (2007/06) Pp. 147-174

https://doi.org/10.7108/PT.200706.0147

摘要

The purpose of this study was to compare the effects of four Guttman-based indices (SCI, MCI, NCI, W&B). Aberant response data were randomly simulated and compared under four conditions (test length, severity of aberrance, types of misfit, and percentage of aberrant respondents). Also modified cutoffs (the 80(superscript th) percentiles) were used to replace the cutoffs originally announced by their various thumb rules.
Results showed that (1) significant differences of detection rates existed among four indices (W&B＞SCI＞MCI＞NCI) under original thumb-rule cutoffs, but the rank changed (W&B＞NCI＞SCI＞MCI) under the modified cutoffs. (2) detecting performanes of the four indices were more consistent in modified-cutoff situation than in thumb-rule situation. (3) either using modified or thumb-rule cutoff almost indices were inferenced by the four simulated conditions.

關鍵字

Guttman型指標 ； 決斷值 ； 偵測力 ； 異常作答組型

並列摘要

The purpose of this study was to compare the effects of four Guttman-based indices (SCI, MCI, NCI, W&B). Aberant response data were randomly simulated and compared under four conditions (test length, severity of aberrance, types of misfit, and percentage of aberrant respondents). Also modified cutoffs (the 80(superscript th) percentiles) were used to replace the cutoffs originally announced by their various thumb rules.
Results showed that (1) significant differences of detection rates existed among four indices (W&B＞SCI＞MCI＞NCI) under original thumb-rule cutoffs, but the rank changed (W&B＞NCI＞SCI＞MCI) under the modified cutoffs. (2) detecting performanes of the four indices were more consistent in modified-cutoff situation than in thumb-rule situation. (3) either using modified or thumb-rule cutoff almost indices were inferenced by the four simulated conditions.

並列關鍵字

aberrant response pattern ； cutoff value ； Guttman-based indices ； power of detection

參考文獻

余民寧(2002)。教育測驗與評量：成就測驗與教學評量。台北市:心理。

吳明隆(1999)。SPSS統計應用實務。台北市:松崗。

D`Costa, A.(1993).Paper presented at convention of National Council for Measurement in Education, Atlanta, GA..

Drasgow, F.,Levine, M. V.,McLanghlin, M. E.(1987).Detecting inappropriate test score with optimal and practical appropriateness indices.Applied Psychological Measurement.11,59-79.

Harnisch, D. L.,Linn, R. L.(1981).Analysis of item response patterns: Questionable test data and dissimilar curriculum practices.Journal of Education Measurement.18(3),133-146.