利用評分者差異函數偵測主觀評分之議題

Using Differential Rater Functioning to Detect the Issues of Subjective Rating

陸雲鳳(Yun-Feng Lu)

《運動教練科學》 43期 (2016/09) Pp. 17-24

https://doi.org/10.6194/SCS.2016.43.03

摘要

目的：本研究利用評分者差異函數（differential rater functioning, DRF）估計評分者的評分差異，偵測評分者間的偏差。方法：受試者18 名選手，採5 位專家評定13 項標槍投擲技術。研究依據Rasch 模式，以Winsteps 程式估計評分者和項目的測量參數，以及DRF 探查評分者在項目的差異。結果：一、受試者和項目信度良好，但都有模式適合度不良者。二、評分者在項目5 的評分嚴謹度有顯著差異。三、A 評分者在項目5 和項目8 的評分較為寬鬆。四、配對比較評分者在項目的差異函數考驗，皆為A 評分者與其他四位評分者的評分嚴謹度有顯著差異。結論：評分者差異函數可以偵測主觀評分之評分者偏差。

關鍵字

Rasch模式 ； 評分者差異函數 ； 評分偏差

並列摘要

Purpose: the study was using differential rater functioning (DRF) to estimate the rating difference and detect rating bias between raters. Methods: The subjects were 18 javelin players. Using five raters assessed thirteen throwing skills in javelin. The research was based on Rasch model and used Winsteps to estimate measurement parameters of item and rater, and detected the rating bias within items between raters. Results: (1) The reliabilities of items and subjects were good, but both of them had some Misfit. (2) The raters' rating severity in the fifth item had significant differences. (3) The A rater had leniency rating in 5th and 8th items. (4) Comparison with paired raters in the differential item function test, we found out that the A rater's rating severity had significant difference with other four raters' rating. Conclusion: DRF can detect subjective rating bias between raters.

並列關鍵字

Rasch model ； differential rater functioning ； rating bias

參考文獻

紀世清、彭俊秀、姚漢禱(2010)。羽球單打比賽戰術類型研究之效度與信度。休閒運動健康評論。1(2)，33-43。

陸雲鳳、紀世清、姚漢禱(2009)。中華台北最佳女子桌球雙打技術分析。休閒運動健康評論。1(1)，44-60。

姚漢禱(2014)。競技運動評分者系統性偏誤之探查。運動教練科學。34，11-21。

紀世清、王家閔、姚漢禱(2011)。羽球混合雙打比賽擊球技術分析。運動教練科學。23，1-14。

紀世清、姚漢禱(2011)。羽球混合雙打比賽戰術分析。運動教練科學。21，41-56。