Title

DIF分析在小樣本情境中的偵測效果-以視障生和普通生在國中基測數學科之DIF爲例

Translated Titles

Detecting Differential Item Functioning in Small Sample Size Conditions: An Empirical Study of the DIF Detection in Basic Competence Test for Junior High School Students

DOI

10.7108/PT.200812.0014

Authors

蘇旭琳(Hsu-Lin Su);陳柏熹(Po-His Chen)

Key Words

DIF ; MH ; 小樣本 ; 視障生 ; 模擬研究 ; DIF ; MH ; simulation study ; small sample size ; visual impaired students

PublicationName

測驗學刊

Volume or Term/Year and Month of Publication

55卷4期(2008 / 12 / 31)

Page #

761 - 791

Content Language

繁體中文

Chinese Abstract

本研究最主要的目的是為瞭解DIF在小樣本情境下的偵測效果,並檢測其方法在實際資料上之效果。研究分為兩個部分:研究一為模擬研究,研究二利用實證資料進行DIF分析。研究一主要目的在於瞭解不同樣本人數、不同方法等變項在各操弄情境下對於偵測效果的影響,結果顯示若控制在能力有差異的情況下,對於焦點組人數較少(如100人)時,採用MH-2 搭配樣本人數100/1000(焦點組/參照組)的組合具有較佳效能。研究二參考研究一的結果,對於2005年第一次國中基測數學科視障生和普通生的實際作答反應進行DIF分析,結果顯示該次測驗中有兩題產生DIF,文中對於可能原因予以解釋。

English Abstract

The purpose of the research is to explore the efficiency of DIF detection when the sample size of focal group is small. There are two parts in the research; Study 1 is a simulation study and Study 2 is an empirical study. The aim of Study 1 is to examine the efficiency of DIF detection in different sample size ratios of reference and focal group and in different methods. The dependent variables are power and type Ⅰ error. The result of Study 1 suggests that MH-2 combined with 100/1000 reach the DIF detecting power of 0.703 and type 1 error of 0.073 when ability distribution is controlled unequal. Study 2 is an empirical study for detecting the DIF item between visual impaired and general students of the basic competence test for junior high school students in BCTEST. The result of Study 2 suggests that there be two DIF items in 2005 BCTEST, and discussion about the reason causing DIF is also provided.

Topic Category 社會科學 > 心理學
社會科學 > 教育學
Reference
  1. 鄭靜瑩(2005)。博士論文(博士論文)。台北市,國立台灣師範大學特殊教育研究所。
    連結:
  2. 盧雪梅(2000)。Mantel-Haenszel DIF程序之第一類錯誤率和DIF嚴重度分類結果研究。測驗年刊,47(1),57-71。
    連結:
  3. 蘇旭琳(2007)。碩士論文(碩士論文)。台北市,國立台灣師範大學教育與心理輔導研究所。
    連結:
  4. Bradley, J. V.(1978).Robustness.The British Journal of Mathematical & Statistical Psychology,31,144-152.
  5. Clauser, B.,Mazor, K. M.,Hambleton, R. K.(1993).The effects of purification of the matching criterion on the identification of DIF using the Mantel-Haenzel procedure.Applied Measurement in Education,6(4),269-279.
  6. Clauser, B.,Mazor, K. M.,Hambleton, R. K.(1994).The effects of score group width on the Mantel-Haenszel procedure.Journal of Educational Measurement,31,67-78.
  7. Fidalgo, A. M.,Ferreres, D.,Muñiz, J.(2004).Utility of the Mantel-Haenszel procedures for detecting differential item functioning in small samples.Educational and Psychological Measurement,64(6),925-936.
  8. Fidalgo, A. M.,Mellenbergh, G. J.,Muñiz, J.(2000).Effects of amount of DIF, test length, and purification type on robustness and power of Mantel-Haenszel procedures.Methods of Psychological Research,5(3),43-53.
  9. Gierl, M. J.,Jodoin, M. G.,Ackerman, T. A.(2000).Performance of Mantel-Haenszel, simultaneous item bias test, and logistic regression when the proportion of DIF items is large.Paper presented at the Annual Meeting of the American Educational Research Association (AERA),New Orleans, LA.:
  10. Hills, J. R.(1989).Screening for potentially biased items in testing programs.Educational Measurement: Issues and practice.
  11. Holland, W. P.,Thayer, D. T.,H. Wainer(Eds.),H. I. Braun(Eds.)(1988).Test validity.Hillsdale, NJ:Lawrence Erlbaum Associates.
  12. Lai, J. S.,Teresi, J.,Gershon, R.(2005).Procedures for the analysis of differential item functioning (DIF) for small sample sizes.Evaluation & the Health Professions,28(3),283-294.
  13. Lord, F.(1980).Applications of item response theory to practical testing problems.Hillsdale, NJ:Lawrence Erlbaum Associates.
  14. Mazor, K. M.,Clauser, B. E.,Hambleton, R. K.(1992).The effect of sample size on the functioning of theMantel-Haenszel statistic.Educational and Psychological Measurement,52,443-451.
  15. Miller, M. D.,Oshima, T. C.(1992).Effect of sample size, number of biased items, and magnitude of bias on a two-stage item bias estimation method.Applied Psychological Measurement,16,381-388.
  16. Muthen, B.(1989).Latent variable modeling in heterogeneous populations.Psychometrika,54,557-585.
  17. Narayanan, P.,Swaminathan, H.(1994).Performance of the Mantel-Haenszel and simultaneous item bias procedures for detecting differential item functioning.Applied Psychological Measurement,18,315-338.
  18. Parshall, C. G.,Miller T. R.(1995).Exact versus asymptotic Mantel-Haenszel DIF statistics: A comparison of performance under small-sample conditions.Journal of Educational Measurement,32(3),302-316.
  19. Rogers, H. J.,Swaminathan, H.(1993).A comparison of logistic regression and Mantel-Haenszel procedures for detecting differential item functioning.Applied Psychological Measurement,17,105-116.
  20. Roussos, L. A.,Stout, W. F.(1996).Simulation studies of the effects of small sample size and studied item parameters on SIBTEST and Mantel-Haenszel type I error performance.Journal of Educational Measurement,33(2),215-230.
  21. Shealy, R.,Stout, W. F.(1993).A model-based standardization approach that seperates true bias/DIF from group differences and detects test bias/DIF as well as item bias/DIF.Psychometrika,58,159-194.
  22. Swaminathan, H.,Rogers, H. J.(1990).Detecting diferential item functioning using logistic regression procedures.Journal of Educational Measurement,27(4),361-370.
  23. Tang, H.(1994).A new IRT-Based small sample DIF method.Paper presented at the Annual Meeting of the Southwest Educational Research Association,San Antonio, TX:
  24. Uttaro, T.,Millsap, R. E.(1994).Factors influencing the Mantel-Haenszel procedure in the detection of differential item functioning.Applied Psychological Measurement,18,15-25.
  25. Wang, W. -C.,Su, Y. -H.(2004).Effects of average signed area between two item characteristic curves and test purification procedures on the DIF detection via the Mantel-Haenszel method.Applied Measurement in Education,17,113-144.
  26. Wu, M. L.,Adams, R. J.,Wilson, M. R.(1998).Acer ConQuest.Melbourne, Victoria:Australian Council for Educational Research Press.
  27. 大學入學考試中心(2005)。九十至九十三學年度學科能力測驗、指定科目考試試題差別功能檢核計畫。台北市:大學入學考試中心。
  28. 大學入學考試中心(2001)。學科能力測驗試題差別功能分析。台北市:大學入學考試中心。
  29. 何華國(1987)。特殊兒童心理與教育。台北市:五南。
  30. 余明寧、謝進昌(2006)。國中基本學力測驗之DIF的實徵分析-以91年度兩次測驗為例。國立高雄師範大學教育學系教育學刊,26,241-276。
  31. 陳蓓蓉(2003)。碩士論文(碩士論文)。台北市,國立台灣師範大學科學教育研究所。
  32. 萬明美(1996)。視覺障礙教育。台北市:五南。
  33. 劉信雄、王亦榮、林慶仁(2000)。視覺障礙學生輔導手冊。台北市:教育部。
Times Cited
  1. 張萬烽、吳裕益(2012)。學習障礙學生在國中基測數學科上表現與試題差異功能分析。特殊教育與復健學報,26,45-70。
  2. 蘇旭琳、陳柏熹(2008)。DIF分析在小樣本情境中的偵測效果—以視障生和普通生在國中基測數學科之DIF爲例。測驗學刊,55(4),761-791。
  3. 陳承德、孫國瑋、施慶麟(2018)。DIF成因之初探:試題特徵與差異試題功能之關聯。教育心理學報,50(2),167-188。