An Application of Multidimensional IRT to the Assessment of Taiwanese Students' English Pragmatic Competence

Translated Titles





周東山(Tung-Shan Chou);包傑恩(Jonathan Park)

Key Words

多項度題目反應理論 ; 語言溝通能力測驗 ; 務實能力 ; NOHARM ; Multidimensional IRT ; communicative language testing ; pragmatic competence ; NOHARM



Volume or Term/Year and Month of Publication

52卷2期(2005 / 12 / 01)

Page #

95 - 118

Content Language


Chinese Abstract


English Abstract

McDonald's 2000 Multidimensional IRT was applied to assess the appropriateness of breaking English communicative ability into two dimensions: semantic competence and pragmatic competence. A test containing three work samples designed to measure communicative ability was given to 341 middle school and college students. The MIRT analysis was performed using NOHARM program developed by Fraser and McDonald in 2003. Both CTT and MIRT analyses showed similar dimensionality of the test. The results indicated that semantic competence and pragmatic competence are psychometrically differentiable, and that Taiwanese students' English communicative ability is well below the functional level of using English as a second language.

Topic Category 社會科學 > 心理學
社會科學 > 教育學
  1. Ackerman, T. A.,Gierl, M. J.,Walker, C. M.(2003).Using multidimensional item response theory to evaluate educational and psychological tests.Educational Measurement: Issues and Practice,Fall,37-51.
  2. Aitchison, J.(1999).Linguistics.Chicago:NTC/Contemporary Publishing.
  3. Bachman, L. F.(1991).Fundamental considerations in language testing.Hong Kong:Oxford University Press.
  4. Brindley, G.(1995).Language Assessment in Action Research Series 8.Sydney:NCELTR Macquarie University.
  5. Canale, M.,Swain, M.(1980).Theoretical bases of communicative approaches to second language teaching and testing.Applied Linguistics,1,1-47.
  6. Fraser, C.(1988).NOHARM: An IBM PC computer program for fitting both unidimensional and multidimensional normal ogive models of latent trait theory.Armidale, Australia:The University of New England.
  7. Fraser, C.,McDonald, R. P.(2003).NOHARM: A Windows program for fitting both unidimensional and multidimensional normal ogive models of latent trait theory.Armidale, Australia:The University of New England.
  8. Kasper, G.,Rose, K.(2001).Pragmatics in Language Teaching.Cambridge:Cambridge University Press.
  9. Lado, R.(1961).Language testing.London:Longman.
  10. McDonald, R. P.(2000).A basis for multidimensional item response theory.Applied Psychological Measurement,24,99-114.
  11. McNamara, T. F.(1996).Measuring second language performance.London:Longman.
  12. Reckcase, M. D.(1985).The difficulty of test items that measure more than one ability.Applied Psychological Measurement,9,401-412.
  13. Reckcase, M. D.,McKinley, R. L.(1991).The discrimination power of items that measure more than one dimension.Applied Psychological Measurement,14,361-373.