簡易檢索 / 詳目顯示

研究生: 吳明達
Wu, Ming-Ta
論文名稱: 應用字彙能力測驗之驗證研究
A Validation Study of a Productive Vocabulary Knowledge Test
指導教授: 曾文鐽
Tseng, Wen-Ta
學位類別: 碩士
Master
系所名稱: 英語學系
Department of English
論文出版年: 2016
畢業學年度: 105
語文別: 英文
論文頁數: 73
中文關鍵詞: 字彙深度測驗驗證部分得分模式單字長度單字難度拼字知識
英文關鍵詞: vocabulary depth, test validation, partial credit model, word length, word difficulty, orthographic knowledge
DOI URL: https://doi.org/10.6345/NTNU202204647
論文種類: 學術論文
相關次數: 點閱:81下載:3
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 本研究旨在根據教育部公佈的基本1,200個字彙發展並驗證一個可用於測量國中生英語拼字知識的應用字彙能力測驗。本測驗採用多元計分方式來評鑑英語學習者的拼字能力,本研究更試圖去探究單字長度與單字難度之間的關係。受試者來自台北市都會區的一所國中共2,149人。資料分析使用部分得分模式(partial credit model),研究結果顯示該應用字彙能力測驗所提供的測量結果適切,具有效度與信度(Rasch受試者信度 = .96)。雖然整體上該測驗對受試者的程度而言稍嫌簡單,不過試題仍然涵蓋了大部分受試者的能力水平。
    本研究的發現指出單字長度與單字的困難度有中低度相關(r = .38),不過,此相關度隨者單字長度縮短而減弱。經由分析高難度單字的拼字錯誤,結果顯示拼字難度可能與字音一致性及跨語言轉移現象密不可分。

    The present study aims to develop and validate a productive vocabulary knowledge test (PVKT) for measuring junior high school English learners’ orthographic knowledge for productive use based on the Basic 1,200 Word List published by Ministry of Education. A partial credit scoring procedure was adopted to evaluate the spelling proficiency of the English learners. The study further attempts to explore the relationship between word length and word difficulty. A total of 2,149 students from a junior high school in the metropolitan area of Taipei, Taiwan, participated in the study. The partial credit model (PCM) was used to analyze the data. The results revealed that the PVKT was valid and reliable (Rasch person reliability = .96) in providing an appropriate measurement. Further, the test was generally slightly easier for the participants while the items still cover the major range of the participants’ ability level.
    The findings of this study suggest that word length is moderately correlated (r = .38) with word difficulty; however, the correlations weaken as word length shortens. Indications that spelling difficulty could also reside in issues of letter-sound correspondence and cross-lingual transfer were found in error analysis of the spelling of the most difficult words.

    LIST OF TABLES v LIST OF FIGURES vi CHAPTER ONE INTRODUCTION 1 Background and Motivation 1 Research Questions 5 Significance of the Study 6 CHAPTER TWO LITERATURE REVIEW 7 Aspects of Vocabulary Knowledge 7 Receptive vs. Productive 7 Breadth vs. Depth 9 Partial-Precise Knowledge 14 Vocabulary Measurement 17 Tests to Assess Productive Vocabulary Knowledge 17 Criteria for a Good Vocabulary Test 20 Measurement Theories 28 Classical Test Theory 28 Item Response Theory 29 CHAPTER THREE METHODOLOGY 38 The Productive Vocabulary Knowledge Test 38 Test Administration 39 Follow-up Interviews 41 Data Analysis 41 CHAPTER FOUR RESULTS 44 Dimensionality 44 Rasch Reliability Indices 45 Model-data Fit Statistics 46 The Distribution of Person Ability and Item Difficulty 48 Relationship between Word Difficulty and Word Length 50 CHAPTER FIVE DISCUSSION 53 Overview of the Study 53 Test Quality 53 Validity and Reliability 53 Other Aspects of Test Quality 54 Relationship between Word Difficulty and Word Length 58 CHAPTER SIX CONCLUSION 62 Summary of Major Findings 62 Implications 63 Limitations of the Study 64 Suggestions for Future Research 64 REFERENCES 66 APPENDIX: Answer Key 73

    Aitchison, J. (2012). Words in the mind: An introduction to the mental lexicon: John Wiley & Sons.
    Alderson, J. C., Clapham, C., & Wall, D. (1995). Language Test Construction and Evaluation: Cambridge University Press.
    Anastasi, A., & Urbina, S. (1997). Psychological Testing: Prentice Hall.
    Anderson, R. C., & Freebody, P. (1981). Vocabulary Knowledge. DOCUMENT RESUME CS 006 138 Guthrie, John T., Ed. Comprehension and Teaching; Research Reviews. International Reading Association, Newark, Del., 77.
    Association, A. P., Association, A. E. R., Association., A. P., & Education, N. C. o. M. i. (1985). Standards for educational and psychological testing (pp. viii, 100 p. ;). Washington, DC: American Psychological Association.
    Bachman, L. F. (1990). Fundamental Considerations in Language Testing: OUP Oxford.
    Bachman, L. F. (2004). Statistical analyses for language assessment: Cambridge University Press.
    Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice: designing and developing useful language tests: Oxford University Press.
    Baker, F. B. (2001). The basics of item response theory: ERIC.
    Baron, J., & Strawson, C. (1976). Use of orthographic and word-specific knowledge in reading words aloud. Journal of Experimental Psychology: Human Perception and Performance, 2(3), 386.
    Beinborn, L., Zesch, T., & Gurevych, I. (2016). Predicting the Spelling Difficulty of Words for Language Learners. Paper presented at the 11th Workshop on Innovative Use of NLP for Building Educational Applications held in conjunction with NAACL 2016, San Diego, California, USA.
    Bloomer, R. H. (1956). Word length and complexity variables in spelling difficulty. The Journal of Educational Research, 49(7), 531-536.
    Boone, W. J., Staver, J. R., & Yale, M. S. (2014). Rasch analysis in the human sciences: Springer.
    Brown, G. D., & Ellis, N. C. (1994). Handbook of spelling: Theory, process, and intervention: John Wiley & Sons Ltd.
    Cahen, L. S., Craun, M. J., & Johnson, S. K. (1971). Spelling Difficulty. A Survey of the Research. Review of Educational Research, 41(4), 281-301.
    Chen, W.-H., & Thissen, D. (1997). Local dependence indexes for item pairs using item response theory. Journal of Educational and Behavioral Statistics, 22(3), 265-289.
    Coles, M. (1982). Word perception, first language script and learners of English as a second language. Birkbeck College, University of London: MA project.
    Corson, D. (1985). The lexical bar: Pergamon Press Oxford.
    Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory: ERIC.
    Ehri, L. C. (1989). The development of spelling knowledge and its role in reading acquisition and reading disability. Journal of Learning Disabilities, 22(6), 356-365.
    Firth, A. (1996). The discursive accomplishment of normality: On ‘lingua franca’English and conversation analysis. Journal of pragmatics, 26(2), 237-259.
    Goulden, R., Nation, P., & Read, J. (1990). How large can a receptive vocabulary be? Applied Linguistics, 11(4), 341-363.
    Graham, S., Berninger, V. W., Abbott, R. D., Abbott, S. P., & Whitaker, D. (1997). Role of mechanics in composing of elementary school students. Journal of Educational Psychology, 89(1), 170-182.
    Hambleton, R. K. (1991). Fundamentals of item response theory (Vol. 2): Sage publications.
    Hambleton, R. K., & Swaminathan, H. (1985). Item response theory: Principles and applications (Vol. 7): Springer Science & Business Media.
    Haynes, M., & Carr, T. H. (1990). Writing system background and second language reading: A component skills analysis of English reading by native speaker-readers of Chinese.
    He, Q., & Wheadon, C. (2013). The effect of sample size on item parameter estimation for the partial credit model. International Journal of Quantitative Research in Education, 1(3), 297-315.
    Heaton, J. B. (1990). Classroom Testing: Longman.
    Henriksen, B. (1999). Three dimensions of vocabulary development. Studies in Second Language Acquisition, 21(02), 303-317.
    Koda, K. (1997). Orthographic knowledge in L2 lexical processing. Second language vocabulary acquisition, 35-52.
    Laufer, B. (1992). How much lexis is necessary for reading comprehension Vocabulary and applied linguistics (pp. 126-132).
    Laufer, B. (1997). What's in a word that makes it hard or easy: Some intralexical factors that affect the learning of words. In N. Schmitt & M. McCarthy (Eds.), Vocabulary: Description, acquisition and pedagogy (pp. 140-155). Cambridge, England: Cambridge University Press.
    Laufer, B. (1998). The development of passive and active vocabulary in a second language: Same or different? Applied Linguistics, 19(2), 255-271.
    Laufer, B., & Goldstein, Z. (2004). Testing vocabulary knowledge: Size, strength, and computer adaptiveness. Language learning, 54(3), 399-436.
    Laufer, B., & Nation, P. (1995). Vocabulary size and use: Lexical richness in L2 written production. Applied Linguistics, 16(3), 307-322.
    Laufer, B., & Nation, P. (1999). A vocabulary-size test of controlled productive ability. Language Testing, 16(1), 33-51.
    Linacre, J. M. (1998). Detecting multidimensionality: which residual data-type works best? Journal of outcome measurement, 2, 266-283.
    Linacre, J. M. (2006). A user’s guide to WINSTEPS MINISTEP Rasch-model computer programs. Chicago IL: Winsteps. com.
    Linacre, J. M. (2012). WINSTEPS Rasch-model computer programs program manual 3.75. 0. Chicago, IL: WINSTEPS.
    Linacre, J. M. (2014). WINSTEPS®(Version 3.81. 0). Computer Software. Beaverton, OR: Winsteps. com.
    Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47(2), 149-174.
    Masters, G. N. (2010). The partial credit model. In M. L. Nering & R. Ostini (Eds.), Handbook of polytomous item response theory models (pp. 109-122). New York: Routledge.
    Masters, G. N., & Wright, B. D. (1997). The partial credit model. In W. J. van der Linden & R. K. Hambleton (Eds.), Handbook of modern item response theory (pp. 101-121): Springer.
    Meara, P. (1990). A note on passive vocabulary. Second Language Research, 6(2), 150-154.
    Meara, P. (1996). 2 The dimensions of lexical competence. Performance and competence in second language acquisition, 35.
    Meara, P. (2005). Lexical frequency profiles: A Monte Carlo analysis. Applied Linguistics, 26(1), 32-47.
    Meara, P., & Fitzpatrick, T. (2000). Lex30: an improved method of assessing productive vocabulary in an L2. System, 28(1), 19-30.
    Melka, F. (1997). Receptive vs. productive aspects of vocabulary. In N. Schmitt & M. McCarthy (Eds.), Vocabulary: Description, acquisition and pedagogy (pp. 84-102). Cambridge, England: Cambridge University Press.
    Melka Teichroew, F. J. (1982). Receptive versus productive vocabulary: a survey. Interlanguage Studies Bulletin, 6(2), 5-33.
    Milton, J. (2009). Measuring second language vocabulary acquisition: Multilingual Matters.
    Ministry of Education. (2006). 國民中小學九年一貫課程綱要語文學習領域(英語) [Guidelines and requirements of Grades 1-9 curriculum for Elementary and Junior High School Education - Language Area (English)]. Taiwan: Ministry of Education Retrieved from http://www.k12ea.gov.tw/97_sid17/英語970526定稿單冊.pdf.
    Nation, I. S. (2001). Learning vocabulary in another language: Ernst Klett Sprachen.
    Paribakht, T. S., & Wesche, M. B. (1993). Reading comprehension and second language development in a comprehension-based ESL program. TESL Canada journal, 11(1), 09-29.
    Phillips, T. (1981). Difficulties in foreign language vocabulary learning and a study of some of the factors thought to be influential. Birkbeck College, University of London: MA project.
    Read, J. (2000). Assessing vocabulary: Cambridge University Press.
    Read, J. (2004). Plumbing the depths: How should the construct of vocabulary knowledge be defined. Vocabulary in a second language: Selection, acquisition, and testing, 209-227.
    Ryan, A. (1997). Learning the orthographical form of L2 vocabulary -- a receptive and a productive process. In N. Schmitt & M. McCarthy (Eds.), Vocabulary: Description, acquisition and pedagogy: Cambridge University Press.
    Schmitt, N. (1998). Tracking the incremental acquisition of second language vocabulary: A longitudinal study. Language learning, 48(2), 281-317.
    Schmitt, N. (2010). Researching vocabulary: A vocabulary research manual: Palgrave Macmillan.
    Schmitt, N., & Meara, P. (1997). Researching vocabulary through a word knowledge framework. Studies in Second Language Acquisition, 19(01), 17-36.
    Swenson, E., & West, M. (1934). On the counting of new words in textbooks for teaching foreign languages: University of Toronto.
    Tangel, D. M., & Blachman, B. A. (1992). Effect of phoneme awareness instruction on kindergarten children's invented spelling. Journal of Literacy Research, 24(2), 233-261.
    Tseng, W.-T. (2013). Validating a pictorial vocabulary size test via the 3PL-IRT model. Vocabulary Learning and Instruction, 2(1), 64-73. doi:10.7820/vli.v02.1.tseng
    Waring, R. (1997). A comparison of the receptive and productive vocabulary sizes of some second language learners. Immaculata; The occasional papers at Notre Dame Seishin University, 94-114.
    Webb, S. (2005). Receptive and productive vocabulary learning. Studies in Second Language Acquisition, 27, 33-52.
    Webb, S. (2007). The effects of repetition on vocabulary knowledge. Applied Linguistics, 28(1), 46-65. doi:10.1093/applin/aml048
    Webb, S. (2008). Receptive and productive vocabulary sizes of L2 learners. Studies in Second Language Acquisition, 30(1), 79.
    Wilkins, D. A. (1972). Linguistics in language teaching: E. Arnold, 1973.
    Wright, B. D. (1996). Local dependency, correlations and principal components. Rasch measurement transactions, 10(3), 509-511.
    Wright, B. D., Linacre, J. M., Gustafson, J., & Martin-Lof, P. (1994). Reasonable mean-square fit values. Rasch measurement transactions, 8(3), 370.

    下載圖示
    QR CODE