Validating the Cloze Items in the English Subtest of the General Scholastic Ability Test in Taiwan

台灣大學學科能力測驗英語科測驗克漏字題目效度的驗證

劉玉玲(Yu-Ling Liu) ； 林文鶯(Wen-Ying Lin) ； 游錦雲(Ching-Yun Yu)

《語文與國際研究》 20期 (2018/12) Pp. 1-23

https://doi.org/10.3966/181147172018120020001

摘要

In Taiwan, English is regarded a key subject in high school curriculum. Hence, before entering university, high school seniors are required to take an English subtest (ES) of the General Scholastic Ability Test (GSAT). Their scores on the GSAT-ES, besides other subtests, influence considerably their future academic pursuit and career path. To them, an important question is: What does the GSAT-ES really measure - several aspects of their English proficiency or just their overall English proficiency? This study was aimed to address, among others, such a question and focus particularly on the two types of cloze items in the GSAT-ES. For this study, a simpler version of Purpura's (2004) model of grammatical knowledge was adopted to classify the cloze items. Classification was done by a group of five experienced university-level English teachers. Then confirmatory factor analysis (CFA) was applied to investigate the degree of fit between the raters' classifications and the test takers' responses. The CFA findings indicated that the raters' classifications failed to fit the test takers' responses and that the one-component model best portrayed the response data. The finding of a one-component model agreed with the unitary competence hypothesis of Oller (1976, 1979), who advocated using cloze items for measuring overall language proficiency. This study concluded with some relevant implications for English teaching and testing.

關鍵字

cloze test ； construct validity ； confirmatory factor analysis ； overall English proficiency

並列摘要

本研究目的乃是藉由驗證性因素分析方法，探討台灣大學學科能力測驗英語科測驗中克漏字題目的構念效度。本研究邀請五位專家們根據Purpura（2004）理論架構將2015及2016年克漏字題目進行題目分類，主要研究問題是在檢視此分類架構與考生的答題資料是否有適配性？為回答此研究問題，本研究向大學考試入學中心申請2015及2016年隨機抽樣各5,500位學生每題克漏字答題的得分資料。本研究藉由驗證性因素分析探討專家將題目分類後產生的測量模型是否與考生的實徵資料相互配適，以期能找出實徵資料的最佳適配模型。研究結果顯示，專家的題目分配模型與實徵資料的適配度不是最佳的，最佳的適配度模型反而是單一整體特質模型。也就是說，本研究結果顯示，大學學科能力測驗英語科測驗克漏字題目乃是在測量整體英語閱讀能力。最後，本研究也根據研究結果，針對高中英語教師與大學考試入學中心編寫克漏字試題相關人員，提出具體建設。

並列關鍵字

克漏字 ； 構念效度 ； 驗證性因素分析 ； 整體英語閱讀能力

參考文獻

Alderson, J. C.(1979).The cloze procedure and proficiency in English as a foreign language.TESOL Quarterly.13(2),219-227.

Alderson, J. C.(1980).Native and non-native speaker performance on cloze tests.Language Testing.30(1),59-76.

Anderson, D. C.(1980).Cohesion and the Cloze Test.University of Illinois, Urbana-Champaign.

Bachman, L. F.(1982).The traits structure of cloze test scores.TESOL Quarterly.16(1),61-70.

Bagozzi, R. P.,Yi, Y.(1988).On the evaluation of structural equation models.Academic of Marketing Science.16(1),76-94.