108課綱第四學習階段國語文閱讀素養線上評量之建構

Development and Validation of an Online Assessment Module for Mandarin Reading Literacy for Middle School Students of the 12-Year Basic Education Program

謝佩蓉(Pei-Jung Hsieh)

《教育科學研究期刊》 63卷4期 (2018/12) Pp. 193-228

https://doi.org/10.6209/JORIES.201812_63(4).0007

摘要

儘管聽、說、讀、寫都是108學年度預定實施之國語文新課綱的重要元素，然由基本理念可窺知，閱讀能力是新課綱非常重要的關鍵。為發展符合新課綱第四學習階段閱讀素養所需線上評量，本研究目的為建立新課綱第四學習階段國語文素養導向評量發展模式並檢視其成效，從評量架構的建立、文本的挑選或撰寫原則、命題原則等三個方面探討，並分析素養導向試題心理計量特性以支持素養導向評量發展模式的有效性。援用三角檢證法，經由三場評量架構專家會議、20場命題工作坊，本研究取得三向度評量架構與16項評量指標，建構五項文本的挑選或撰寫原則，10項素養導向試題之命題原則，以及23篇文本之201題閱讀素養導向試題之效度證據。試題置於i-Assessment研究團隊所開發的線上平台進行預試。經三梯次預試，對象來自全臺灣58校1,685位國中七、八、九年級學生。以試題難度、鑑別度、Rasch模式之適配度呈現試題心理計量特性，分析軟體為R，Package為CTT和TAM。17篇文本（73.91%）試題之平均鑑別度指數達.30以上。選擇題平均通過率介於.45～.74之間，難度分布廣；半數建構題為高層次評鑑與省思題，其鑑別度指數平均.37、平均通過率.24，屬高鑑別度、高難度試題，符合期待。試題具備良好心理計量特性，併同歷程中專家肯定的效度證據，共同支持素養導向評量發展模式的有效性。最後透過範例試題，提供教學現場作為命題實務參考。

關鍵字

中等教育 ； 素養導向評量 ； 線上測驗 ； 閱讀理解

並列摘要

Reading is one of the key elements of the 12-year basic education curriculum guidelines for elementary schools, junior high schools, and general senior high schools: Language and Literature Category - Chinese Language and Literature. This study developed an online reading assessment module in line with the new curriculum guidelines. A literacy-based assessment module was established to construct an assessment framework, text selection or writing principles, item writing principles, and reading literacy-oriented items. The psychometric characteristics of the items were also investigated to support the validity of the module. The principles and items were validated through the triangulation method. By conducting assessment framework meetings and item writing workshops, a 3-dimensional assessment framework, 17 indicators, 5 text writing principles, and 10 item writing principles were obtained. The Online Assessment for Science Literacy platform was adopted for 23 testlets with 201 items for pilot test administration. The participants were 1,685 junior high school students from 58 schools in Taiwan. Item difficulty, discrimination, and infit mean square statistics were analyzed using the CTT and TAM packages in R. The average discrimination of 17 testlets (73.91%) was more than .30. The average p-value of multiple choice items ranged from .45 to .74. The average discrimination of half of the constructed response items was .37 and the average p-value was .24, which revealed high discrimination and high difficulty. The sample items were also provided as a reference for preparing assessment designs for schools in the future.

並列關鍵字

literacy-based assessment ； online assessment ； reading comprehension ； secondary education

參考文獻

唐淑華、蔡孟寧、林烘煜（2015）。多文本課外閱讀對增進國中學生理解歷史主題之研究：以「外侮」主題為例。教育科學研究期刊，60（3），63-94。【Tang, S.-H., Tsai, M.-N., & Lin, H.-Y. (2015). Using multiple texts to foster junior high students’ historical understanding. Journal of Research in Education Sciences, 60(3), 63-94. 10.6209/JORIES.2015.60(3).03】

唐淑華、蔡孟寧、林烘煜（2015）。多文本課外閱讀對增進國中學生理解歷史主題之研究：以「外侮」主題為例。教育科學研究期刊，60（3），63-94。【Tang, S.-H., Tsai, M.-N., & Lin, H.-Y. (2015). Using multiple texts to foster junior high students’ historical understanding. Journal of Research in Education Sciences, 60(3), 63-94. 10.6209/JORIES.2015.60(3).03】

劉宜芳、柯華葳（2017）。線上閱讀研究之回顧與展望。教育科學研究期刊，62（2），61-87。【Liu, I.-F., & Ko, H.-W. (2017). Online reading research: A selective review. Journal of Research in Education Sciences, 62(2), 61-87. 】

劉宜芳、柯華葳（2017）。線上閱讀研究之回顧與展望。教育科學研究期刊，62（2），61-87。【Liu, I.-F., & Ko, H.-W. (2017). Online reading research: A selective review. Journal of Research in Education Sciences, 62(2), 61-87. 】

蘇慧珍、楊凱琳、陳佳陽（2017）。閱讀策略教學對高二學生數學學習表現的影響。教育科學研究期刊，62（1），33-58。【Su, H.-C., Yang, K.-L., & Chen, C.-Y. (2017). Effects of teaching reading strategies on senior high school student's mathematics performance. Journal of Research in Education Sciences, 62(1), 33-58. 2】