網路化檔案評量環境下教學者評、學生自評與同儕互評之信效度比較

Comparisons of Reliability and Validity among Instructor Assessment, Student Self-Assessment and Peer-Assessment under Web-Based Portfolio Assessment Environment

張基成(Chi-Cheng Chang) ； 吳明芳(Ming-Fun Wu)

《教育資料與圖書館學》 49卷1期 (2011/09) Pp. 135-170

https://doi.org/10.6120/JoEMLS.201109_49(1).0386.RS.CM

摘要

本研究比較網路化檔案評量環境下教學者評、學生自評與同儕互評的信效度。研究樣本為某高職二年級修習「計算機應用」課程的72位學生。學生使用網路化檔案評量系統進行檔案的製作、觀摩、自評與同儕互評，教師透過系統檢視學生的檔案並評量其學習表現。在三種評量結果之間差異上，教學者評、學生自評、同儕互評三種評量結果有顯著差異，其中教學者評量最為嚴格、其次為學生自評，同儕互評最為寬鬆。在三種評量結果之間一致性上，僅自評與教師評之間具一致性。自評與同儕互評之間、同儕互評與教學者評之間，都不具一致性。在三種評量結果與測驗成績一致性上，教學者評分結果與測驗成績具高度一致性，學生自評與測驗成績亦具高度一致性；而同儕互評結果與測驗成績一致性低。

關鍵字

網路化學習歷程檔案 ； 網路化檔案評量 ； 自評 ； 同儕互評

並列摘要

This study compares the reliable and validity among instructor assessment, student self-assessment and peer-assessment under the Web-based portfolio assessment environment. The research samples consist of 72 students who take ”Computer Application” course of the second grade in some vocational high school. The students use the Web-based portfolio assessment system for creating their portfolio, emulating peers' portfolio, and performing self-assessment and peer-assessment. The teacher uses the system for reviewing and assessing students' learning performances. In regard to the difference among the three assessment approaches, there exists a significant difference among the three approaches. Instructor assessment is most rigorous, while peer-assessment is most slack. In regard to the correlation among the three assessment approaches, there exists a significant consistency between self-assessment and instructor assessment. There exist inconsistencies between self-assessment and peer-assessment as well as peer-assessment and instructor assessment. In regard to the correlation among the three assessment results and test score, there exist a high consistency between instructor assessment and test score. As well, there exist a high consistency between self-assessment and test score. However, the consistency between peer-assessment and test score is inadequate.

並列關鍵字

Web-based portfolio ； Web-based portfolio assessment ； Self-assessment ； Peer-assessment

參考文獻

王保進(2006)。中文視窗版SPSS 與行為科學研究。台北市=Taipei:心理出版社=Psychological Publishing Co., Ltd.。

余民寧(2003)。教育測驗與評量：成就測驗與教學評量。台北市=Taipei:心理出版社=Psychological Publishing Co., Ltd.。

卓宜青(2001)。網路化學習歷程檔案系統及同儕評量。國立交通大學資訊科學系=Department of Computer and Information Science, National Chiao Tung University。

吳明隆、涂金堂(2008)。SPSS與統計應用分析。台北市=Taipei:五南=Wu-Nan。

邱皓政(2008)。量化研究與統計分析：SPSS中文視窗版資料分析範例解說。台北市=Taipei:五南=Wu-Nan。