網路化檔案評量標準與信、效度之建立

Construction of The Rubrics, Reliability and Validity of Web-Based Portfolio Assessment

吳明芳(Ming-Fang Wu)

指導教授 ： 張基成

國立臺北科技大學/人文與科學學院/技術及職業教育研究所/碩士(2008年)

摘要

本研究建立網路化檔案評量標準，結合網路化檔案評量系統，以北部某高級職業學校會計事務科修習課程「計算機應用」的學生為研究對象，建立評量標準的信、效度。具體研究目的與結果如下：在網路化檔案評量標準建構部份：一、建立網路化檔案評量標準包含六大面向與三十二項指標。二、以作品面向的信效度最高，情意面向最低；網路化檔案評量的信度部份：一、本研究所建立的網路化檔案評量標準具備良好信度。二、教學者評量是具有足夠信度（含評量者間、評量者內）的網路化檔案評量方式。三、學習者自評是具足夠信度的網路化檔案評量方式。四、網路化檔案同儕互評信度不足，原因有待進一步驗證；網路化檔案評量的效度部分：一、本研究所建立的網路化檔案評量標準具備良好效度。二、學習者自評是具有效度的網路化檔案評量方式。三、網路化檔案評量的同儕互評之效度低。四、網路化檔案評量之自評較同儕互評具效度。五、網路化檔案評量的教學者評量、學習者自評、同儕互評分數之間有顯著差異；同儕互評最寬鬆，教學者評最嚴格；信、效度建立所遭遇的困難與限制則是更多元的評量面向雖有助於評量標準信效度的提升，但對於評量方式的信效度驗證卻有影響。

關鍵字

結構式網路化學習歷程檔案 ； 檔案評量 ； 學習歷程檔案 ； 評量標準

並列摘要

This study constructed the rubrics of web-based portfolio assessment, which is the combination of web-based portfolio assessment system. This experiment was taken by Department of Accounting affairs students, who took computer application,from a vocational school in northern Taiwan. Based on the result, we found the reliability and validity of portfolio assessment. The aim and result of this research are as followed: The part of Rubrics of Web-Based Portfolio Assessment: 1. Founding the grading standard of The Rubrics of Web-Based Portfolio Assessment, this includes 6 aspects and 32 rubrics. 2. The reliability in the work aspect is the highest, while it is the lowest in the aspect of motion. The part of the reliability of web-based portfolio
assessment: 1. The web-based portfolio assessment has good reliability. 2. The teacher
assessment is a highly reliable web-based portfolio assessment, which includes the reliability between examinees and examinees themselves. 3. Self assessment is a kind of reliable web-based portfolio assessment.4. peer-assessment doesn’t have enough reliability, and the reason needs further research for proofs.The part of web-based portfolio assessment system:1. The web-based portfolio assessment system that this research founds has good validity2. Self evaluation is a valid way of web-based portfolio assessment.3. The validity of peer-assessment is low.4. The validity of self evaluation of web-based portfolio assessment is higher than that of peer-assessment.There is much difference between educator’s grading, self valuation, and peer-assessment; peer-assessment is the loosest, while those from the educators are the strictest. The difficulties and restrictions from reliability and validity are that although various evolution processes helps upgrade the reliability and validity of assessment, it affects the proof of them as well.

並列關鍵字

Structured web-based portfolio ； Portfolio assessment ； Learning portfolio ； Rubrics of portfolio assessment

參考文獻

Martin, R. J. (1998). A study of the reflective practices of physical education student teachers. Unpublished Doctoral Dissertation. Columbia University, New Youk.

張基成（民92a）。學習歷程檔案講義。台北科技大學技術及職業教育研究所。（未出版）

張基成（民92b）。學習檔案的分類講義。台北科技大學技術及職業教育研究所。（未出版）

郭應全（民93）。結構式網路化檔案評量系統。台北科技大學技術及職業教育研究所碩士論文。（未出版）

鄭雅文（民91）。電子化反省思考學習歷程檔案的設計與應用。台灣師範大學資訊教育研究所碩士論文。（未出版）