我國技術學院綜合評鑑之後設評鑑研究

A Meta-Evaluation on Comprehensive Evaluation of Institutes of Technology in Taiwan

周明華(Ming-Hwa Jou)

指導教授 ： 楊朝祥 ； 田振榮

國立臺灣師範大學/科技學院/工業教育學系/博士(2009年)

摘要

本研究旨在探討高等技術校院擴增、高教普及化之後，如何改進評鑑作業，確保教育品質。本研究目的包括：1.發展技術學院綜合評鑑之後設評鑑標準；2.依據後設評鑑標準實施問卷調查，分析技術學院綜合評鑑實施情形；3.瞭解評鑑委員、受評學校人員在後設評鑑之看法；4.比較不同背景評鑑委員、受評學校人員在後設評鑑看法的差異；5.訪談並瞭解技職教育及評鑑專業領域之學者專家對技術學院評鑑之看法；6.綜合比較問卷調查與專家訪談結果，歸納研究結論，提出建議，供主管教育行政機關參考。

本研究採用問卷調查及專家訪談等研究方法進行，研究對象包括：95、96年度參與教育部辦理技術學院綜合評鑑之評鑑委員及受評學校代表、教育行政機關與技職教育及評鑑領域學者代表。主要研究工具為「我國技術學院綜合評鑑調查問卷」及訪談題綱。

本研究主要結果如下：
1.技術學院綜合評鑑之後設評鑑標準包含四個構面、廿一個向度、七十二個題項；2.根據五等量表之後設評鑑標準，技術學院綜合評鑑在後設評鑑標準四個構面之同意度略高於「普通」；3.探討不同身份、不同背景者對技術學院綜合評鑑看法之差異性。4.驗證問卷調查與專家訪談結果發現：(1)評鑑能達成發現問題、積極改善、提升品質的目標；(2)技術學院綜合評鑑尚屬公正客觀，能適度反映辦學實況；(3)指標尚能彰顯技職教育特色，但須正確解讀指標意涵；(4)評鑑委員需具備專業領域、技職教育、評鑑專業等知能；(5)學校自我評鑑機制仍待加強；(6)評鑑之晤談時間有助驗證學校辦學策略及瞭解教學；(7)現階段技術學院評鑑採等第制尚屬合宜；(8)評鑑成績的等第分佈尚屬合理；(9)尚能同意評鑑結果與政府之行政措施結合；(10)評鑑執行單位能妥當安排評鑑程序，順利完成評鑑工作；(11)評鑑委員多能遵守倫理、利益迴避原則；(12)受評者的權益受到充分重視；(13)評鑑結果尚能符合社會期待。最後提出近程、中長程及後續研究建議。

關鍵字

技術學院 ； 綜合評鑑 ； 後設評鑑

並列摘要

This study aims to probe how to improve the evaluation process in order to ensure educational quality after the enlargement of higher educational institutions which leads to the popularization of higher education in Taiwan. The objectives are: 1. to develop meta-evaluation criteria for comprehensive evaluation of institutes of technology, 2. to analyze the implementation of comprehensive evaluation based on the meta-evaluation criteria through questionnaire survey, 3. to understand the viewpoints of meta-evaluation in the evaluators and the staff of the institutions evaluated, 4. to compare the differences in the opinions on meta-evaluation among evaluators and institution staff with different background, 5. to interview scholars and experts in the related fields of technological education & evaluation in order to understand their viewpoints about the implementation of evaluation on technological institutions, 6. to propose suggestions for educational administration authority based on the synthesized findings of questionnaire survey and interviews of this study.

Questionnaire survey and interview were adopted in this study. The major groups of stakeholders involved in the process of this study were: evaluators and the randomly chosen faculty members of schools which were evaluated by the Ministry of Education in 2006 & 2007, the representatives of educational administration authority and scholars in the field of technological education. ‘The Questionnaire of the Comprehensive Evaluation of Institutions of Technology’ & interview outlines were developed by the author as research tools.
The major results of this study are as follows:
1. The criteria of meta-evaluation consist of 4 domains (utility , feasibility , propriety, accuracy), 21 dimensions and 72 items. 2. Based on the meta-evaluation criteria adopting a five-point Likert scale, the result indicates that the approval rating on the 4-domain components of meta-evaluation criteria was slightly higher than the average level in comprehensive evaluation. 3. The differences in opinions on meta-evaluation among those people with different background are discussed. 4. After the verification of the result of questionnaire survey and interview, the major findings are: (1) the evaluation can help schools achieve the goals of discovering problems, improving the current system, and upgrading educational quality, (2) the comprehensive evaluation is fair and objective that can reflect the real situation how schools operate; (3) the evaluative criteria are able to manifest the characteristics of technological education if they can be precisely interpreted; (4) it is suggested that the evaluators require the abilities in the fields of occupational specialty, technological education and evaluation; (5) school self-evaluation mechanism needs to be improved; (6) interviews with faculties and students during the evaluation process help to verify the school implementation system of educational plans, and to understand the teaching results; (7) it is proper to adopt grading system for comprehensive evaluation at the current stage; (8) the result of grading of comprehensive evaluation was considered reasonable to some extent; (9) it is agreed that the government’s administrative measures and distribution of subsidies were, to some degree, based on the result of evaluation;(10) the executive organization responsible for the evaluation project in schools can carry out the process smoothly; (11) most of the evaluators were able to keep to the evaluative ethics and advantage-taking avoidance principle; (12) the rights and interests of schools have been taken into full consideration; (13) the result of comprehensive evaluation of institutes of technology meets the expectation of the public to some extent. Finally, suggestions for short- , medium- & long-term development and the directions of further research are proposed.

並列關鍵字

Institutes of Technology ； Comprehensive Evaluation ； Meta-Evaluation

參考文獻

教育部（2006d）。95年度技術學院評鑑手冊（評鑑委員）。國立雲林科技大學技術及職業教育研究中心編印（未出版）。

教育部（2009）。教育部技術及職業教育司KMS（未出版）。

教育部（2006c）。95年度科技大學評鑑計畫（評鑑委員手冊）。社團法人台灣評鑑協會編印（未出版）。

陳曼玲（2009）。凸顯技職特色推動技職校院學生全面實施實習與證照法制化—專訪教育部常務次長林聰明。評鑑雙月刊，19，1-3。

徐昌慧（2009）。科技大學暨技術學院評鑑之指標修訂及未來發展。評鑑雙月刊，18期，36-40。