國立科學工藝博物館為配合常態展示與特殊展示主題內容,舉辦許多的推廣活動以促進參與者對科學與技術的認識,吸引參與者的興趣,進而行銷工博館以吸引更多參與者有效應用工博館的各項資源。 為建立活動發展與進行的回饋機制,進而了解活動的成效;本研究之目的即發展國立科學工藝博物館科技教育活動之評量工具。透過文獻探討、專家訪談、參與式觀察、問卷調查、使用者評量等方式,瞭解科技教育活動之評量工具使用環境及使用者之需求,並驗證工具的信效度。 本研究根據文獻、訪談、工具試用、檢討會議、觀察活動等方式,考量評量工具的易用性、質性資料記錄的需要、及活動的種類,評量工具經過多次改版,最後修訂出五種評量工具,分別為(1)評量工具的使用指引;(2)活動評量工具與評量流程圖;(3)工具一:活動規劃人員課程設計檢核表;(4)研習、演示、及闖關等三型態之工具二「活動觀察人員檢核表」;(5)研習、演示、及闖關等三型態之工具三「講師教學行為檢核表」;(6)工具四「活動滿意度調查表」;(7)工具五「評量結果彙整表」。活動觀察人員使用檢核工具的評分信度的檢驗,經七位評量者使用後進行評量指標評分結果進行「評分者使用工具完全百分比一致性檢驗」,獲得平均相互同意度為0.82,信度為0.97。
The purpose of this study was to develop the evaluation tools for the technology education activities in National Science and Technology Museum (NSTM). Through the literature review, panel discussion, observation, and questionnaire, the evaluation tools were developed. To achieve the validity of evaluation tool, researchers applied the tools through three technology education activities in NSTM to find the usage outcome and then refine the tools. Five tools were developed which were Activity Plan Checking Sheet, Observer Evaluation Checking Sheet, Instructor Evaluation Checinig Sheet, Satisfaction Questionnaire, and Evaluation Final Report Form. Internal consisitency examination and scoring agreement examination were used to examine the reliability of Observer Evaluation Checking Sheet. The interscoring agreement value is 0.82; while the interrater reliability value is 0.97.