應用田野調查法於SimuSurvey之成效性和使用性評估

Effectiveness and Usability Evaluation of SimuSurvey Using Field Study Approach

蔡雪華(Choi Suet Wa)

指導教授 ： 謝尚賢

國立臺灣大學/工學院/土木工程學研究所/碩士(2008年)

https://doi.org/10.6342/NTU.2008.01683

摘要

在工程教學環境中，學生除了要學會理論外，也要學會實作與應用，所以一般都會有實驗課，目的讓學生可以學會應用；然而，由於環境和器材限制，為了要解決限制所引起教學上的問題和使學生有效地學習知識，教學人員會利用一些教學輔助工具來輔助教學。然而一個有用的(usefulness)輔助教學工具才能對教學有幫助，所以必須了解輔助教學工具的在教學環境下之使用性（usability）和成效性(effectiveness)。
本研究提出應用參與觀察法進行教學輔助工具之使用性和成效性評估的方法和步驟，以名為SimuSurvey的測量輔助教學工具應用在測量實習課為案例進行二次實作研究，第一次實作是把SimuSurvey直接導入到課堂授課中，第二次實作是應用SimuSurvey於課堂外,並配合課堂內容作預習和複習用。在實作中，研究者以我就是使用者的概念半參與半觀察在教學環境中收集相關資料，並用田野筆記方便快速收集野外觀察資料。在資料分析，綜合質化和量化資料分析方法得到電腦輔助教學工具之完整使用性和成效性的結果。
經過二次案例實作，可知本研究提出應用參與觀察法之方法和步驟是可行而且有效。同時發現應用參與觀察法進行使用性和成效性評估可找出隱藏的使用性問題和功能性需求。最後從二次案例實作經驗中了解應用參與觀察法所需注意之事項。

關鍵字

使用性評估 ； 成效性評估 ； 參與觀察法 ； 電腦輔助教學工具 ； 使用性問題 ； 功能性需求

並列摘要

A Computer-Aided Instruction (CAI) tool, called SimuSurvey, is being developed at Department of Civil Engineering, National Taiwan University for assisting surveyor training. This tool can help instructors to demonstrate theories and allow students to practice surveying all by themselves. Although SimuSurvey has been evaluated well in surveyor training and surveying teaching for its feasibility and effectiveness, its effectiveness and usability of assisting students to learn and apply the basic knowledge and instrument operation skills has not been studied in real surveying practicing situations. In this research, we applied a field study approach, called the participant observation method, to evaluate the usability and effectiveness of SimuSurvey through field observation of students’ behaviors in surveying practicing. The method and procedure required for realizing the participant observation method for evaluation of SimuSurvey and other CAI tools are designed.
Two case studies are carried out in this research to investigate and demonstrate the usability and effectiveness of the proposed method and procedure. In the case studies, we not only participate in implementing SimuSurvey into teaching, but also observe the behaviors of the students. Through both of the qualitative and quantitative analyses on the observation data, questionnaires and tests, SimuSurvey is shown to be usable and effective. Also, some hidden usability problems and functional requirements are found. Besides, according to the case studies, a caution list is summarized for readers who wish to apply the participant observation method in their researches.

並列關鍵字

usability evaluation ； effectiveness evaluation ； participant observation method ； computer-aided instruction tool ； usability problem ； functional requirement

參考文獻

呂卓堅(2008)，工程測量實習之電腦輔助教學研究，博士論文，國立台灣大學土 木工程學研究所，台北。

Carolyn, B. S. (1999). “Qualitative Methods in Empirical Studies of Software Engineering.” IEEE Transactions on Software Engineering, Vol. 25 n.4, 557-572

Douglas, J.D. et al. (1980). Introduction to the Sociologies of Everyday Life, Allyn & Bacon, Boston.

Goffman, E. (1959). The Presentation of Self in Everyday Life, Garden City, Doubleday, New York.

Han, S. H. & Yang, H. C. (2004). “Screening Important Design Variables for Building a Usability Model: Genetic Algorithm-Based Partial Least-Squares Approach.” International Journal of Industrial Ergonomics, Vol. 33, 159-171.