發展面試互動情緒感知與評量機器人之設計思考

Design Thinking for Developing Emotional Sensing and Evaluation Robot of Interactive Interview

王聖銘(Sheng-Ming Wang) ； 黃絜如(Chieh-Ju Huang) ； 林書瑄(Shu-Xuan Lin)

《數位學習科技期刊》 11卷2期 (2019/04) Pp. 87-114

https://doi.org/10.3966/2071260X2019041102004

摘要

本研究探討如何應用設計思考方法，提供不同背景的使用者，於面試互動中情緒感知及評量的方法與系統。若能透過系統化及跨領域設計，發展能模擬面試，並偵測面試者之情緒，以及整合語意偵測及專業關鍵字評量的對話機器人，將有助於面試者透過自我練習與評量的回饋，增進面試時的專業表現。研究顯示，若導入情感運算技術及機器學習機制，深化互動服務機器人與使用者之間的互動與回饋，則更能符合服務情境與未來創新服務發展的需求。本研究架構於跨領域整合設計思考、情緒偵測技術及案例式推理分析的方法，以模擬面試的服務情境為實證研究案例，建置情緒感知機器人的原型系統，針對情緒感知的方法進行規劃與測試，並提出三個情緒偵測分析指標：臉部表情快樂指數、眼睛眨眼頻率、個人履歷文本語意情緒；作為本研究情緒感知的分析依據，以實驗結果分析相關技術整合的成效，以及系統發展之價值、效用與示能性。本研究以應用案例式推理分析的方法，建立互動服務情境及使用者專業背景與情緒感知評價系統的連結，除能符合人本設計以使用者為導向的需求及系統應用之示能性外，後續可透過案例庫累積，逐步調整各情緒偵測指標之權重，建立情緒感知機器人在未來學習機制的基礎。

關鍵字

人本設計 ； 案例式推理 ； 情緒感知 ； 設計思考 ； 機器學習

並列摘要

As the application of design and technology has become more interdisciplinary and integrated, the development of interactive service robots (ISRs), which are designed according to unique situational requirements, has emerged as a popular trend. Research has shown that if affective computing technology and machine learning mechanisms can be introduced to enhance interaction and feedback between ISRs and users, ISRs can better satisfy the needs of a greater number of people. In addition, they may be better aligned with both the service context and the future development of innovative services. Based on an interdisciplinary integration framework, this study combines the concept and method of design thinking, emotion-detection technology, and case-based reasoning (CBR) to simulate the service situation of an interview, and thus to develop a prototype emotion-sensing robot (ESR) system. The results of the experiment were then used to analyze the effectiveness of integrating corresponding technologies as well as the value, utility, and affordance of the developed system. This study constructed an ESR prototype and validated its worth as an application by integrating and testing core emotion-detection technologies. The ESR developed based using an interdisciplinary approach is able to connect user needs and the application of technology to the development of corresponding functions. Furthermore, this study introduced CBR analysis to establish a link between an interactive service context, the professional backgrounds of users, and an emotion-sensing evaluation system. Despite meeting both user requirements and user-centered design requirements, as well as demonstrating the feasibility of the system, future studies are necessary to enrich the cases in the database of CBR system and establish a foundation of machine learning principles for ESRs.

並列關鍵字

user-centered design ； case-based reasoning ； emotional robot ； design thinking ； machine learning

參考文獻

Lievens, F., Highhouse, S., & Corte, W. (2005). The importance of traits and abilities in supervisors’ hirability decisions as a function of method of assessment. Journal of Occupational and Organizational Psychology, 78(3), 453-470. doi:10.1348/096317905X26093

王志豔、周強（2013）。表情心理學。新北市：華志文化。【Wang, C.-Y., & Chou, C. (2013). Expression psychology. New Taipei City, Taiwan: W. C. Culture.】

吳珊燕、許鑫（2013）。基於案例推理的菜譜推薦系統研究。現代圖書情報技術，12，34-41。【Wu, S.-Y., & Xu, X. (2013). Cooking recipe recommendation system based on CBR. Data Analysis and Knowledge Discovery, 12, 34-41.】

孫波、劉永娜、陳玖冰、羅繼鴻、張迪（2015）。智慧學習環境中基於面部表情的情感分析。現代遠程教育研究，2，96-103。【Sun, B., Liu, Y.-N., Chen, J.-B., Luo, C.-H., & Zhang, D. (2015). Emotion analysis based on facial expression recognition in smart learning environment. Modern Distance Education Research, 2, 96-103.】

陳建丞（2005）。應徵者外表吸引力對面試官評量之影響─以面試官訓練為干擾變數。人力資源管理學報，5（4），55-66。【Chen, C.-C. (2005). Exploring moderating effect of the influence of applicant physical attractiveness in job interviews: Interviewer training as the moderator. Journal of Human Resource Management, 5(4), 55-66.】