基於體感互動科技發展互動式溝通與情緒感知平台

Development of Interaction and Emotion Detect Platform base on Motion Capture

陳延暐(Yen-Wei Chen)

指導教授 ： 徐業良

元智大學/工程學院/機械工程學系/碩士(2011年)

https://doi.org/10.6838/YZU.2011.00341

摘要

由於現代社會生活與工作型態的變遷，高齡者獨居現象逐漸增多，如能提供高齡者更具互動性且更直覺的遠距溝通工具，也會有助高齡者維持健全的人際溝通網路，並且避免孤獨感所帶來的負面影響。另外高齡者日常生活活動的表現也與健康狀況有密切的關係，而針對高齡者的活動力監測也可有助於提早發現潛在疾病或生理機能退化，另外在居家環境中的心理狀態，如情緒、壓力，也是亟需關注的部分。
近年來「體感互動科技」的興起，已可直接感測身體動作進行互動式操作，其中Kinect是目前最熱門的體感互動科技商品之一，在搭配骨架辨識軟體後，可獲得人體關節的座標及方向資訊，本研究使用Kinect作為感測器，並將此技術應於遠距溝通、活動力監測以及情緒感知三方面。在遠距溝通中透過肢體動作的操作，可達到更直覺、更具互動性的通訊方式；另外在活動力監測中，透過截取關節位置之特性，觀察其移動的次數及幅度，並且也可觀察特定的關節部位達到異常活動的功能，如跌倒偵測；本研究也將此特性，更進階的使用於情緒感知，透過觀察肢體的動作，判斷其情緒之種類以及激烈程度。
本研究也開發互動式溝通與情緒感知平台IERP(Interaction and Emotion Recognition Platform)將上述之功能整合，另外也特別針對視訊中眼神接觸的問題作改善，透過本研究對於Kinect之探索，也驗證其功能應用於高齡者照護之可能性。

關鍵字

Kinect ； 體感互動 ； 互動式溝通 ； 情緒感知 ； 活動力監測

並列摘要

Because of he transition of the modern society and the work state, the phenomenon of the elder living along increase progressively. Providing an interactive and intuitional tele-communication can help elder to maintain a complete interpersonal communication , and avoid the negative effect from loneliness. Besides, the performance of activity of daily living also has high relationship with elderly health. The potential disease and the degeneration of physiological function can also be discovered by monitoring their activity of daily living.
The Somatosensory interactive technology can let people use their body to control the function interactively, and Kinect is the most popular product in recent year. With skeleton recognition software, it can get the joint coordinate and direction information. We use the kinect as a sensor in this research, and development of tele-communication, ADL monitoring and emotion recognition base on the Somatosensory interactive technology. In tele-communication, user can operate the function by moving their body posture. In ADL monitoring, kinect can observe the number and range of movement, even fall detect. In emotion recognition, we also can determine the variation of emotion by observing user’s limbs movement.
We also developed an IERP(Interaction and Emotion Recognition Platform) to combine those three functions, and improved the effect of the eye contact in web conference. In this research, we discovered the function of the Kinect, and prove the possibility of using Kinect in the elderly home care system.

並列關鍵字

Kinect ； interactive communication ； emotion recognition ； ADL monitoring

參考文獻

[1]Butler, R. Foreword in Birren, J., Detuchman, D. (Eds), 1991, Guiding autobiography groups for older adults: Exploring the fabric of life, Baltimore, Maryland: John Hopkins University Press,.

[4]Bachman, D. L., Wolf, P. A., Lin, R.T., 1993 “Incidence of dementia and probable Alzheimer’s Disease in a General Population: The Framingham Study”, Neurology, Vol.43, pp. 515-519.

[5]Mehrabian, A. and Ferris, S. R., 1967, “Inference of Attitudes from Nonverbal Communication in Two Channels”, Journal of Consulting Psychology, Vol.31, No.3, pp. 248-252.

[15]Zhang, Z., He, A., and Wei, D., 2008, “A Mobile Network-based Multimedia Teleconference System for Homecare Services”, TELEMEDICINE and e-HEALTH, Vol.14, No.2, pp.147-155.

[20]Tsai, Y .P., Kao ,C. C., Hung. Y. P. and Shih, Z. C., 2004, “Real-Time Software Method for Preserving Eye Contact in Video Conferencing”, journal of information science and engineering 20, 1001-1017.