基於臉部膚色時空特性變化資訊之情緒分類

EmoInside: Emotion Classification from Spatial-Temporal Variations of Skin Color in Face

吳政陽(Cheng-Yang Wu)

指導教授 ： 吳家麟

國立臺灣大學/電機資訊學院/資訊網路與多媒體研究所/碩士(2014年)

https://doi.org/10.6342/NTU.2014.00686

摘要

本論文提出了一利用臉部膚色之時空變異特性的情緒分類方式。過去使用生理訊號分類情緒的方法往往會受到訊號取得不易的限制，或者是用以取得訊號的裝置昂貴，從而使此無法實用。

我們在本論文中利用了遠距生理訊號量測的原理，透過一空間-時間濾波的方式，將臉部之生理訊號，從由一般攝影機所拍攝的影片中擷取出來。並用以分類情緒。以此方式擷取的訊號，在實驗中的表現，與由儀器量測的訊號效能相彷甚至更佳，證明了以此種訊號分類情緒方法的可行性。

關鍵字

情緒分類 ； 膚色 ； 生理訊號

並列摘要

In this thesis, we proposed a framework for classifying emotions by utilizing the face skin color variations. Previous approaches of classifying emotions with philological signal are limited by the difficulty of acquiring such signals in practice. The proposed method use a spatial-temporal filter to extract the face skin color variation signal in a video which is recorded by a consumer level camera and classify emotions with the extracted signal. The proposed approach is evaluated on a public database MAHNOB-HCI-Tagging and compared with the result provided by the database provider. The results showed the feasibility of the proposed approach, which implies the possibility of emotion classification by remotely estimated physiological signals in face.

並列關鍵字

Emotion Classification ； Skin Color ； Physiological Signal

參考文獻

Society for Optics and Photonics, 1985.

map fitting with constrained local models. In Computer Vision and Pattern Recognition

Recognition using class specific linear projection. Pattern Analysis and Machine

[5] G. de Haan and V. Jeanne. Robust pulse rate from chrominance-based rppg. IEEE

transactions on bio-medical engineering, 60(10):2878, 2013.