萃取表情重要特徵進行表情辨識與表情強度分析

Classifying Expressive Face Images with Expression Degree Estimation

莊蕙如(Hui-Ju Chuanh)

指導教授 ： 賴尚宏

國立清華大學/電機資訊學院/資訊工程學系/碩士(2009年)

https://doi.org/10.6843/NTHU.2009.00655

摘要

In this thesis, we propose a novel system to estimate the intensity of different human facial expressions. Based on the modified optical flow computation, we model the motion of facial pixels instead of relying on complex muscle model and reduce the demand to detect many facial feature points.
According to the assumption that faces of the same expression are close in the expression space, this thesis also proposes a novel weighting scheme for the facial optical flow field by using a quadratic programming formulation. Experiments manifest the efficiency of the proposed system on the expression intensity estimation and expression recognition of face images.

關鍵字

光流場 ； 二次線性規劃 ； 表情辨識 ； 表情強度分析

並列摘要

在這篇論文中，我們提出一個可在不同人臉分析表情強度的分析系統。由於我們使用整張人臉的光流場向量作表情分析的特徵，所以並不需要依賴過多的人為控制即可做辨識。
首先，我們假設即使是不同個體在表現相同表情時，會有部分的臉部肌群是呈現類似的運動，因此我們設計一個新的特徵去描述該運動的方向性，並且 將整個問題轉換為一個有條件下的二次數學規劃問題( constrained quadratic programming )，透過統計找出對某種表情較具有代表性的區域，在做表情分析及表情分類時，提升該部分特徵的參考價值，進而做出較正確的判斷。

並列關鍵字

Optical Flow ； quadratic programming ； expression recognition ； expression intensity estimation

參考文獻

[1] A. Frome, Y. Singer, F. Sha, and J. Malik, ”Learning Globally-Consistent Local Distance Functions for Shape-Based Image Retrieval and Classification,” Proceedings of IEEE 11th International Conference on Computer Vision, pp.1-8, 2007.

[2] C.-H. Teng, S.-H. Lai, Y. S. Chen, and W.-H. Hsu, “Accurate optical flow computation under non-uniform brightness variations,” Computer Vision and Image Understanding, vol. 97, no. 3, pp. 315-346, 2005.

[6] Dong Guo and Terence Sim,“Digital face makeup by example,” Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp.1-8, 2009

[8] Y. Kosaka and K. Kotani,”Facial expression analysis by kernel eigenspace method based on class features (KEMC) using nonlinear basis for separation of expression-classes,” Proceedings of IEEE International Conference on Computer Vision, pp. 1409- 1412, 2004.

[10] M. Pantic, L. Rothkrantz,”Expert system for automatic analysis of facial expression,” Image and Vision Computing Journal, vol.18, no.11, pp. 881-905, 2000.