基於局部外觀基礎方法的人臉驗證之研究

A Study on Face Verification with Local Appearance-Based Methods

林子皓(Tzu-Hao Lin)

指導教授 ： 陳朝欽

國立清華大學/電機資訊學院/資訊工程學系所/碩士(2018年)

摘要

近年來，由於在大眾媒體中不斷出現的充滿美好幻想的應用情境逐漸地走向現實世界，人臉辨識也愈來愈受到全世界人們的關注。在兩種人臉辨識的模式中，人臉驗證(Verification)比起人臉識別(Identification)更為簡單也更適合像身分認證等實際應用上。為了更鉅細靡遺地描述人類臉部所包含的資訊，在各式各樣的人臉辨識方法中我們偏好於選擇局部外觀基礎的方法(local appearance-based methods)。
在本論文中，我們研讀了三種局部外觀基礎的方法: 梯度方向金字塔臉(GOP-Face)、局部二值模式臉(LBP-Face)以及複數小波轉換臉(DT-CWT-Face)，並且嘗試對於這三種方法給出簡單又詳盡的概述。此外，我們採用了最近鄰居法(k nearest neighbor)並運用人臉驗證在 ORL、Yale以及FERET等資料庫上來實驗這些方法對於像是空間位移、照度變化和年齡進展等臉部變因的穩固性。結果顯示LBP-Face以及DT-CWT-Face確實在空間位移上有著較佳的穩固性，而DT-CWT-Face對於年齡進展有驚人的表現更勝於GOP-Face。然而，他們對於照度變化的效果卻不如預期。

關鍵字

人臉辨識 ； 人臉驗證 ； 局部外觀基礎方法 ； 梯度方向金字塔 ； 局部二值模式 ； 二分複小波轉換

並列摘要

In recent years, due to the fantastic applications revealed in the mass media are progressively walking out to the reality, face recognition is getting more and more attention to people all over the world. Between the two modes of face recognition, verification is simpler and more suitable than identification in some practical applications such as authentication. To describe the information in human faces more elaborately, we prefer the local appearance-based methods among the various face recognition approaches.
In this thesis, we studied three local appearance-based methods: GOP-Face (Gradient Orientation Pyramid), LBP-Face (Local Binary Pattern) and DT-CWT-Face (Dual Tree-Complex Wavelet Transform), and tried to give a clear overview of these three methods. Furthermore, we use face verification to experiment their robustness to variations like spatial shift, illumination changes and age progression on the ORL, Yale and FERET databases with k nearest neighbor classifier. The results verified that LBP-Face and DT-CWT-Face are actually more robust to the spatial shift and DT-CWT-Face is surprisingly robust to age progression, and is even better than GOP-Face. However, the performance against illumination change is not as good as expected.

並列關鍵字

Face Recognition ； Face Verification ； Local Appearance-Based Method ； Gradient Orientation Pyramid ； Local Binary Pattern ； Dual Tree-Complex Wavelet Transform

參考文獻

[Abde2001] A.F. Abdelnour and I.W. Selesnick, “Nearly Symmetric Orthogonal Wavelet Bases,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing (ICASSP), Vol. 27, No. 6, 625-637, 2001.

[Ahon2006] T. Ahonen, A. Hadid, and M. Pietika¨inen, “Face Description with Local Binary Patterns: Application to Face Recognition,” IEEE Trans. Pattern Anal. Machine Intell., Vol. 28, No. 12, 2037-2041, 2006.

[Chen2000] H. Chen, P. Belhumeur, and D. Jacobs, “In Search of Illumination Invariants,” in IEEE Conf. Computer Vision and Pattern Recognition(CVPR), Vol. 1, 254-261, 2000.

[Geor2001] A. Georghiades, P. Belhumeur, D. Kriegman, “From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose,” IEEE Trans. Pattern Analysis and Machine Intelligence, Vol. 23, No. 6, 643-660, 2001.

[King1999] N.G. Kingsbury. “Image Processing with Complex Wavelets,” Phil. Trans. Royal Society London A, Math. Phys. Sci., Vol. 357, No. 1760, 2543–2560, 1999.