基於人臉網格的一種對於化妝與跨年齡的臉部辨識

A Face Mesh-ased Recognition of Makeup And Cross-age Faces

陳勁凱(Chen Chin-Kai)

指導教授 ： 陳美勇

國立臺灣師範大學/科技與工程學院/機電工程學系/碩士(2024年)

https://doi.org/10.6345/NTNU202401798

摘要

臉部辨識是一種重要的生物識別技術，在多種應用中得到廣泛使用。然而，化妝以及年齡變化會使人臉發生變化，進而影響人臉上的特徵，從而降低臉部辨識的準確性。為了解決化妝以及年齡變化造成的臉部辨識問題，本論文提出了一種基于MediaPipe的FaceMesh和類神經網路的臉部辨識方法，以解決化妝以及年齡變化造成的臉部辨識問題，該方法將在Python內部逐步構成。MediaPipe FaceMesh模型的人臉偵測是以 BlazeFace 人臉偵測器為基礎，該偵測器會對圖像進行操作並計算人臉位置。偵測到人臉後，FaceMesh模型會使用一個自定義殘差神經網絡提取名為landmark的臉部特徵，並利用歐式距離和landmark蘊含的座標資料計算指定的landmark之間的距離以及比值，作為訓練用的臉部特徵。主成分分析用於提高準確率，降低過擬合現象。類神經網路用於訓練模型。實驗結果表明，該方法在化妝以及年齡變化下的臉部辨識有一定的準確性，具有一定的應用價值。

關鍵字

Mediapipe ； Blazeface ； Facemesh ； 跨年龄 ； 化妆 ； 人臉識別 ； 主成分分析 ； 類神經網路

並列摘要

Face recognition is an important biometric technology widely used in various applications. However, makeup and age changes can alter facial features, reducing the accuracy of face recognition. To address the issues caused by makeup and age changes, this paper proposes a face recognition method based on MediaPipe's FaceMesh and neural networks. This method aims to tackle the problems posed by makeup and age changes, and will be implemented step by step in Python.The face detection in the MediaPipe FaceMesh model is based on the BlazeFace face detector, which processes images and calculates the position of faces. After detecting a face, the FaceMesh model uses a custom residual neural network to extract facial features called landmarks. Euclidean distances and the coordinates embedded in these landmarks are used to calculate distances and ratios between specified landmarks as facial features for training. Principal Component Analysis (PCA) is employed to improve accuracy and reduce overfitting. Neural networks are then used to train the model.Experimental results demonstrate that this method achieves a certain level of accuracy in face recognition under makeup and age changes, showing potential for practical applications.

並列關鍵字

Mediapipe ； Blazeface ； Facemesh ； Cross-age ； Makeup ； Face Recognition ； Principal Component Analysis ； Neural Networks

參考文獻

"Apple's Face ID: Cheat sheet". TechRepublic. June 11, 2020. Retrieved 2020-12-07.

“One ID”, GUNNEBO, blog.gunneboentrancecontrol.com/one-id-already-bringing-benefits-to-airports-airlines-and-passengers

Ueda S, Koyama T. Influence of make-up on facial recognition. Perception. 2010;39(2):260-4. doi: 10.1068/p6634. PMID: 20402247.

A. Dantcheva, C. Chen and A. Ross, "Can facial cosmetics affect the matching accuracy of face recognition systems?," 2012 IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS), Arlington, VA, USA, 2012, pp. 391-398.

A. Lanitis, C. J. Taylor and T. F. Cootes, "Toward automatic simulation of aging effects on face images," in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 4, pp. 442-455, April 2002.