智慧型監視系統之多人人臉即時循序偵測及追蹤

A Smart Surveillance System for Real-Time Sequential Detection and Tracking of Multiple Faces

張英傑(Ying-Jie Zhang)

指導教授 ： 吳明芳

崑山科技大學/工程學院/電機工程研究所/碩士(2006年)

https://doi.org/10.6828/KSU.2006.00053

摘要

本論文主要是利用PTZ(Pan-Tile-Zoom)攝影機去做多人人臉的循序偵測與追蹤。在人臉偵測方面，首先利用顏色分割將膚色區域從影像中擷取出來，接著利用橢圓面板比對與連接元區域標定的方法，以達到人臉區域初步定位。初步定位後，運用一些幾何規則去對人臉特徵(眼睛、嘴唇)做搜尋，以找出人臉的正確位置。在單人人臉追蹤方面，控制PTZ攝影機對移動的人臉加以追蹤，使人臉保持在畫面中心，並利用影像投影的方法，將非人臉的膚色物體排除掉，以強健人臉的動態追蹤。
在多人人臉循序追蹤方面，當畫面出現第二個人臉時，則利用PTZ攝影機進行縮放動作並且追蹤第二個人臉區域，使第二個人臉置於畫面中心，由於系統執行縮放動作後，會將第一個人臉排除，因此當第三個人臉區域出現時，系統會繼續執行追蹤下一個人臉，以達到多人人臉追蹤的目的。本文以實際多人人臉即時影像加以實驗，結果顯示確實能達到多人人臉偵測與追蹤的效果，印證了本文所提方法的可行性。

關鍵字

人臉偵測 ； 膚色偵測 ； 人臉追蹤 ； PTZ攝影機

並列摘要

This thesis utilizes Pan-Tile-Zoom camera (PTZC) to develop a multiple faces sequential detecting and tracking system. In the face detection part, first we extract skin region from image by color segmentation, then utilize the methods of ellipse matching and connected components labeling to decide the candidate face regions. After the preliminary face positioning, we use some geometry rules to search face features (eyes, lips) in order to find out the correct position of the face candidate. In the face tracking part, we use PTZC to track the moving face candidate, keep it in the picture center and room in PTZC to enlarge the face candidate. Here we also use the image projection method to remove those skin color pixels which are not belonged to the face’s elements from the image to get more robust dynamic face tracking results.
　　For multiple face sequential tracking, the system will be interested in second face candidate when it appears. We track the new coming face candidate and let it become our new target. The same detecting and tracking methods will be used on this new face candidate. Moreover, the system will control PTZC to focus on this target. The same rules will apply on next coming new face candidates. When the face candidate disappears from the vision area of PTZC the system will start to search and track the other face candidate in its vision area continuously. After experiment with the real-time images of multiple faces, the result shows that the system can reach multiple faces detection and tracking, and proves the feasibility of proposed method in this thesis.

並列關鍵字

PTZ camera ； face detection ； skin detection ； face tracking

參考文獻

[2]黃泰祥，具備人臉追蹤與辨識功能的一個智慧型數位監視系統，中原大學電子工程學系碩士論文，民國93年。

[1]黃敏峰，人臉追蹤法應用於監視系統之研究，成功大學電機工程學系，碩士論文，民國92年。

[6]Funahasahi T., Tominaga M., Fujiwara　T., Koshimizu H., “Hierarchical Face Tracking Using PTZ camera”, Chukyo Univ., Japan, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004 , pp.427-432.

[7]Rowley H.A., Baluja S., Kanade T.,“Rotation Invariant Neural Network-Based　Face Detection”, Carnegie Mellon University PA ,IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1998, 1998, pp.963 – 963.

[10]Pappu R., Beardsley P.A., “A Qualitative Approach to Classifying Gaze　Direction”, Meida Lab., MIT, Cambridge, MA, USA, Third　IEEE International Conference on Automatic Face and Gesture Recognition , 1998, pp.160-165.