基於Kinect之雙手位移辨識系統

Hands Motion Recognition System Based On Kinect

陳冠廷(Guan-Ting Chen)

指導教授 ： 謝景棠

淡江大學/工學院/電機工程學系碩士班/碩士(2011年)

https://doi.org/10.6846/TKU.2011.00130

摘要

隨著電腦科技的進步，人機互動方式也隨之在改變，如任天堂所推出的WII、蘋果推出的iPhone...等。脫離傳統的按鍵與搖桿，以體感輸入、觸控輸入等方式進行操作。而這些人機互動界面之改變使人們在機器操作上更加直觀與便利。
　　近年來以電腦視覺為基礎之三維人機互動研究發展蓬勃，利用手勢與機器互動為其中較熱門之研究。肢體中手部之自由度較大，較可做出多變化之動作，方便下達較為複雜的指令。
　　本篇論文中，我們提出了利用Kinect之追蹤方法。將Kinect輸出之彩色影像經ASM人臉偵測與膚色偵測後結合深度影像濾除背景得以濾出手部資訊，再以粒子濾波器來達到雙手的追蹤，最後判斷雙手間距離之變化以及單手位移方向，進而控制電腦之軟體。

關鍵字

人機互動 ； 立體視覺 ； Particle Filter ； Tracking ； YCbCr ； ASM ； Kinect

並列摘要

With the advances of computer technology, human-computer interaction also will be changed. Such as the WII invented by the Nintendo, and the iPhone devised by Apple, etc. To operate the machine is from using the traditional buttons and joysticks to apply "sensing motion", and touching, etc. These changes in human-computer interaction make us more intuitive and convenient on operation.
In recent years, the researchs on three-dimensional human-computer interaction based on computer vision are developed well. The interaction using gestures is the most popular study. The hands can do more free movements than any other body, also can execute more complex comments easily.
In this paper, we propose a tracking method using by Kinect. We use the color images from the Kinect after the ASM algorithm and the skin color detection to track the face, then combine the depth image after doing removing the background to get the hands' information. Therefore, we apply the particle filter for tracking the hands. Finally, we can determine the distance between the hands and the direction of one hand, and then we can control the computer's software.

並列關鍵字

Human–Computer Interaction(HCI) ； Stereo vision ； Particle Filter ； Tracking ； YCbCr ； ASM ； Kinect

參考文獻

[8] 張量鈞，基於立體視覺之手掌位移辨識系統，淡江大學電機工程學系碩士論文，民國九十九年。

[21] 王瑞斌，以軟硬體協同設計之粒子濾波器及其在影像追蹤之應用，淡江大學電機工程學系，民國九十九年

[3] Heung-Il Suk, Bong-Kee Sin, and Seong-Whan Lee, “Robust Modeling and Recognition of Hand Gestures with Dynamic Bayesian Network”,IEEE International Conference on Pattern Recognition, p.1-4,Dec.2008.

[4] Young-Joon Chai, Dong-Heon Jang, And Tae-Yong Kim,“Homogeneity Based Background Subtraction for Robust Hand Pose Recognition : Focusing On the Digital Game Interface, ”Computer Graphics, Imaging and Visualisation(CGIV), pp.292~297, 200

[6] 曾士宏，即時手勢辨識系統之應用，淡江大學電機工程學系碩士在職專班，民國九十七年。