基於複雜背景資訊之手勢互動 介面設計與晶片實現

Design and Chip Implementation of Three Dimensional Gestures Interface Based on Complex Background

王竣弘(Chun-Hung Wang)

指導教授 ： 范育成

國立臺北科技大學/電資學院/電腦與通訊研究所/碩士(2014年)

摘要

本論文提出一個基於複雜背景資訊之手勢互動介面設計與晶片實現，本系統可以使用於亮度改變的環境與背景色彩線條複雜的環境，避免受到環境的干擾影響系統的準確性，以手掌追蹤以及手指追蹤的資訊來辨識，並判斷使用者的手勢進行操控，達到手勢互動介面的操作。
本論文所提出的操作模式方式為，當使用者在單手操作時，可以藉由將手指張開的手指數目為5的手勢(Gesture)，並透過移動方向偵測(Moving Direction Detection)進行八種手勢移動方向的操作；若手指數目為2的手勢時，則可以透過手勢的掌心移動方向來控制圖片的縮放；若手指數目為1的手勢時，則可利用手指點擊畫面中的虛擬按鈕，達到相對應的控制。
在實驗中我們邀請不同的使用者操控，並測試系統之準確率。最後我們將所提出的手勢互動介面系統進行硬體架構設計，以數位積體電路設計流程將系統實現為數位晶片。以擷取的視訊攝影機影像，送入晶片後偵測出手部範圍大小與手部座標，做為手勢辨識系統的判別基礎。

關鍵字

互動介面 ； 手勢辨識 ； 手部追蹤 ； 手指追蹤

並列摘要

In this thesis, we proposed a “Design and Chip Implementation of Three Dimensional Gestures Interface Based on Complex Background.” Our system could be used in illumination changes, varying color and cluttered background. Avoid affecting the system accuracy from the different environment, The system track user’s hand and fingers. Furthermore, the system recognized the state of user’s hand and fingers via information. Our system provided a human-computer interaction(HCI) by using gesture.
Our proposed approach is that when a user control the system, the system would detect the eight kinds of moving direction while user adopts 5 fingers gesture. The system would detect the finger of scaling image while user uses 2 fingers gesture. In the scale mode, the system would zoom in or zoom out the image.
In addition the system would detect the finger of clicking image while user adopts 1 finger gesture. In finger clicking state, user could select the operation of virtual button by clicking that button.
Finally, we design digital chip using hardware architecture and cell-based design to implement our system. When we get the image from camera, our chip would detect the ROI size, center coordinates of hand for next image tracking.

並列關鍵字

Computer Interaction Interface ； Gesture Recognition ； Hands Tracking ； Finger Tracking

參考文獻

[5] Ransalu Senanayake, and Sisil Kumarawadu, “ A Robust Vision-based Hand Gesture Recognition System for Appliance Control In Smart Homes, ” in 2012 IEEE International Conference on Signal Processing, Communication and Computing (ICSPCC), 2012, pp. 760–763.

[6] Z. J. L. Barron, D. J. Fleet and S. S. Beauchemin, “Performance of Optical Flow Techniques,” International Journal of Computer Vision, Vol. 12, No. 1, pp. 43-77, Feb. 1994.

[7] Hang Zhou, Qiuqi Ruan, and Houjin Chen, and Emil M. Petriu, “A New Approach of Hand Tracking Based on Integrated Optical Flow Analyses,” in 10th IEEE International Conf. on Signal Processing, 2010, pp. 1194-1197.

[8] M. B. Caglar and N. Lobo, “Open Hand Detection in a Cluttered Single Image Using Fingertip Primitives,” in IEEE Int. Conf. on Computer Vision and Pattern Recognition Workshop, 2006, pp. 148–153.

[9] Siddharth S. Rautaray, and Anupam Agrawal, “Design of Gesture Recognition System for Dynamic User Interface,” in IEEE International Conference on Technology Enhanced Education (ICTEE), 2012, pp. 1-6.