基於手形輪廓之智慧型手勢辨識系統設計

Intelligent Hand Gesture Recognition System Design Based On Hand Contour

余玉田(Yu-Tien Yu)

指導教授 ： 陳永平

國立交通大學/電機學院/電機學院碩士在職專班電機與控制組/碩士(2010年)

https://doi.org/10.6842/NCTU.2010.00270

摘要

本論文主要是研究可應用於手勢辨識之智慧型辨識系統，其設計流程共分為三個部分，首先是利用影像處理取得手勢的影像，並以手形輪廓掃描的方式描述手勢的特徵，其次是採用類神經網路的架構，以倒傳遞法則來訓練類神經網路的參數，使其得以辨識手勢的特徵，最後再利用實驗來驗證將倒傳遞類神經網路應用於手勢辨識的可行性，由實驗結果可知，本論文所開發之智慧型辨識系統可以完全準確地辨識出數字1至5的單純手勢，而對於較為複雜的數字0至9，也可利用提高手勢特徵的精準度，以及增加類神經元的方式，達到準確辨識目的。

關鍵字

手勢辨識 ； 影像處理 ； 倒傳遞類神經網路 ； 手形輪廓

並列摘要

This thesis proposes an intelligent recognition system based on neural network for hand gesture recognition. The design process is partitioned into three parts. First, the hand gesture is abstracted from an image by image procession and the characteristics of hand gesture are retrieved by the hand contour scanning method. Then, based on the back-propagation algorithm, the neural network is trained to learn the charateristics of the hand gesture. Finally, experiments are included to demonstrate the feasibility of the developed intelligent hand gesture recognition system. From the experimental results, it is clear that the system can precisely recognize the simple hand gestures related to the numbers from 1 to 5. For the more complicated case to expresss 0 to 9, the system is also available to successfully recognize all of them, after increasing the resolution of hand gesture and the number of neurons in the neural network.

並列關鍵字

hand gesture recognition ； back-propagation algorithm ； hand contour

參考文獻

[4] C. L. Huang and S. H. Jeng, “A model-based hand gesture recognition system”, Machine Vision and Appl., vol.12, pp.243-258, 2001.

[5] V.I. Pavlovic, R. Sharma, and T.S. Huang, “Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review”, Transactions on Pat-tern Analysis and Machine Intelligence, 19(7):677–695, 1997.

[6] Y. Yasumuro, Qian Chen, and K. Chihara, “3D modeling of human hand with motion constraints”, Proc. of the Int. Conf. on 3-D Digital Imaging and Modeling, pp.275-282, May 1997.

[9] S. Wagner, B. Alefs, and C. Picus, “Framework for a portable gesture interface,” The Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition, April 10-12, 2006, pp. 275-280.

[10] L. Gupta and M. Suwei, “Gesture-based interaction and communication: automated classification of hand gesture contours,” IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, vol. 31, pp. 114-120, 2001. 55