基於手勢輸入之即時通系統

Hand Gesture Recognition Based Messenger System

房祥騫(Hsiang-Chien Farng)

指導教授 ： 周永山

淡江大學/工學院/電機工程學系碩士班/碩士(2013年)

https://doi.org/10.6846/TKU.2013.00070

摘要

本論文研製一個基於手勢輸入之即時通系統。此系統利用撓性感測器(flex sensor)與加速度計，搭配一組穿戴式機構，量測各手指的彎曲角度和手腕的傾斜方向，並將量測所得資訊以RS232傳輸協定傳至電腦端，經濾波後進行手勢辨識演算以產生相對應的文字。最後搭配TCP/IP協定，以自製之即時通介面與其他電腦進行互動。
在手勢辨識演算方面，本論文先採用一決策樹架構，將不同手勢進行初步分類，再由一改良式的機率類神經網路進行最後的手勢辨識。實驗顯示此方法降低了辨識時的計算負擔，提高了整體的辨識效率。

關鍵字

手勢辨識 ； 撓性感測器 ； ASL ； 機率類神經 ； 決策樹

並列摘要

This thesis develops a messenger system based on hand gesture recognition technique. Flex sensors and an accelerometer combined with a wearable gesture sensing device are used to measure the bending angle of each finger and the wrist. The measurements are transmitted to PC by RS232 transmission protocol. After filtering to smooth the data, these data are processed through the gesture recognition algorithm to generate the corresponding text. Finally, the users can interact with the others by the homemade messenger system interface through TCP / IP protocol.
The proposed gesture recognition algorithm consists of two major steps, which first utilizes the concept of decision tree to classify the filtered measured data of different gestures, and then performs more delicate gesture recognition by a probability neural network to reach a verification result. Experiment shows that an improved verification rate with reduced computational burden of the problem is obtained by the proposed method.

並列關鍵字

Gesture recognition ； flex sensor ； ASL ； probability neural network ； decision tree

參考文獻

[6]陳旻廷, 以資料手套輸入裝置之手勢操控虛擬人物系統之建構, 中原大學工業工程研究所碩士學位論文, 中華民國96年7月.

[15]張家銘, 基於慣性感測的遠端控制虛擬釣魚系統, 淡江大學電機工程學系碩士學位論文, 中華民國101年6月.

[1]A. El-Sawah, C. Joslin, N.D. Georganas, and E.M. Petriu, “A Framework for 3D Hand Tracking and Gesture Recognition using Elements of Genetic Programming”, Fourth Canadian Conference on Computer and Robot Vision, CRV '07, pp. 495 – 502, May 28-30, 2007.

[2]P.K. Pisharady, P. Vadakkepat, and A.P. Loh, “Attention Based Detection and Recognition of Hand Postures Against Complex Backgrounds”, International Journal of Computer Vision, Vol. 101, Issue. 3, pp. 403-419, Feb 2013.

[5]M. Nishiyama and K. Watanabe, “Wearable Sensing Glove With Embedded Hetero-Core Fiber-Optic Nerves for Unconstrained Hand Motion Capture”, IEEE Transactions on Instrumentation and Measurement , Vol. 58, No 12, pp. 3995-4000, Dec 2009.