基於RGB-D影像資訊之即時指寫法數字辨識系統設計

指寫法辨識可提供使用者自然、直覺的人機互動方式，因此近年來被廣泛應用於各種領域中，如電子遊戲、遠距遙控等。本論文提出一個以色彩深度影像為基礎的指寫法數字辨識系統，分為手掌與指尖位置偵測、特徵擷取及指寫法數字辨識三個部分。首先利用膚色偵測配合聯通物件法與距離轉換法，分別找出手掌與指尖位置；接著追蹤指尖書寫數字之動態軌跡，先擷取軌跡移動方向作為數字辨識用之特徵，其中因為0與6無法經由移動方向特徵予以辨識，所以再提出軌跡起始點、終止點與垂直方向移動距離三種特徵，以提高辨識率。最後，利用串接式最鄰近法進行指寫法數字辨識。從實驗結果可知，本論文所提之即時指寫法數字辨識系統確實具有成效，可達九成五以上之辨識率。

關鍵字

紙寫法數字；手勢辨識；動態時間校正

並列摘要

The finger writing recognition approach has been introduced to a diversity of fields, like video games and remote control systems, because it provides a natural and intuitive communication for Human-Computer Interaction (HCI). This thesis proposes a real-time finger writing digit recognition system with high accuracy rate based on the RGB-D information. The system is divided into three main parts, including ROI selection, feature extraction, and finger writing digit recognition. For the ROI selection, first detect the skin color regions, then determine the palm and the fingertips based on the connect component labeling (CCL) and the distance transform respectively. Further, track the fingertip to create the trajectory and extract its directional features for digit recognition. However, since it is often confused in recognizing 0 and 6, three extra features are added to increase their recognition rate. Finally, with series k-NN classifiers, the experimental results show that the accuracy rate is higher than 95% in finger writing digit recognition, which implies the proposed real-time recognition system is indeed effective and efficient.

並列關鍵字

finger writing digits ； gesture recognition ； dynamic time warping

參考文獻

[2] Bragatto, T. A C; Ruas, G. I S; Lamar, M.V., "Real-time video based finger spelling recognition system using low computational complexity Artificial Neural Networks," Telecommunications Symposium, 2006 International , vol., no., pp.393,397, 3-6 Sept. 2006

[3] Bui, T.D.; Nguyen, L.T., "Recognizing Postures in Vietnamese Sign Language With MEMS Accelerometers," Sensors Journal, IEEE , vol.7, no.5, pp.707,712, May 2007

[4] Wang, J.S.; Chuang, F.C., "An Accelerometer-Based Digital Pen With a Trajectory Recognition Algorithm for Handwritten Digit and Gesture Recognition," Industrial Electronics, Transactions on IEEE , vol. 59, no. 7, pp.2998,3007, July 2012

[5] Lu, Z.; Chen, X.; Li, Q.; Zhang, X.; Zhou, P., "A Hand Gesture Recognition Framework and Wearable Gesture-Based Interaction Prototype for Mobile Devices," Human-Machine Systems, IEEE , vol. 44, no. 2, pp.293,299, April 2014

[6] Frolova, D.; Stern, H.; Berman, S., "Most Probable Longest Common Subsequence for Recognition of Gesture Character Input," Cybernetics, Transactions on IEEE , vol. 43 no. 3, pp.871,880, June 2013

國際替代計量

基於RGB-D影像資訊之即時指寫法數字辨識系統設計

全文下載

主題瀏覽