基於皮膚顏色及手指角度之手勢辨識

Skin-Color and Finger-Angle Based Hand-Gesture Recognition

張晉豪(Jin-Hau Chang)

指導教授 ： 吳俊德

國立暨南國際大學/科技學院/電機工程學系/碩士(2020年)

https://doi.org/10.6837/ncnu202000141

摘要

在現今，人機互動依然是個很重要的技術。其中，手勢辨識可以說是基礎的人機互動方式，現今技術在辨識手掌及手指的方式不競相同。在這裡，我們使用了一些新的方式用於手指偵測的部分，而膚色辨別及一些影像處理的方式是現有的。
在我們捕抓到的RGB影像，我們先轉換成NCC色彩空間並捕抓膚色，並設定膚色為白，其餘為黑。然後，利用數位影像處理去除掉雜訊部分，並且取得正確的膚色區塊。接下來，取得手掌的位置作為之後計算角度上的點。之後，我們找尋手指上的點，並且排除錯誤的部分。最後，我們利用計算手指間的角度，以達成辨識手式符號的方法。
使用以上方法，我們可以準確的捕抓手指位置，以及計算辨識出手的姿態。這項研究可以幫助電腦理解人的手勢，並可以作為人機互動的基礎。並且在未來可以應用在機器人控制上。

關鍵字

人機互動 ； 手勢辨識 ； 數位影像處理

並列摘要

Recently, human-machine interaction is still a very important technology. Among them, gesture recognition can be said to be the basic human-machine interaction method. There is no much difference in the way of identifying palms and fingers in most research. Here, we use some new methods for the part of finger detection. The methods of skin color discrimination and some image processing are existing.
In the RGB images we capture, we first convert to the NCC color space and capture the skin color, and set the skin color to white, and the others to black. Then, we use digital image processing to exclude the noise part and obtain the correct skin color. Next, the position of the palm is obtained as a point in the angle to be calculated later. After that, we search the points on the fingers and eliminate the wrong points. Finally, we use the calculation of the angle between fingers to achieve a method of identifying hand-shaped symbols.
Using the above method, we can accurately capture the position of the finger and calculate and recognize the gesture of the hand. This research can help computers understand human gestures and can be used as the basis for human-computer interaction. And it can be applied to robot control in the future.

並列關鍵字

human-computer interaction ； gesture recognition ； digital image processing

參考文獻

[1] M. Soriano, S. Huovinen, B. Martinkauppi and M. Laaksonen, “Using the Skin Locus to Cope with Changing illumination Condition in Color-Based Face Tracking”, Proc. of IEEE Nordic Signal Processing Symposium, 2000, pp.383-386.

[2] D. Chai, and K. Ngan, “Face segmentation using skin-color map in videophone applications”, in IEEE Trans. Circuits and Systems for Video Technology, vol. 9 no. 4 pp. 551-564, 1999.

[3] E. Marszalec, B. Martinkauppi, M. Soriano, and M. Pietikäinen, “Physics-based face database for color research”, in J. Electronic Imaging, vol. 9, pp. 32-38, 2000

[4] Z. Lu, X. Chen, Q. Li, X. Zhang and P. Zhou, “A Hand Gesture Recognition Framework and Wearable Gesture-Based Interaction Prototype for Mobile Device” in IEEE transactions on human-machine systems, vol.44, iss.2, April 2014.

[5] M. Elmezain, A. Al-Hamadi, and B. Michaelis, “A robust method for hand gesture segmentation and recognition using forward spotting scheme in conditional random fields,” in Proceedings of the 20th International Conference on Pattern Recognition (ICPR ’10), pp. 3850– 3853, August 2010.