手背: 透過手背之手勢辨識研究

BackHand:Sensing Hand Gesture via Back of the Hand

林哲緯(Jhe-Wei Lin)

指導教授 ： 陳彥仰

國立臺灣大學/電機資訊學院/資訊網路與多媒體研究所/碩士(2016年)

https://doi.org/10.6342/NTU201602594

摘要

在這篇論文裡,我們探索透過手背來作為感測手勢的來源,其干擾 遠低於以手套形式作為感測手勢的方法以及提供比手腕和手肘作為來 源更為精準的辨識。我們的裝置利用應變規陣列黏貼於手背表面,並 利用機器學習相關技術來辨識多樣的手勢。
為了更加了解手勢辨識之正確度以及手背上不同感測位置的影響, 我們安排共計十位使用者實施使用者研究。實驗結果顯示出:藉由將 感測器所讀取之數值圖像化後,跨使用者的結果差異極大,而相同的 使用者則相似。對於跨使用者做出 16 個手勢的系統而言,系統辨識 之正確度落於 27.4%,而對於單一使用者而言,同樣的系統則能達到 95.8%的正確率。另一項實驗結果,則顯示以橫列為基礎的排列方式, 感測陣列最適合黏附於坐落在 MCP(手指與手掌間的關節) 至手腕頂端 之間 1/8 到 1/4 的位置。

關鍵字

手勢辨識 ； 穿戴式介面 ； 手背 ； 手勢介面 ； 應變規 ； 機器學習 ； 手勢互動

並列摘要

In this paper, we explore using the back of hands for sensing hand ges- tures, which interferes less than glove-based approaches and provides better recognition than sensing at wrists and forearms. Our prototype, BackHand, uses an array of strain gauge sensors affixed to the back of hands, and applies machine learning techniques to recognize a variety of hand gestures.
We conducted a user study with 10 participants to better understand ges- ture recognition accuracy and the effects of sensing locations. Results showed that sensor reading patterns differ significantly across users, but are consis- tent for the same user. The leave-one-user-out accuracy is low at an average of 27.4%, but reaches 95.8% average accuracy for 16 popular hand gestures when personalized for each participant. The most promising location spans the 1/8˷1/4 area between the metacarpophalangeal joints (MCP, the knuckles between the hand and fingers) and the head of ulna (tip of the wrist).

並列關鍵字

Gesture recognition ； wearable interface ； back of the hand ； hand gesture interface ； strain gauge ； machine learning ； gestural interaction

參考文獻

[17] T. S. Saponas, D. S. Tan, D. Morris, R. Balakrishnan, J. Turner, and J. A. Landay. Enabling always-available input with muscle-computer interfaces. In Proceedings of the 22Nd Annual ACM Symposium on User Interface Software and Technology, UIST ’09, pages 167–176, New York, NY, USA, 2009. ACM.

[7] L. Dipietro, A. Sabatini, and P. Dario. A survey of glove-based systems and their applications. Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions on, 38(4):461–482, July 2008.

[9] N. Kevin, S. Ranganath, and D. Ghosh. Trajectory modeling in gesture recognition using cybergloves reg; and magnetic trackers. In TENCON 2004. 2004 IEEE Region 10 Conference, volume A, pages 571–574 Vol. 1, Nov 2004.

[11] Y. S. Kim, B. S. Soh, and S.-G. Lee. A new wearable input device: Scurry. Industrial Electronics, IEEE Transactions on, 52(6):1490–1499, Dec 2005.

[12] G. Kulaksiz and R. Gozil. The effect of hand preference on hand anthropometric measurements in healthy individuals. Annals of Anatomy - Anatomischer Anzeiger, 184(3):257 – 265, 2002.