A Virtual TouchPad for Smartphone with Depth Camera

10.6688/JISE.2017.33.2.4

翁偉昇(WEI-SHENG WONG)；徐士中(SHIN-CHUNG HSU)；黃仲陵(CHUNG-LIN HUANG)

virtual touchpad ； human-computer interaction (HCI) ； fingertip hand gesture recognition (FHGR) ； on-click hand gesture ； on-press hand gesture

Journal of Information Science and Engineering

33卷2期（2017 / 03 / 01）

329 - 345

英文

This paper proposes a virtual touchpad human computer interaction (HCI) based on the fingertip hand gesture recognition (FHGR) method for smartphone with depth camera. The virtual touchpad HCI requires less computing power and memory resource than the conventional hand gesture recognition (HGR) methods. It consists of three modules: (1) open hand identification, (2) active fingertip detection and tracking, and (3) fingertip hand gesture recognition (FHGR). First, the handshape region is segmented and divided into three component regions: arm, palm, and fingers. Second, we locate the fingertips and then detect the active fingertips. Finally, the trajectory of every active fingertip is analyzed for FHGR. The two major contributions of this paper are (1) development of a real-time FHGR method with high recognition accuracy and (2) implementation of a virtual touchpad HCI for the smart phones.