JISE


  [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12] [13] [14] [15] [16]


Journal of Information Science and Engineering, Vol. 33 No. 2, pp. 329-345


 A Virtual TouchPad for Smartphone with Depth Camera


WEI-SHeng Wong1, SHIN-CHUNG HSU1 AND CHUNG-Lin Huang2,+
1
Department of Electrical Engineering
National Tsing Hua University
Hsinchu, 30013 Taiwan

2Department of M-Commerce and Multimedia Applications
Asia University
Taichung, 41354 Taiwan
E-mail: d9761817@oz.nthu.edu.tw; clhuang@asia.edu.tw


    This paper proposes a virtual touchpad human computer interaction (HCI) based on the fingertip hand gesture recognition (FHGR) method for smartphone with depth camera. The virtual touchpad HCI requires less computing power and memory resource than the conventional hand gesture recognition (HGR) methods. It consists of three modules: (1) open hand identification, (2) active fingertip detection and tracking, and (3) fingertip hand gesture recognition (FHGR). First, the handshape region is segmented and divided into three component regions: arm, palm, and fingers. Second, we locate the fingertips and then detect the active fingertips. Finally, the trajectory of every active fingertip is analyzed for FHGR. The two major contributions of this paper are (1) development of a real-time FHGR method with high recognition accuracy and (2) implementation of a virtual touchpad HCI for the smart phones.


Keywords: virtual touchpad, human-computer interaction (HCI), fingertip hand gesture recognition (FHGR), on-click hand gesture, on-press hand gesture

  Retrieve PDF document (JISE_201702_04.pdf)