A Real-time Finger-tapping Interface Using High-speed Vision System

In this paper, we propose a finger-tapping interface called FINGERTAP, which can estimate the contact states and forces on human fingertips in real time by using only the fingertip positions measured by high-speed vision cameras. In particular, we focus on the high-frequency component that develops at the moment a fingertip contacts something. We introduce a real-time estimation algorithm for the fingertip contact state and force by using frequency filtering to detect the high-frequency movement component of the fingertip positions. We also introduce a clickable pointing interface and a virtual musical instrument as a demonstration of an application using the FINGERTAP system.

[1]  A. Namiki,et al.  High-speed sensory-motor fusion for robotic grasping , 2002 .

[2]  M. Ishikawa,et al.  A CMOS vision chip with SIMD processing element array for 1 ms image processing , 1999, 1999 IEEE International Solid-State Circuits Conference. Digest of Technical Papers. ISSCC. First Edition (Cat. No.99CH36278).

[3]  Robert W. Lindeman,et al.  The AcceleGlove: a whole-hand input device for virtual reality , 2002, SIGGRAPH '02.

[4]  Idaku Ishii,et al.  Development of a high-resolution, high-speed vision system using CMOS image sensor technology enhanced by intelligent pixel selection technique , 2004, SPIE Optics East.

[5]  Makoto Sato,et al.  3-dimensional Interface Device For Virtual Work Space , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Kazunori Umeda,et al.  Construction of an intelligent room based on gesture recognition: operation of electric appliances with hand gestures , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[7]  K. Tsukada,et al.  Ubi-Finger : Gesture Input Device for Mobile Use , 2002 .

[8]  M. Kourogi,et al.  The Hand-mouse: A Human Interface Suitable for Augmented Reality Environments Enabled by Visual Wearables , 2001 .

[9]  Thomas H. Massie,et al.  The PHANToM Haptic Interface: A Device for Probing Virtual Objects , 1994 .

[10]  Yoshikazu Yamamoto,et al.  A New Input Method of Computers with One CCD Camera: Virtual Keyboard , 2001, INTERACT.

[11]  Alex Pentland,et al.  A Wearable Computer Based American Sign Language Recognizer , 1997, SEMWEB.

[12]  Haruhisa Kawasaki,et al.  Control of multi-fingered haptic interface opposite to human hand , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[13]  Yoichi Sato,et al.  Real-Time Fingertip Tracking and Gesture Recognition , 2002, IEEE Computer Graphics and Applications.