Efficient Search Technique for Hand Gesture Tracking in Three Dimensions

We describe a real-time stereo camera system for tracking a human handfrom a sequence of images and measuring the three dimensional trajectories of the handmo vement. We incorporate three kinds of constraints into our tracking technique to put restrictions on the search area of targets and their relative positions in each image. The restrictions on the search area are imposedb y continuity of the handlo cations, use of skin color segmentation, andepip olar constraint between two views. Thus, we can reduce the computational complexity and obtain accurate three-dimensional trajectories. This paper presents a stereo tracking technique andexp erimental results to show the performance of the proposed method.

[1]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[2]  King Ngi Ngan,et al.  Locating facial region of a head-and-shoulders color image , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[3]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Matthew Turk,et al.  View-based interpretation of real-time optical flow for gesture recognition , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[5]  Takahiro Watanabe,et al.  Real time gesture recognition using eigenspace from multi-input image sequences , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[6]  Jin-Hyung Kim,et al.  An HMM-Based Threshold Model Approach for Gesture Recognition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Shan Lu,et al.  Color-based hands tracking system for sign language recognition , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[8]  Hideo Saito,et al.  3-D drawing system via hand motion recognition from two cameras , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[9]  Berthold K. P. Horn.  Robot vision , 1986, MIT electrical engineering and computer science series.

[10]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Rajeev Sharma,et al.  Tracking hand dynamics in unconstrained environments , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[12]  Thomas S. Huang,et al.  Virtual Gun, A Vision Based Human Computer Interface Using the Human Hand , 1994, MVA.

[13]  Masanori Yamada,et al.  A new robust real-time method for extracting human silhouettes from color images , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[14]  Satoru Hayamizu,et al.  Gesture recognition using HLAC features of PARCOR images and HMM based recognizer , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.