Two-handed gesture tracking incorporating template warping with static segmentation

We present a template-based method of motion estimation which tracks two-handed-gestures. In our method the gesturing information of temporal motion and spatial luminance is fully utilized. The dominant motion of the detected region corresponding to the tracked object (some hand or the head) is computed. Using this result the object template is warped to yield a prediction template. Incorporated with static segmentation using the watershed algorithm the warped template will be updated through comparison of each sub-region with the prediction template. Tracking results for a set of two-handed command gestures are given to demonstrate its performance.

[1]  A. Murat Tekalp,et al.  Face detection and facial feature extraction using color, shape and symmetry-based cost functions , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[2]  Shan Lu,et al.  Recognition of local features for camera-based sign language recognition system , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[3]  Shaogang Gong,et al.  Tracking Discontinuous Motion Using Bayesian Inference , 2000, ECCV.

[4]  Matthew Turk,et al.  View-based interpretation of real-time optical flow for gesture recognition , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[5]  Stan Sclaroff,et al.  Active blobs , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[6]  Narendra Ahuja,et al.  Recognizing hand gesture using motion trajectories , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[7]  John M. Gauch,et al.  Image segmentation and analysis via multiscale gradient watershed hierarchies , 1999, IEEE Trans. Image Process..

[8]  Marcel Worring,et al.  Multifeature object tracking using a model-free approach , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[9]  Alex Pentland,et al.  Coupled hidden Markov models for complex action recognition , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Thomas S. Huang,et al.  Gesture modeling and recognition using finite state machines , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[11]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Akira Utsumi,et al.  Multiple-hand-gesture tracking using multiple cameras , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).