Simultaneous Tracking of Both Hands by Estimation of Erroneous Observations

Thearticulate motionof thehandmakesit very difficult to track thehands while performing a gesture.Simultaneoustrackingof both hands needsto dealwith largeinterframevariationsin shape,clutterandmutual occlusion. In this paper , we presenta robustmethodfor localizing thehandregion by tracking even in the presence of severe occlusion.We develop a model for tracking two rectangularwindows,eachboundingoneof thehands,usingthe condensationalgorithm. We proposea new methodfor dealingwith occlusionsby estimatingtheoccludedobservations in termsof thenon-occluded obser vationsandtheirpredictedvalues,yielding very reliableresults.

[1]  John R. Kender,et al.  Finding skin in color images , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[2]  Pietro Perona,et al.  Monocular tracking of the human arm in 3D , 1995, Proceedings of IEEE International Conference on Computer Vision.

[3]  Akira Utsumi,et al.  Multiple-hand-gesture tracking using multiple cameras , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[4]  C. Jennings,et al.  Robust finger tracking with multiple cameras , 1999, Proceedings International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems. In Conjunction with ICCV'99 (Cat. No.PR00378).

[5]  Richard Szeliski,et al.  Tracking with Kalman snakes , 1993 .

[6]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Michael H. Lin.  Tracking articulated objects in real-time range image sequences , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[8]  Keith Jack,et al.  Video Demystified: A Handbook for the Digital Engineer , 1993 .

[9]  David C. Hogg,et al.  Wormholes in shape space: tracking through discontinuous changes in shape , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[10]  Mohammed Yeasin,et al.  Automatic generation of robot program code: learning from perceptual data , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[11]  Andrew Blake,et al.  A Probabilistic Exclusion Principle for Tracking Multiple Objects , 2004, International Journal of Computer Vision.

[12]  Larry S. Davis,et al.  3-D model-based tracking of humans in action: a multi-view approach , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Natan Peterfreund,et al.  Robust Tracking of Position and Velocity With Kalman Snakes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Christoph Bregler,et al.  Learning and recognizing human dynamics in video sequences , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.