Visual Tracking of High DOF Articulated Structures: an Application to Human Hand Tracking

Passive sensing of human hand and limb motion is important for a wide range of applications from human-computer interaction to athletic performance measurement. High degree of freedom articulated mechanisms like the human hand are difficult to track because of their large state space and complex image appearance. This article describes a model-based hand tracking system, called DigitEyes, that can recover the state of a 27 DOF hand model from ordinary gray scale images at speeds of up to 10 Hz.

[1]  J. O'Rourke,et al.  Model-based image analysis of human motion using constraint propagation , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  R. Mann,et al.  Gait analysis--precise, rapid, automatic, 3-D position and orientation kinematics and dynamics. , 1983, Bulletin of the Hospital for Joint Diseases Orthopaedic Institute.

[3]  Mann Rw,et al.  Gait analysis--precise, rapid, automatic, 3-D position and orientation kinematics and dynamics. , 1983 .

[4]  John E. Dennis,et al.  Numerical methods for unconstrained optimization and nonlinear equations , 1983, Prentice Hall series in computational mathematics.

[5]  Jaron Lanier,et al.  A hand gesture interface device , 1987, CHI 1987.

[6]  Mark W. Spong,et al.  Robot dynamics and control , 1989 .

[7]  Masanobu Yamamoto,et al.  Human motion analysis based on a robot arm model , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Michael Girard,et al.  Computer animation of knowledge-based human grasping , 1991, SIGGRAPH.

[9]  Alex Pentland,et al.  Recovery of Nonrigid Motion and Structure , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Katsushi Ikeuchi,et al.  Grasp Recognition Using The Contact Web , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Alex Pentland,et al.  Space-time gestures , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Takeo Kanade,et al.  DigitEyes: Vision-Based Human Hand Tracking , 1993 .