A real-time full body tracking and humanoid animation system

Non-intrusive human body tracking is a key issue in advanced human-computer interaction, with applications ranging from virtual reality to videoconference and telepresence. This paper describes a system for vision-based tracking of body posture. The system is explicitly designed to provide a robust yet simple and inexpensive solution to real-time body tracking through a careful choice of visual and kinematic models. Human posture representation is fully compatible with the MPEG-4 standard. Results of system application to a computer graphics scenario (animation of 3D avatars) are presented and discussed.

[1]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Emanuele Trucco,et al.  Introductory techniques for 3-D computer vision , 1998 .

[3]  D. H. Mellor,et al.  Real time , 1981 .

[4]  Nebojsa Jojic,et al.  Tracking self-occluding articulated objects in dense disparity maps , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[5]  Larry S. Davis,et al.  Real-time 3D Motion Capture , 1998 .

[6]  Donald P. Brutzman,et al.  The virtual reality modeling language and Java , 1998, CACM.

[7]  Josie Wernecke,et al.  The inventor mentor - programming object-oriented 3D graphics with Open Inventor, release 2 , 1993 .

[8]  Kazuhiko Takahashi,et al.  Real-time, 3D estimation of human body postures from trinocular images , 1999, Proceedings IEEE International Workshop on Modelling People. MPeople'99.

[9]  Ronan Boulic,et al.  Hierarchical kinematic behaviors for complex articulated figures , 1996 .

[10]  W. Press,et al.  Numerical Recipes in Fortran: The Art of Scientific Computing.@@@Numerical Recipes in C: The Art of Scientific Computing. , 1994 .

[11]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[12]  Alex Pentland,et al.  Real-time self-calibrating stereo person tracking using 3-D shape estimation from blob features , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[13]  William H. Press,et al.  The Art of Scientific Computing Second Edition , 1998 .

[14]  Alex Pentland,et al.  The ALIVE system: full-body interaction with autonomous agents , 1995, Proceedings Computer Animation'95.