On Implicit Modelling for Fitting Purposes

Tracking and modeling people from video sequences has become an in­ creasingly important research topic, with applications inc1uding anima­ tion, surveillance and sports medicine. In this paper, we propose a model based 3-D approach to recovering both body shape and motion. It takes advantage of a sophisticated animation model to achieve both robustness and realism. Stereo sequences of people in motion serve as input to our system. From these, we extract a 2.5-D description of the scene and, optionally, silhouette edges. We propose an integrated frame­ work to fit the model and to track the person's motion. Constraints for 3-D points and silhouette edges are presented in detail. We recover not only the motion but also a fuH animation model c10sely resembling the subject.

[1]  Pascal Fua,et al.  Using model-driven bundle-adjustment to model heads from raw video sequences , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[2]  Kurt Konolige,et al.  Small Vision Systems: Hardware and Implementation , 1998 .

[3]  William H. Press,et al.  Numerical recipes in C. The art of scientific computing , 1987 .

[4]  Jean Ponce,et al.  Using Geometric Distance Fits for 3-D Object Modeling and Recognition , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Nadia Magnenat-Thalmann,et al.  Generating Animatable 3D Virtual Humans from Photographs , 2000, Comput. Graph. Forum.

[6]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[7]  Pascal Fua,et al.  Reconstructing complex surfaces from multiple stereo views , 1995, Proceedings of IEEE International Conference on Computer Vision.

[8]  Daniel Thalmann,et al.  Fast realistic human body deformations for animation and VR applications , 1996, Proceedings of CG International '96.

[9]  Wei Sun,et al.  Virtual people: capturing human models to populate virtual worlds , 1999, Proceedings Computer Animation 1999.

[10]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..