Non-linear statistical models for the 3D reconstruction of human pose and motion from monocular image sequences

This paper presents a model based approach to human body tracking in which the 2D silhouette of a moving human and the corresponding 3D skeletal structure are encapsulated within a non-linear point distribution model. This statistical model allows a direct mapping to be achieved between the external boundary of a human and the anatomical position. It is shown how this information, along with the position of landmark features such as the hands and head can be used to reconstruct information about the pose and structure of the human body from a monocular view of a scene.

[1]  Timothy F. Cootes,et al.  A Non-linear Generalisation of PDMs using Polynomial Regression , 1994, BMVC.

[2]  Robin D. Tillett,et al.  Modelling Collective Animal Behaviour using Extended Point Distribution Models , 1997, BMVC.

[3]  M Sarhadi,et al.  Cluster based nonlinear principle component analysis , 1997 .

[4]  Stephen M. Omohundro,et al.  Surface Learning with Applications to Lipreading , 1993, NIPS.

[5]  M Sarhadi,et al.  Cluster Based non-linear Principle Component Analysis , 1997 .

[6]  Timothy F. Cootes,et al.  Non-linear point distribution modelling using a multi-layer perceptron , 1995, Image Vis. Comput..

[7]  David C. Hogg,et al.  Improving Specificity in PDMs using a Hierarchical Approach , 1997, BMVC.

[8]  Shaogang Gong,et al.  Face Recognition in Dynamic Scenes , 1997, BMVC.

[9]  Alex Pentland,et al.  Real-time self-calibrating stereo person tracking using 3-D shape estimation from blob features , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[10]  David C. Hogg,et al.  Real Time Hand Tracking and Gesture Recognition as a 3D Input Device for Graphical Applications , 1996, Gesture Workshop.

[11]  Alistair D. N. Edwards,et al.  Progress in Gestural Interaction, Proceedings of Gesture Workshop '96, March 19th 1996, University of York, UK , 1997, Gesture Workshop.

[12]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[13]  Christopher J. Taylor,et al.  Automatic Construction of Eigenshape Models by Genetic Algorithm , 1997, IPMI.

[14]  Timothy F. Cootes,et al.  A mixture model for representing shape variation , 1999, Image Vis. Comput..

[15]  David C. Hogg,et al.  Automated Pivot Location for the Cartesian-Polar Hybrid Point Distribution Model , 1995, BMVC.