Tracking 3D Human Motion in Compact Base Space

In this study, we present an efficient approach to recover 3D human motion from monocular image sequences in generative reconstruction framework. This approach is based on the extracting of motion base space. From the motion capture data with bothersome high dimension characteristic of human activity, we extract the motion base space in which human pose can be described essentially and concisely by a more controllable way. And then, the structure of this space corresponding to some special activities such as walking motion is explored with data clustering. For the single image, Gaussian mixture model is used to generate the candidates of 3D pose. The shape context is the common descriptor of image silhouette feature and synthetical feature of human model. We get the shortlist of 3D poses by measuring the shape contexts matching cost between image feature and the synthetical features. In tracking situation, an AR model trained by the example sequences produces almost accurate pose predictions. Experiments demonstrate that the proposed approach works well

[1]  Tieniu Tan,et al.  People tracking based on motion model and motion constraints with automatic initialization , 2004, Pattern Recognit..

[2]  Michael J. Black,et al.  Implicit Probabilistic Models of Human Motion for Synthesis and Tracking , 2002, ECCV.

[3]  Camillo J. Taylor,et al.  Reconstruction of Articulated Objects from Point Correspondences in a Single Uncalibrated Image , 2000, Comput. Vis. Image Underst..

[4]  Michael J. Black,et al.  Learning and Tracking Cyclic Human Motion , 2000, NIPS.

[5]  Jitendra Malik,et al.  Recovering 3D human body configurations using shape contexts , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Rómer Rosales,et al.  Learning Body Pose via Specialized Maps , 2001, NIPS.

[7]  Jitendra Malik,et al.  Efficient shape matching using shape contexts , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Pascal Fua,et al.  3D Human Body Tracking Using Deterministic Temporal Motion Models , 2004, ECCV.

[9]  Cristian Sminchisescu,et al.  Discriminative density propagation for 3D human motion estimation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Ankur Agarwal,et al.  Tracking Articulated Motion Using a Mixture of Autoregressive Models , 2004, ECCV.

[11]  David J. Fleet,et al.  Monocular 3-D Tracking of the Golf Swing , 2005, CVPR.

[12]  Xiaogang Jin,et al.  Convolution surfaces for arcs and quadratic curves with a varying kernel , 2002, The Visual Computer.

[13]  David J. Fleet,et al.  Monocular 3D tracking of the golf swing , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  Jake K. Aggarwal,et al.  Human Motion Analysis: A Review , 1999, Comput. Vis. Image Underst..

[15]  Ankur Agarwal,et al.  Recovering 3D human pose from monocular images , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..