Physics-Based Person Tracking Using the Anthropomorphic Walker

We introduce a physics-based model for 3D person tracking. Based on a biomechanical characterization of lower-body dynamics, the model captures important physical properties of bipedal locomotion such as balance and ground contact. The model generalizes naturally to variations in style due to changes in speed, step-length, and mass, and avoids common problems (such as footskate) that arise with existing trackers. The dynamics comprise a two degree-of-freedom representation of human locomotion with inelastic ground contact. A stochastic controller generates impulsive forces during the toe-off stage of walking, and spring-like forces between the legs. A higher-dimensional kinematic body model is conditioned on the underlying dynamics. The combined model is used to track walking people in video, including examples with turning, occlusion, and varying gait. We also report quantitative monocular and binocular tracking results with the HumanEva dataset.

[1]  J. W. Humberston.  Classical mechanics , 1980, Nature.

[2]  Andrew P. Witkin,et al.  Spacetime constraints , 1988, SIGGRAPH.

[3]  Tad McGeer,et al.  Passive walking with knees , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[4]  Tad McGeer,et al.  Passive Dynamic Walking , 1990, Int. J. Robotics Res..

[5]  Dimitris N. Metaxas,et al.  Dynamic 3D models with local and global deformations: deformable superquadrics , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[6]  D. Houlihan,et al.  Advances in Comparative and Environmental Physiology , 1991, Advances in Comparative and Environmental Physiology.

[7]  Alex Pentland,et al.  Recovery of Nonrigid Motion and Structure , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  T. McGeer,et al.  Principles of Walking and Running , 1992 .

[9]  Dimitris N. Metaxas,et al.  Shape and Nonrigid Motion Estimation Through Physics-Based Synthesis , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Jun S. Liu,et al.  Sequential Imputations and Bayesian Missing Data Problems , 1994 .

[11]  Sven J. Dickinson,et al.  Physics-based tracking of 3D objects in 2D image sequences , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[12]  David C. Brogan,et al.  Animating human athletics , 1995, SIGGRAPH.

[13]  C. Robert.  Simulation of truncated normal variables , 2009, 0907.4010.

[14]  Alex Pentland,et al.  Dynamic models of human motion , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[15]  Zoran Popovic,et al.  Physically based motion transformation , 1999, SIGGRAPH.

[16]  Vladimir Pavlovic,et al.  A dynamic Bayesian network approach to figure tracking using learned dynamic models , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[17]  R J Full,et al.  Templates and anchors: neuromechanical hypotheses of legged locomotion on land. , 1999, The Journal of experimental biology.

[18]  M. Pitt,et al.  Filtering via Simulation: Auxiliary Particle Filters , 1999 .

[19]  Hans-Hellmut Nagel,et al.  Tracking Persons in Monocular Image Sequences , 1999, Comput. Vis. Image Underst..

[20]  David J. Fleet,et al.  Stochastic Tracking of 3D Human Figures Using 2D Image Motion , 2000, ECCV.

[21]  Simon J. Godsill,et al.  On sequential Monte Carlo sampling methods for Bayesian filtering , 2000, Stat. Comput..

[22]  Gill A. Pratt,et al.  Legged robots at MIT: what's new since Raibert? , 2000, IEEE Robotics Autom. Mag..

[23]  Ioannis A. Kakadiaris,et al.  Model-Based Estimation of 3D Human Motion , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Olivier D. Faugeras,et al.  3D Articulated Models and Multiview Tracking with Physical Forces , 2001, Comput. Vis. Image Underst..

[25]  Martijn Wisse,et al.  A Three-Dimensional Passive-Dynamic Walking Robot with Two Legs and Knees , 2001, Int. J. Robotics Res..

[26]  Stan Sclaroff,et al.  3D hand pose reconstruction using specialized mappings , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[27]  David J. Fleet,et al.  People tracking using hybrid Monte Carlo filtering , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[28]  A. Kuo.  A simple model of bipedal walking predicts the preferred speed-step length relationship. , 2001, Journal of biomechanical engineering.

[29]  Arthur D Kuo,et al.  Energetics of actively powered locomotion using the simplest walking model. , 2002, Journal of biomechanical engineering.

[30]  Lucas Kovar,et al.  Footskate cleanup for motion capture editing , 2002, SCA '02.

[31]  C. Poole,et al.  Classical Mechanics, 3rd ed. , 2002 .

[32]  Trevor Darrell,et al.  Fast pose estimation with parameter-sensitive hashing , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[33]  Hyun Joon Shin,et al.  Physical touch-up of human motions , 2003, 11th Pacific Conference onComputer Graphics and Applications, 2003. Proceedings..

[34]  F. Dellaert,et al.  A Rao-Blackwellized particle filter for EigenTracking , 2004, CVPR 2004.

[35]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[36]  R. Blickhan,et al.  Similarity in multilegged locomotion: Bouncing like a monopode , 1993, Journal of Comparative Physiology A.

[37]  A. Elgammal,et al.  Inferring 3D body pose from silhouettes using activity manifold learning , 2004, CVPR 2004.

[38]  Jessica K. Hodgins,et al.  Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces , 2004, SIGGRAPH 2004.

[39]  Cristian Sminchisescu,et al.  Generative modeling for continuous non-linearly embedded visual inference , 2004, ICML.

[40]  C. K. Liu,et al.  Learning physics-based motion style with nonlinear inverse optimization , 2005, SIGGRAPH 2005.

[41]  Andy Ruina,et al.  A Bipedal Walking Robot with Efficient and Human-Like Gait , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[42]  Trevor Darrell,et al.  Learning appearance manifolds from video , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[43]  C. Karen Liu,et al.  Learning physics-based motion style with nonlinear inverse optimization , 2005, ACM Trans. Graph..

[44]  Pascal Fua,et al.  Hierarchical implicit surface joint limits for human body tracking , 2005, Comput. Vis. Image Underst..

[45]  David J. Fleet,et al.  Priors for people tracking from small training sets , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[46]  G. B. Kauffman,et al.  Efficient Bipedal Robots Based on Passive-Dynamic Walkers , 2005 .

[47]  Alessandro Bissacco,et al.  Modeling and learning contact dynamics in human motion , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[48]  Michael J. Black,et al.  HumanEva: Synchronized Video and Motion Capture Dataset for Evaluation of Articulated Human Motion , 2006 .

[49]  David J. Fleet,et al.  Optical Flow Estimation , 2006, Handbook of Mathematical Models in Computer Vision.

[50]  Ankur Agarwal,et al.  Recovering 3D human pose from monocular images , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  David J. Fleet,et al.  3D People Tracking with Gaussian Process Dynamical Models , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[52]  David J. Fleet,et al.  Physics-Based Person Tracking Using Simplified Lower-Body Dynamics , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[53]  Arend L. Schwab,et al.  Adding an Upper Body to Passive Dynamic Walking Robots by Means of a Bisecting Hip Mechanism , 2007, IEEE Transactions on Robotics.

[54]  M. V. D. Panne,et al.  SIMBICON: simple biped locomotion control , 2007, SIGGRAPH 2007.

[55]  Cristian Sminchisescu,et al.  BM³E : Discriminative Density Propagation for Visual Tracking , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[56]  David J. Fleet,et al.  The Kneed Walker for human pose tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[57]  Odest Chadwicke Jenkins,et al.  Physical simulation for probabilistic motion tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[58]  A. Schwab.  Lecture Notes Multibody Dynamics B, wb1413 , 2009 .