Hierarchical pose estimation for human gait analysis

Articulated structures like the human body have many degrees of freedom. This makes an evaluation of the configuration's likelihood very challenging. In this work we propose new linked hierarchical graphical models which are able to efficiently evaluate likelihoods of articulated structures by sharing visual primitives. Instead of evaluating all configurations of the human body separately we take advantage of the fact that different configurations of the human body share body parts, and body parts, in turn, share visual primitives. A hierarchical Markov random field is used to integrate the sharing of visual primitives in a probabilistic framework. We propose a scalable hierarchical representation of the human body and show that this representation is especially well suited for human gait analysis from a frontal camera perspective. Furthermore, the results of the evaluation on a gait dataset show that sharing primitives substantially accelerates the evaluation and that our hierarchical probabilistic framework is a robust method for scalable detection of the human body.

[1]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[2]  ChewYean Yam,et al.  On the relationship of human walking and running: automatic person identification by gait , 2002, Object recognition supported by user interaction for service robots.

[3]  R. B. Macleod,et al.  A Source Book Of Gestalt Psychology , 1939 .

[4]  Hui Gao,et al.  Gender Recognition from Walking Movements using Adaptive Three-Mode PCA , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[5]  H. Nagel,et al.  Tracking of persons in monocular image sequences , 1997, Proceedings IEEE Nonrigid and Articulated Motion Workshop.

[6]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[7]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[8]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[9]  Richard Bowden,et al.  Detection and Tracking of Humans by Probabilistic Body Part Assembly , 2005, BMVC.

[10]  Ambasamudram N. Rajagopalan,et al.  Human Identification Using Gait , 2002 .

[11]  M. Wertheimer,et al.  A source book of Gestalt psychology. , 1939 .

[12]  William T. Freeman,et al.  Constructing free-energy approximations and generalized belief propagation algorithms , 2005, IEEE Transactions on Information Theory.

[13]  Michael I. Jordan,et al.  Loopy Belief Propagation for Approximate Inference: An Empirical Study , 1999, UAI.

[14]  David C. Hogg Model-based vision: a program to see a walking person , 1983, Image Vis. Comput..

[15]  Michael Isard,et al.  Tracking loose-limbed people , 2004, CVPR 2004.

[16]  Michael J. Black,et al.  HumanEva: Synchronized Video and Motion Capture Dataset and Baseline Algorithm for Evaluation of Articulated Human Motion , 2010, International Journal of Computer Vision.

[17]  Tai Sing Lee,et al.  Hierarchical Bayesian inference in the visual cortex. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[18]  Stephen J. McKenna,et al.  Human Pose Estimation Using Learnt Probabilistic Region Similarities and Partial Configurations , 2004, ECCV.

[19]  Ramakant Nevatia,et al.  Human Pose Tracking in Monocular Sequence Using Multilevel Structured Models , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Cordelia Schmid,et al.  Learning to Parse Pictures of People , 2002, ECCV.

[21]  Tieniu Tan,et al.  Silhouette Analysis-Based Gait Recognition for Human Identification , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  David A. Forsyth,et al.  Strike a pose: tracking people by finding stylized poses , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[23]  Michael J. Black,et al.  Gibbs likelihoods for Bayesian tracking , 2004, CVPR 2004.

[24]  Karl Rohr,et al.  Incremental recognition of pedestrians from image sequences , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.