Probabilistic 3D Tracking: Rollator Users' Leg Pose from Coronal Images

Understanding the human gait is an important objective towards improving elderly mobility. In turn, gait analyses largely depend on kinematic and dynamic measurements. While the majority of current markerless vision systems focus on estimating 2D and 3D walking motion in the sagittal plane, we wish to estimate the 3D pose of rollator users' lower limbs from observing image sequences in the coronal (frontal) plane. Our apparatus poses a unique set of challenges: a single monocular view of only the lower limbs and a frontal perspective of the rollator user. Since motion in the coronal plane is relatively subtle, we explore multiple cues within a Bayesian probabilistic framework to formulate a posterior estimate for a given subject's leg limbs. This paper describes four cues based on three features to formulate a pose estimate: image gradients, colour and anthropometric symmetry. Our appearance model is applied within a non-parametric (particle) filtering system to track the lower limbs. Our tracking system does not rely on any detection for automatic initialization. Preliminary experiments are promising, showing that the algorithm may provide an indication of relative depth for each lower limb.

[1]  Michael J. Black,et al.  Predicting 3D People from 2D Pictures , 2006, AMDO.

[2]  Jitendra Malik,et al.  Estimating Human Body Configurations Using Shape Context Matching , 2002, ECCV.

[3]  Pradip N. Sheth,et al.  Intelligent Mobility Aids for the Elderly , 2008 .

[4]  Yang Song,et al.  Unsupervised Learning of Human Motion , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  John S. Zelek,et al.  Towards real-time 3-D monocular visual tracking of human limbs in unconstrained environments , 2005, Real Time Imaging.

[6]  Larry S. Davis,et al.  A Robust Background Subtraction and Shadow Detection , 1999 .

[7]  Richard Bowden,et al.  Detection and Tracking of Humans by Probabilistic Body Part Assembly , 2005, BMVC.

[8]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[9]  Jared Glover A robotically-augmented walker for older adults , 2003 .

[10]  Jesse Hoey,et al.  Automated Detection of Unusual Events on Stairs , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[11]  Kazuhiro Kosuge,et al.  Motion Control of Intelligent Walker based on Renew of Estimation Parameters for User State , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  David J. Fleet,et al.  Probabilistic Detection and Tracking of Motion Boundaries , 2000, International Journal of Computer Vision.

[13]  Cristian Sminchisescu,et al.  Estimating Articulated Human Motion with Covariance Scaled Sampling , 2003, Int. J. Robotics Res..

[14]  Paul W. Fieguth,et al.  Color-based tracking of heads and other mobile objects at video frame rates , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  James W. Davis,et al.  The Representation and Recognition of Action Using Temporal Templates , 1997, CVPR 1997.

[16]  Olivier Bernier,et al.  Fast nonparametric belief propagation for real-time stereo articulated body tracking , 2009, Comput. Vis. Image Underst..

[17]  David J. Fleet,et al.  Monocular 3-D Tracking of the Golf Swing , 2005, CVPR.

[18]  Tieniu Tan,et al.  Kinematics-based tracking of human walking in monocular video sequences , 2004, Image Vis. Comput..

[19]  Cristian Sminchisescu,et al.  Kinematic jump processes for monocular 3D human tracking , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[20]  David J. Fleet,et al.  People tracking using hybrid Monte Carlo filtering , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[21]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[22]  Odest Chadwicke Jenkins,et al.  Physical simulation for probabilistic motion tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  David J. Fleet,et al.  Monocular 3D tracking of the golf swing , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[24]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[25]  A. Kutiyanawala,et al.  iWalker: Toward a Rollator-Mounted Wayfinding System for the Elderly , 2008, 2008 IEEE International Conference on RFID.

[26]  James W. Davis,et al.  The representation and recognition of human movement using temporal templates , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[27]  BlakeAndrew,et al.  C ONDENSATION Conditional Density Propagation forVisual Tracking , 1998 .

[28]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[29]  Bartlett W. Mel,et al.  Cue combination and color edge detection in natural scenes. , 2008, Journal of vision.

[30]  Jitendra Malik,et al.  Recovering human body configurations: combining segmentation and recognition , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[31]  James Tung,et al.  IWalker: A ‘Real-World’ Molity Assessment Tool , 2007 .

[32]  Andrew Blake,et al.  Probabilistic Tracking with Exemplars in a Metric Space , 2002, International Journal of Computer Vision.

[33]  Frank Nielsen,et al.  Statistical region merging , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.