Tracking of Human Body Parts using the Multiocular Contracting Curve Density Algorithm

In this contribution we introduce the multiocular contracting curve density algorithm (MOCCD), a novel method for fitting a 3D parametric curve. The MOCCD is integrated into a tracking system and its suitability for tracking human body parts in 3D in front of cluttered background is examined. The developed system can be applied to a variety of body parts, as the object model is replaceable in a simple manner. Based on the example of tracking the human hand-forearm limb it is shown that the use of three MOCCD algorithms with three different kinematic models within the system leads to an accurate and temporally stable tracking. All necessary information is obtained from the images, only a coarse initialisation of the model parameters is required. The investigations are performed on 14 real-world test sequences. These contain movements of different hand-forearm configurations in front of a complex cluttered background. We find that the use of three cameras is essential for an accurate and temporally stable system performance since otherwise the pose estimation and tracking results are strongly affected by the aperture problem. Our best method achieves 95% recognition rate, compared to about 30% for the reference methods of 3D active contours and a curve model tracked by a particle filter. Hence only 5% of the estimated model points exceed a distance of 12 cm with respect to the ground truth, using the proposed method.

[1]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[2]  Andrew Blake,et al.  Articulated body motion capture by annealed particle filtering , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[3]  Pascal Fua,et al.  Articulated Soft Objects for Multiview Shape and Motion Capture , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Bodo Rosenhahn,et al.  A System for Marker-Less Human Motion Estimation , 2005, DAGM-Symposium.

[5]  Paulo R. S. Mendonça,et al.  Model-Based Hand Tracking Using an Unscented Kalman Filter , 2001, BMVC.

[6]  Michael Beetz,et al.  The Contracting Curve Density Algorithm: Fitting Parametric Curve Models to Images Using Local Self-Adapting Separation Criteria , 2004, International Journal of Computer Vision.

[7]  Takeo Kanade,et al.  Shape-From-Silhouette Across Time Part II: Applications to Human Modeling and Markerless Motion Tracking , 2005, International Journal of Computer Vision.

[8]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[9]  Michael Isard,et al.  Active Contours , 2000, Springer London.

[10]  Hiroshi Akima,et al.  A New Method of Interpolation and Smooth Curve Fitting Based on Local Procedures , 1970, JACM.

[11]  Fridtjof Stein,et al.  In-factory calibration of multiocular camera systems , 2004, SPIE Photonics Europe.

[12]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[13]  Yaakov Bar-Shalom,et al.  Estimation and Tracking: Principles, Techniques, and Software , 1993 .

[14]  Jannik Fritsch,et al.  Kernel particle filter for real-time 3D body tracking in monocular color images , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[15]  Christian Wöhler,et al.  Model Basedmulti-View Active Contours for Quality Inspection , 2004, ICCVG.

[16]  Robert Hanek.  The contracting curve density algorithm and its application to model-based image segmentation , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.