3D shape estimation based on density driven model fitting

We introduce a generic and efficient method for 2D and 3D shape estimation via density fields. Our method models shape as a density map and uses the notion of density to fit a model to a rapidly computed occupancy map of the foreground object. We show how to utilize hierarchical (pyramid-like) object segmentation data to regularize a hierarchical model fitting. With primary focus on estimating 3D shapes of nonrigid articulated objects such as human bodies, we illustrate our approach with examples of efficient model fitting to 3D occupancy maps of human figures. We also discuss a number of extensions of our method to applications involving nonrigid object tracking and movement analysis.

[1]  W. Eric L. Grimson,et al.  Fixed topology skeletons , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[2]  Gérard G. Medioni,et al.  Full Volumetric Descriptions From Three Intensity Images , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Andrea Bottino,et al.  A Silhouette Based Technique for the Reconstruction of Human Movement , 2001, Comput. Vis. Image Underst..

[4]  Frank P. Ferrie,et al.  Darboux Frames, Snakes, and Super-Quadrics: Geometry from the Bottom Up , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  S. Gong,et al.  Tracking hybrid 2D-3D human models from multiple views , 1999, Proceedings IEEE International Workshop on Modelling People. MPeople'99.

[6]  Larry S. Davis,et al.  3-D model-based tracking of humans in action: a multi-view approach , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Ramakant Nevatia,et al.  Part-Based 3D Descriptions of Complex Objects from a Single Image , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Jen-Hui Chuang,et al.  Skeletonization of Three-Dimensional Object Using Generalized Potential Field , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Steven W. Zucker,et al.  On the evolution of the skeleton , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[10]  Pascal Fua,et al.  Tracking and Modeling People in Video Sequences , 2001, Comput. Vis. Image Underst..

[11]  Larry S. Davis,et al.  A distributed system for real-time volume reconstruction , 2000, Proceedings Fifth IEEE International Workshop on Computer Architectures for Machine Perception.

[12]  Tosiyasu L. Kunii,et al.  Model-based analysis of hand posture , 1995, IEEE Computer Graphics and Applications.

[13]  Robert Bergevin,et al.  Generalized cylinders extraction in a range image , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[14]  Richard K. Beatson,et al.  Reconstruction and representation of 3D objects with radial basis functions , 2001, SIGGRAPH.

[15]  Larry S. Davis,et al.  Multi-perspective analysis of human action , 1999 .

[16]  Jules Bloomenthal,et al.  Skeletal methods of shape manipulation , 1999, Proceedings Shape Modeling International '99. International Conference on Shape Modeling and Applications.

[17]  R. Plankers,et al.  Articulated soft objects for video-based body modeling , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.