3-D Reconstruction of Multipart Self-Occluding Objects

In this paper we present a method for reconstruction of multipart objects from several arbitrary views using deformable superquadrics as the models of the object's parts. Two visual cues are used: occluding contours and stereo (possibly aided by projected patterns). The object can be relatively complex and can exhibit numerous self occlusions from some or all views. Our preliminary experiments on a human body and a tailor's mannequin show that the reconstruction is more complete than in purely stereo or structured light based methods and more precise than the reconstruction from occluding contours only.

[1]  Yuan-Fang Wang,et al.  Integration of active and passive sensing techniques for representing three-dimensional objects , 1989, IEEE Trans. Robotics Autom..

[2]  Dimitris N. Metaxas,et al.  Dynamic 3D models with local and global deformations: deformable superquadrics , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[3]  Ioannis A. Kakadiaris,et al.  Model-based estimation of 3D human motion with occlusion based on active multi-viewpoint selection , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Robert C. Bolles,et al.  Parametric Correspondence and Chamfer Matching: Two New Techniques for Image Matching , 1977, IJCAI.

[5]  Nebojsa Jojic,et al.  On Analysis of Cloth Drape Range Data , 1998, ACCV.

[6]  Dimitris N. Metaxas,et al.  Shape and Nonrigid Motion Estimation Through Physics-Based Synthesis , 1993, IEEE Trans. Pattern Anal. Mach. Intell..