3 D Shape From Multi-viewpoint Images Using Deformable Mesh Model

This paper presents a two-stage method for 3D shape reconstruction from multi-viewpoint images. In the first stage, a rough 3D shape of an object is estimated by using volumetric intersection from geometric information of the object, i.e., silhouettes. In the following stage, the estimated shape is refined by using “deformable mesh model”. This model changes its shape so as to satisfy the following constraints: 1) “photo-consistency” constraint, 2) silhouette constraint, 3) smoothness constraint. The volumetric intersection estimates rough but stable shape using geometric information, and the deformable model refines the shape using photometric information. Hence, the method has two advantages of stability and accuracy. Some experimental results are also shown for demonstrating these advantages.

[1]  S. Suess,et al.  Three dimensional modelling , 1974 .

[2]  Bruce G. Baumgart,et al.  Geometric modeling for computer vision. , 1974 .

[3]  Jake K. Aggarwal,et al.  TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE , 2008 .

[4]  Susan Hackwood,et al.  Computational geometric methods in volumetric intersection for 3D reconstruction , 1990, Pattern Recognit..

[5]  Aldo Laurentini,et al.  How Far 3D Shapes Can Be Understood from 2D Silhouettes , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Katsushi Ikeuchi,et al.  A Spherical Representation for Recognition of Free-Form Surfaces , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  David C. Hogg,et al.  Towards 3D hand tracking using a deformable model , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[8]  Andrew Zisserman,et al.  Wide baseline stereo matching , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[9]  Andrew Zisserman,et al.  Surface Reconstruction from Multiple Views Using Apparent Contours and Surface Texture , 2000, Confluence of Computer Vision and Computer Graphics.

[10]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[11]  Kiriakos N. Kutulakos,et al.  A Theory of Shape by Space Carving , 2000, International Journal of Computer Vision.

[12]  Pascal Fua,et al.  Object-centered surface reconstruction: Combining multi-image stereo and shading , 1995, International Journal of Computer Vision.