Dynamic 3D shape from multi-viewpoint images using deformable mesh model

This paper presents a framework for dynamic 3D shape reconstruction from multi-viewpoint images using a deformable mesh model. With our method, we can obtain 3D shape and 3D motion of the object simultaneously. We represent the shape by a surface mesh model and the motion by translations of its vertices, i.e., deformation. Thus global and local topological structure of the mesh are preserved from frame to frame. This helps us to analyse the motion of the object, to compress the 3D data, and so on. Our model deforms its shape so as to satisfy several constraints. This constraint-based deformation provides a computational framework to integrate several reconstruction cues such as surface texture, silhouette, and motion flow observed in multi-viewpoint images.

[1]  D. Burr A dynamic model for image registration , 1981 .

[2]  Pascal Fua,et al.  Using 3-Dimensional Meshes To Combine Image-Based and Geometry-Based Constraints , 1994, ECCV.

[3]  David C. Hogg,et al.  Towards 3D hand tracking using a deformable model , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[4]  Atsushi Imiya,et al.  Marching cubes method with connectivity , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[5]  Takeo Kanade,et al.  Shape and motion carving in 6D , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[6]  Andrew Zisserman,et al.  Surface Reconstruction from Multiple Views Using Apparent Contours and Surface Texture , 2000, Confluence of Computer Vision and Computer Graphics.

[7]  Andrea Bottino,et al.  A Silhouette Based Technique for the Reconstruction of Human Movement , 2001, Comput. Vis. Image Underst..

[8]  Takashi Matsuyama,et al.  Real-time active 3D shape reconstruction for 3D video , 2003, 3rd International Symposium on Image and Signal Processing and Analysis, 2003. ISPA 2003. Proceedings of the.

[9]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[10]  Kiriakos N. Kutulakos,et al.  A Theory of Shape by Space Carving , 2000, International Journal of Computer Vision.

[11]  Takeo Kanade,et al.  Three-dimensional scene flow , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.