Volumetric Model Reconstruction from Unrestricted Camera Views Based on the Photo-consistency of 3D Voxel Mask

This project aims to develop a three-dimensional (3D) model reconstruction system using images acquired from a mobile camera. It consists of four major steps: camera calibration, volumetric model reconstruction, surface modeling and texture mapping. A novel online scale factor estimation is developed to enhance the accuracy of the coplanar camera calibration. For the volumetric modeling, the voting-based shape-from-silhouette first generates a coarse model, which is then refined by the photo-consistency check using the novel 3D voxel mask. Our scheme can handle concave surface in a sophisticated way. Finally, the surface model is formed with the original images mapped. 3D models of some test objects are presented.

[1]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[2]  Antonis A. Argyros,et al.  Fusion of laser and visual data for robot motion planning and collision avoidance , 2003, Machine Vision and Applications.

[3]  Long Quan,et al.  Surface Reconstruction by Propagating 3D Stereo Data in Multiple 2D Images , 2004, ECCV.

[4]  Roger Y. Tsai,et al.  Techniques for Calibration of the Scale Factor and Image Center for High Accuracy 3-D Machine Vision Metrology , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Reinhard Koch,et al.  Visual Modeling with a Hand-Held Camera , 2004, International Journal of Computer Vision.

[6]  Vwani P. Roychowdhury,et al.  Algorithms for coplanar camera calibration , 2000, Machine Vision and Applications.

[7]  Paul A. Beardsley,et al.  3D Model Acquisition from Extended Image Sequences , 1996, ECCV.

[8]  Steven M. Seitz,et al.  Photorealistic Scene Reconstruction by Voxel Coloring , 1997, International Journal of Computer Vision.

[9]  Long Quan,et al.  Surface reconstruction by integrating 3D and 2D data of multiple views , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[10]  William Schroeder,et al.  The Visualization Toolkit: An Object-Oriented Approach to 3-D Graphics , 1997 .

[11]  David P. Luebke,et al.  A Developer's Survey of Polygonal Simplification Algorithms , 2001, IEEE Computer Graphics and Applications.

[12]  Stan Sclaroff,et al.  Stochastic refinement of the visual hull to satisfy photometric and silhouette consistency constraints , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[13]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[14]  A. Laurentini,et al.  The Visual Hull Concept for Silhouette-Based Image Understanding , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Kiriakos N. Kutulakos,et al.  A Theory of Shape by Space Carving , 2000, International Journal of Computer Vision.

[16]  Alan Watt,et al.  3D Computer Graphics , 1993 .

[17]  Wolfgang Niem,et al.  Automatic reconstruction of 3D objects using a mobile camera , 1999, Image Vis. Comput..

[18]  Sang Wook Lee,et al.  High-Contrast Color-Stripe Pattern for Rapid Structured-Light Range Imaging , 2004, ECCV.

[19]  Peter Eisert,et al.  Multi-hypothesis, volumetric reconstruction of 3-D objects from multiple calibrated camera views , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[20]  Paolo Cignoni,et al.  Multiple Texture Stitching and Blending on 3D Objects , 1999, Rendering Techniques.

[21]  Hans-Peter Seidel,et al.  A Silhouette-Based Algorithm for Texture Registration and Stitching , 2001, Graph. Model..

[22]  Paul S. Heckbert,et al.  Survey of Texture Mapping , 1986, IEEE Computer Graphics and Applications.

[23]  Yukinori Matsumoto,et al.  Shape-from-Silhouette/Stereo and Its Application to 3-D Digitizer , 1999, DGCI.

[24]  Thomas Malzbender,et al.  A Survey of Methods for Volumetric Scene Reconstruction from Photographs , 2001, VG.

[25]  Sabry F. El-Hakim,et al.  A multi-sensor approach to creating accurate virtual environments 1 Revised version of a paper prese , 1998 .

[26]  Paulo R. S. Mendonça,et al.  Epipolar geometry from profiles under circular motion , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Olivier D. Faugeras,et al.  Complete Dense Stereovision Using Level Set Methods , 1998, ECCV.

[28]  Michael A. Penna.  Camera Calibration: A Quick and Easy Way to Determine the Scale Factor , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Francis Schmitt,et al.  Silhouette and stereo fusion for 3D object modeling , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..