Image based modeling via plane sweep based surface growing

In this paper, we present a multi-view stereo based shaped modeling method. Using images captured from different viewpoints, our approach can provide objects' 3d models with high fidelity details automatically and efficiently. We firstly use a strict plane based sweep stereo method via GPU to compute quasi-dense depth maps which usually have many holes. Then, a simplified patch based surface growing method is used to compute dense depth maps and the corresponding 3d geometry model. Different from other multi-view stereo methods, we do not optimize object normal during expansion process, but gradually compute the normal information from reconstructed quasi dense neighbors. This makes our method works well on much more difficult scenarios, such as textureless, wide baseline, varying illumination than plane based sweep methods and more efficient than surface growing methods. Experiments show that our method can generate high fidelity 3D object shape model quite efficiently.

[1]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[2]  Francis Schmitt,et al.  Silhouette and stereo fusion for 3D object modeling , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[3]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[4]  Du-Ming Tsai,et al.  Fast normalized cross correlation for defect detection , 2003, Pattern Recognit. Lett..

[5]  Francis Schmitt,et al.  Silhouette and stereo fusion for 3D object modeling , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[6]  Christopher Zach,et al.  High-Performance Multi-View Reconstruction , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[7]  Jan-Michael Frahm,et al.  Variable baseline/resolution stereo , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[9]  Roberto Cipolla,et al.  Multi-view stereo via volumetric graph-cuts , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Long Quan,et al.  A quasi-dense approach to surface reconstruction from uncalibrated images , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[13]  Pascal Fua,et al.  On benchmarking camera calibration and multi-view stereo for high resolution imagery , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Tim Weyrich,et al.  Post-processing of Scanned 3D Surface Data , 2004, PBG.

[15]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[16]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.