A MVS based automatic 3D model reconstruction system from turntable image sequence

Traditionally, multi-view stereo (MVS) based 3D reconstruction needs a lot of manual interactions, such as camera calibration, silhouette extraction, texture synthesis, etc. To overcome this disadvantage, we present an automatic 3D reconstruction method based on image sequence. First, we design a new checkerboard with included angle 120°. The camera parameters and the rotational axis can be calibrated simultaneously. Then, an automatic silhouette extraction method is presented based on super pixel and cellular automata, from which the color image sequence can be segmented into binary images. Next, we use MVS based 3D reconstruction method to obtain 3D mesh model with camera parameters, color images and silhouettes. Finally, by using the 3D model, projection matrix and color images, we can synthesize the texture map. A prototype is developed based on Canon SDK and a controller. This system can help user to acquire 3D models without professional knowledge. Experimental results with variety of objects demonstrate the effectiveness of our system.

[1]  Luc Van Gool,et al.  Stratified Self-Calibration with the Modulus Constraint , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Roberto Cipolla,et al.  PhotoBuilder-3D models of architectural scenes from uncalibrated images , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[5]  M. Pollefeys.  Self-calibration and metric 3d reconstruction from uncalibrated image sequences , 1999 .

[6]  Olivier D. Faugeras,et al.  On the geometry and algebra of the point and line correspondences between N images , 1995, Proceedings of IEEE International Conference on Computer Vision.

[7]  Olivier D. Faugeras,et al.  A nonlinear method for estimating the projective geometry of 3 views , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[8]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[9]  Huchuan Lu,et al.  Saliency detection via Cellular Automata , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[11]  Xiaojun Wu,et al.  Multi-View Stereo Reconstruction Technique , 2013 .

[12]  Xiaojun Wu,et al.  Multi-resolution texture synthesis from turntable image sequences , 2012 .