From Image Sequence to 3D Reconstructed Model

Obtaining 3D model based on images by simple devices is convenient and low-cost, meanwhile the model generation is automatic. The paper proposes a method to extract the 3D point cloud of object surface by a sequence of images. To obtain sparse 3D point clouds, a highly precise method of camera self-calibration is proposed. The self-calibration method is based on the bundle adjustment and uses a localglobal hybrid iterative optimization. Meanwhile, we propose a neighboring image matching strategy to solve the problem in the multiple image matching, which can improve the matching speed and preserve the matching accuracy. Then, dense 3D point clouds can be obtained by our improved Patchedbased Multi-View Stereo(PMVS) algorithm. Finally, we adopt 3D mesh construction method based on Possion distribution. The experimental results show that our algorithm increases the number of triangulation patches by 2.5% 27.9%, reduces the operation time by 5.0% 20.7%, and decreases the cross and mismatch of triangular patches in most cases. It is convenient and efficient to print out 3D models with richer details.

[1]  Tae Hee Han,et al.  Fast Normalized Cross-Correlation , 2009, Circuits Syst. Signal Process..

[2]  Michael M. Kazhdan,et al.  Screened poisson surface reconstruction , 2013, TOGS.

[3]  J. J. Moré,et al.  Levenberg--Marquardt algorithm: implementation and theory , 1977 .

[4]  Bill Triggs,et al.  Critical Motions for Auto-Calibration When Some Intrinsic Parameters Can Vary , 2000, Journal of Mathematical Imaging and Vision.

[5]  Sunghee Choi,et al.  The power crust , 2001, SMA '01.

[6]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[8]  Jorge J. Moré,et al.  The Levenberg-Marquardt algo-rithm: Implementation and theory , 1977 .

[9]  Takeo Kanade,et al.  Shape and motion from image streams under orthography: a factorization method , 1992, International Journal of Computer Vision.

[10]  Gerhard Roth,et al.  Evolutionary Based Autocalibration from the Fundamental Matrix , 2002, EvoWorkshops.