Structure from motion for 3D object reconstruction based on local and global bundle adjustment

Structure from motion approach allows to recover both the 3D structure of the scene and the camera motion. It uses a global bundle adjustment by minimizing a non-linear criterion (often through the use of the Levenberg-Marquardt algorithm) to adjust the various entities initially estimated, which requires a long calculation time and can converge to a local solution due to a bad initialization. In this paper, we used the Structure from Motion approach for 3D object reconstruction from images taken by a single camera moving around the object. The proposed approach is based on the combination of the local bundle adjustment (LBA) and the global bundle adjustment (GBA) which is very useful to ensure effective and rapid convergence to the optimal solution. Our reconstruction system is initialized from two calibrated images. After each insertion of a new uncalibrated Image, we integrate a LBA to adjust the new estimated parameters and avoid as much as possible the accumulation of errors which can affect the system's stability. After the insertion of the last image, a GBA is performed to adjust as best as possible all the estimated entities already refined locally (3D points and camera parameters). Experimental results show the reliability and rapidity of the proposed approach compared to the classical approach.

[1]  Sunghee Choi,et al.  The power crust , 2001, SMA '01.

[2]  Reinhard Koch,et al.  Visual Modeling with a Hand-Held Camera , 2004, International Journal of Computer Vision.

[3]  J. J. Moré,et al.  Levenberg--Marquardt algorithm: implementation and theory , 1977 .

[4]  Feipeng Da,et al.  3D reconstruction of human face based on an improved seeds-growing algorithm , 2011, Machine Vision and Applications.

[5]  Khalid Satori,et al.  Multi-view passive 3D reconstruction: Comparison and evaluation of three techniques and a new method for 3D object reconstruction , 2014, 2014 International Conference on Next Generation Networks and Services (NGNS).

[6]  Abderrahim Saaidi,et al.  Incremental Multi-view 3D Reconstruction Starting from Two Images Taken by a Stereo Pair of Cameras , 2015 .

[7]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[8]  A. Laurentini,et al.  The Visual Hull Concept for Silhouette-Based Image Understanding , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Kiriakos N. Kutulakos,et al.  A Theory of Shape by Space Carving , 2000, International Journal of Computer Vision.

[10]  Alain Crouzil,et al.  Similarity measures for image matching despite occlusions in stereo vision , 2011, Pattern Recognit..

[11]  Marshall W. Bern,et al.  A new Voronoi-based surface reconstruction algorithm , 1998, SIGGRAPH.

[12]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[13]  Youfu Li,et al.  Uncalibrated Euclidean 3-D reconstruction using an active vision system , 2004, IEEE Transactions on Robotics and Automation.

[14]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.