Fast and Easy 3D Reconstruction with the Help of Geometric Constraints and Genetic Algorithms

The purpose of the work presented in this paper is to describe new method of 3D reconstruction from one or more uncalibrated images. This method is based on two important concepts: geometric constraints and genetic algorithms (GAs). At first, we are going to discuss the combination between bundle adjustment and GAs that we have proposed in order to improve 3D reconstruction efficiency and success. We used GAs in order to improve fitness quality of initial values that are used in the optimization problem. It will increase surely convergence rate. Extracted geometric constraints are used first to obtain an estimated value of focal length that helps us in the initialization step. Matching homologous points and constraints is used to estimate the 3D model. In fact, our new method gives us a lot of advantages: reducing the estimated parameter number in optimization step, decreasing used image number, winning time and stabilizing good quality of 3D results. At the end, without any prior information about our 3D scene, we obtain an accurate calibration of the cameras, and a realistic 3D model that strictly respects the geometric constraints defined before in an easy way. Various data and examples will be used to highlight the efficiency and competitiveness of our present approach.Graphical Abstract

[1]  Yi-Ping Hung,et al.  New calibration-free approach for augmented reality based on parameterized cuboid structure , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[2]  Larry S. Davis,et al.  Model-based object pose in 25 lines of code , 1992, International Journal of Computer Vision.

[3]  Hao Lv,et al.  Sketch-based 3-D modeling for piecewise planar objects in single images , 2015, Comput. Graph..

[4]  Peter F. Sturm,et al.  Using geometric constraints through parallelepipeds for calibration and 3D modeling , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  David Coley,et al.  Introduction to Genetic Algorithms for Scientists and Engineers , 1999 .

[6]  Richard Szeliski,et al.  Geometrically Constrained Structure from Motion: Points on Planes , 1998, SMILE.

[7]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[8]  Khalid Satori,et al.  Enhancement of 3D reconstruction process in terms of beautification and efficiency using geometric constraints , 2015, 2015 Intelligent Systems and Computer Vision (ISCV).

[9]  Gunnar Sparr,et al.  Euclidean and Affine Structure/Motion for Uncalibrated Cameras from Affine Shape and Subsidiary Information , 1998, SMILE.

[10]  Martial Hebert,et al.  Iterative projective reconstruction from multiple views , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[11]  David B. Fogel An introduction to genetic algorithms: Melanie Mitchell. MIT Press, Cambridge MA, 1996. $30.00 (cloth), 270 pp , 1997 .

[12]  Didier Bondyfalat,et al.  Imposing Euclidean Constraints During Self-Calibration Processes , 1998, SMILE.

[13]  Alden H. Wright,et al.  Genetic Algorithms for Real Parameter Optimization , 1990, FOGA.

[14]  Edmond Boyer,et al.  Camera calibration and 3D reconstruction from single images using parallelepipeds , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[15]  Long Quan,et al.  Image-based rendering by joint view triangulation , 2003, IEEE Trans. Circuits Syst. Video Technol..

[16]  Michael G. Strintzis,et al.  3D reconstruction of indoor and outdoor building scenes from a single image , 2010, SMVC '10.

[17]  Kenneth Alan De Jong,et al.  An analysis of the behavior of a class of genetic adaptive systems. , 1975 .

[18]  Michael O'Neill,et al.  Riccardo Poli, William B. Langdon, Nicholas F. McPhee: A Field Guide to Genetic Programming , 2009, Genetic Programming and Evolvable Machines.

[19]  Philip David,et al.  SoftPOSIT: Simultaneous Pose and Correspondence Determination , 2002, International Journal of Computer Vision.

[20]  Leif Kobbelt,et al.  Linear Analysis of Nonlinear Constraints for Interactive Geometric Modeling , 2012, Comput. Graph. Forum.

[21]  Nassir Navab,et al.  Canonical Representation and Multi-View Geometry of Cylinders , 2006, International Journal of Computer Vision.

[22]  Andrew Zisserman,et al.  New Techniques for Automated Architectural Reconstruction from Photographs , 2002, ECCV.

[23]  Andrew Zisserman,et al.  Model selection for automated reconstruction from multiple views , 2002, BMVC.

[24]  Peter F. Sturm,et al.  3D Modelling Using Geometric Constraints: A Parallelepiped Based Approach , 2002, ECCV.

[25]  Peter F. Sturm,et al.  The Analysis of Ambiguous Solutions in Linear Systems and its Application to Computer Vision , 2003, BMVC.

[26]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[27]  Michel Dhome,et al.  Bundle adjustment: a fast method with weak initialisation , 2002, BMVC.

[28]  William M. Spears,et al.  Crossover or Mutation? , 1992, FOGA.

[29]  William Sofer An Introduction to Genetic Algorithms. Melanie Mitchell , 2000 .

[30]  Abderrahim Saaidi,et al.  Reconstruction of 3D Scenes by Camera Self-Calibration and Using Genetic Algorithms , 2016 .

[31]  David E. Goldberg,et al.  Sizing Populations for Serial and Parallel Genetic Algorithms , 1989, ICGA.

[32]  Riccardo Poli,et al.  A Field Guide to Genetic Programming , 2008 .

[33]  Khalid Satori,et al.  Important approach to vanishing points detection based on simple image geometry and new accumulation space , 2016 .

[34]  John J. Grefenstette,et al.  Optimization of Control Parameters for Genetic Algorithms , 1986, IEEE Transactions on Systems, Man, and Cybernetics.

[35]  Roberto Cipolla,et al.  Combining single view recognition and multiple view stereo for architectural scenes , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[36]  Reinhard Koch,et al.  Metric 3D Surface Reconstruction from Uncalibrated Image Sequences , 1998, SMILE.

[37]  Alex M. Andrew Multiple View Geometry in Computer Vision, by Richard Hartley and Andrew Zisserman, Cambridge University Press, Cambridge, 2000, xvi+607 pp., ISBN 0-521-62304-9 (hardback, £60.00) , 2001, Robotica.