Method of 3D mesh reconstruction from sequences of calibrated images

In this paper we propose a technical mesh of an unknown 3D scene from two or more images taken by cameras having the constant parameters based on genetic algorithms. The present approach is based on the formulation of a nonlinear cost function from the determination of a relationship between points of the image planes and all parameters of the cameras. The minimization of this function by a genetic approach enables us to simultaneously estimate the intrinsic and extrinsic parameters of the cameras. These parameters are used with matching to determine the 3D point clouds. The mesh generation is performed by Delaunay triangulation. The strong point of this approach can be clearly seen in the minimization of the constraints of a self-calibration system: The use a genetic algorithm to accelerate the speed of convergence and avoid local minima to obtain a good estimation of the camera parameters and the use of a 3D scene reduces the planarity constraints. Our study is performed on real data to demonstrate the validity and performance of the presented approach in terms of accuracy, simplicity, stability, and convergence.

[1]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[2]  Steven Fortune,et al.  A sweepline algorithm for Voronoi diagrams , 1986, SCG '86.

[3]  Khalid Satori,et al.  Camera self-calibration with varying intrinsic parameters by an unknown three-dimensional scene , 2013, The Visual Computer.

[4]  Roberto Cipolla,et al.  Camera Self-Calibration from Unknown Planar Structures Enforcing the Multiview Constraints between Collineations , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Mariette Yvinec,et al.  Surface Reconstruction from Multi-View Stereo of Large-Scale Outdoor Scenes , 2010, Int. J. Virtual Real..

[6]  Pierre Gurdjos,et al.  Another Way of Looking at Plane-Based Calibration: The Centre Circle Constraint , 2002, ECCV.

[7]  Cordelia Schmid,et al.  Comparing and evaluating interest points , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[8]  Jiaoying Shi,et al.  Camera self-calibration using the geometric structure in real scenes , 2003, Proceedings Computer Graphics International 2003.

[9]  Elsayed E. Hemayed,et al.  A survey of camera self-calibration , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[10]  Michael Haller,et al.  Image Based Shadowing in Real-Time Augmented Reality , 2006, Int. J. Virtual Real..

[11]  J. Giesen,et al.  Delaunay Triangulation Based Surface Reconstruction: Ideas and Algorithms , 2004 .

[12]  Franz Aurenhammer,et al.  Voronoi diagrams—a survey of a fundamental geometric data structure , 1991, CSUR.

[13]  Khalid Satori,et al.  ROBUST METHOD FOR SELF-CALIBRATION OF CAMERAS HAVING THE VARYING INTRINSIC PARAMETERS , 2013 .

[14]  S. Sloan A fast algorithm for constructing Delaunay triangulations in the plane , 1987 .

[15]  Leif Kobbelt,et al.  Robust reconstruction of watertight 3D models from non-uniformly sampled point clouds without normal information , 2006, SGP '06.

[16]  K. Satori,et al.  A new method of camera self-calibration with varying intrinsic parameters using an improved genetic algorithm , 2013, 2013 8th International Conference on Intelligent Systems: Theories and Applications (SITA).

[17]  C. Sinthanayothin,et al.  Method of 3D mesh reconstruction from point cloud using elementary vector and geometry analysis , 2012, 2012 8th International Conference on Information Science and Digital Content Technology (ICIDT2012).

[18]  Khalid Satori,et al.  Camera self-Calibration with Varying Parameters from Two views , 2013 .

[19]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Pierre Gurdjos,et al.  Methods and geometry for plane-based self-calibration , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[21]  Sanchao Liu,et al.  Self-calibration of Varying Internal Camera Parameters Algorithm Based on Quasi-affine Reconstruction , 2012, J. Comput..

[22]  Khalid Satori,et al.  ROBUST METHOD FOR CAMERA CALIBRATION WITH VARYING PARAMETERS USING HYBRID MODIFIED GENETIC SIMPLEX ALGORITHM , 2013 .

[23]  Philip H. S. Torr,et al.  The Development and Comparison of Robust Methods for Estimating the Fundamental Matrix , 1997, International Journal of Computer Vision.

[24]  Alain Crouzil,et al.  Similarity measures for image matching despite occlusions in stereo vision , 2011, Pattern Recognit..

[25]  Steven Fortune,et al.  A sweepline algorithm for Voronoi diagrams , 1986, SCG '86.

[26]  Lionel Oisel,et al.  One-dimensional dense disparity estimation for three-dimensional reconstruction , 2003, IEEE Trans. Image Process..