Combining Multi-view Stereo and Bundle Adjustment for Accurate Camera Calibration

This article presents an algorithm to achieve accurate camera calibration for 3D reconstruction/visualization systems observing static scenes. The advent of high-resolution digital cameras, and sophisticated 3D reconstruction algorithms such as multi-view stereo offer the promise of unprecedented geometric fidelity in image-based modeling tasks, but it also puts unprecedented demands on camera calibration to fulfill these promises. Camera calibration is an essential step of most such systems involving multiple cameras. While there exist several standard procedure for the task, it is not easy to ensure accurate calibration. In this article, we talk about existing popular camera calibration procedure together with their problems and potential sources of errors, then provide a solution to these problems with an algorithm that produces accurate camera calibration starting from an initial guess possibly containing some errors. More concretely, the algorithm uses a multi-view stereo system on scaled-down input images to reconstruct rough 3D geometry of a scene from initial camera parameters, which is used to effectively guide the search for additional image correspondences. A standard bundle-adjustment algorithm is used with the obtained image correspondences to tighten-up camera calibration. The proposed method has been tested on various real datasets to prove its effectiveness.

[1]  Larry S. Davis,et al.  3D Surface Reconstruction Using Graph Cuts with Surface Constraints , 2006, ECCV.

[2]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[3]  Michel Dhome,et al.  Do We Really Need an Accurate Calibration Pattern to Achieve a Reliable Camera Calibration? , 1998, ECCV.

[4]  Bill Triggs,et al.  Autocalibration and the absolute quadric , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Tomás Pajdla,et al.  Robust Rotation and Translation Estimation in Multiview Reconstruction , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Reinhard Koch,et al.  Visual Modeling with a Hand-Held Camera , 2004, International Journal of Computer Vision.

[7]  Roberto Cipolla,et al.  Silhouette Coherence for Camera Calibration under Circular Motion , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Jean Ponce,et al.  Carved Visual Hulls for Image-Based Modeling , 2006, ECCV.

[9]  Francis Schmitt,et al.  Silhouette and stereo fusion for 3D object modeling , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[10]  Bruce G. Baumgart,et al.  Geometric modeling for computer vision. , 1974 .

[11]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Pascal Fua,et al.  Regularized Bundle-Adjustment to Model Heads from Image Sequences without Calibration Data , 2000, International Journal of Computer Vision.

[13]  Edmond Boyer,et al.  Exact polyhedral visual hulls , 2003, BMVC.

[14]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[15]  Roberto Cipolla,et al.  Reconstruction of sculpture from its profiles with unknown camera positions , 2004, IEEE Transactions on Image Processing.

[16]  Marc Pollefeys,et al.  Multi-view reconstruction using photo-consistency and exact silhouette constraints: a maximum-flow formulation , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[17]  V. Uffenkamp State of the Art of High Precision Industrial Photogrammetry , 1993 .

[18]  Richard Szeliski,et al.  Vision Algorithms: Theory and Practice , 2002, Lecture Notes in Computer Science.

[19]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[20]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[21]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..