Scene point constraints in camera auto-calibration: an implementational perspective

We present a scheme for incorporating scene constraints into the auto-calibration process for the structure and motion recovery problem. The steps covered by the scheme include projective factorization of the joint image measurement matrix, recovery of the absolute dual quadric, the upgrade from projective structure to its Euclidean counterpart, and incorporation of constraints from orthogonal scene planes into bundle adjustment. The focus of the paper is on the implementation details of all these steps and discussion of the various issues that arose. We have tested the scheme on both synthetic and real image data and found that it is more advantageous to incorporate into camera auto-calibration and bundle adjustment as many scene constraints as are available rather than performing auto-calibration and bundle adjustment alone.

[1]  A. Heyden,et al.  Euclidean reconstruction from constant intrinsic parameters , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[2]  Bill Triggs,et al.  Factorization methods for projective structure and motion , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[4]  Roger Mohr,et al.  It can be done without camera calibration , 1991, Pattern Recognit. Lett..

[5]  Martial Hebert,et al.  Iterative projective reconstruction from multiple views , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[6]  Anders Heyden,et al.  A Scheme for Combining Auto-calibration and Scene Constraints , 2002 .

[7]  A. Heyden,et al.  Structure and motion from lines under affine projections , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[8]  Anders Heyden,et al.  Euclidean reconstruction from image sequences with varying and unknown focal length and principal point , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Luc Van Gool,et al.  The modulus constraint: a new constraint self-calibration , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[10]  Adrien Bartoli,et al.  Three New Algorithms for Projective Bundle Adjustment with Minimum Parameters , 2001 .

[11]  Reinhard Koch,et al.  Self-Calibration and Metric Reconstruction Inspite of Varying and Unknown Intrinsic Camera Parameters , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[12]  Quang-Tuan Luong,et al.  Self-Calibration of a Moving Camera from Point Correspondences and Fundamental Matrices , 1997, International Journal of Computer Vision.

[13]  Long Quan,et al.  Conic Reconstruction and Correspondence From Two Views , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Anders Heyden.  Projective Structure and Motion from Image Sequences using Subspace Methods , 1997 .

[15]  Bill Triggs,et al.  Autocalibration and the absolute quadric , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Anders Heyden,et al.  An iterative factorization method for projective structure and motion from image sequences , 1999, Image Vis. Comput..

[17]  Philip F. McLauchlan,et al.  Gauge Independence in Optimization Algorithms for 3D Vision , 1999, Workshop on Vision Algorithms.

[18]  Andrew Zisserman,et al.  Combining scene and auto-calibration constraints , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[19]  Andrew Zisserman,et al.  Multiple view geometry in computer visiond , 2001 .

[20]  Richard I. Hartley,et al.  A linear method for reconstruction from lines and points , 1995, Proceedings of IEEE International Conference on Computer Vision.

[21]  Anders Heyden,et al.  Flexible calibration: minimal cases for auto-calibration , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[22]  Peter F. Sturm,et al.  A Factorization Based Algorithm for Multi-Image Projective Structure and Motion , 1996, ECCV.

[23]  Marc Pollefeys,et al.  Multiple view geometry , 2005 .

[24]  Takeo Kanade,et al.  Gauge fixing for accurate 3D estimation , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[25]  Philip H. S. Torr,et al.  The Development and Comparison of Robust Methods for Estimating the Fundamental Matrix , 1997, International Journal of Computer Vision.

[26]  Philip E. Gill,et al.  Practical optimization , 1981 .

[27]  Luc Van Gool,et al.  Euclidean 3D Reconstruction from Image Sequences with Variable Focal Lenghts , 1996, ECCV.

[28]  Anders Heyden,et al.  Auto-calibration via the absolute quadric and scene constraints , 2002, Object recognition supported by user interaction for service robots.

[29]  Takeo Kanade,et al.  Shape and motion from image streams under orthography: a factorization method , 1992, International Journal of Computer Vision.

[30]  Gunnar Sparr,et al.  A Common Framework for Kinetic Depth, Reconstruction and Motion for Deformable Objects , 1994, ECCV.

[31]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[32]  Rachid Deriche,et al.  A Robust Technique for Matching two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry , 1995, Artif. Intell..

[33]  Gong Rubin,et al.  3D Structure from a Single Calibrated View Using Distance Constraints , 2003 .

[34]  Gunnar Sparr,et al.  Simultaneous reconstruction of scene structure and camera locations from uncalibrated image sequences , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[35]  Richard I. Hartley,et al.  Estimation of Relative Camera Positions for Uncalibrated Cameras , 1992, ECCV.

[36]  P. McLauchlan.  Gauge invariance in projective 3D reconstruction , 1999, Proceedings IEEE Workshop on Multi-View Modeling and Analysis of Visual Scenes (MVIEW'99).

[37]  George Q. Chen,et al.  Robust point feature matching in projective space , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[38]  O. Faugeras.  Stratification of three-dimensional vision: projective, affine, and metric representations , 1995 .

[39]  Anders Heyden,et al.  Recursive structure and motion from image sequences using shape and depth spaces , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[40]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[41]  O. D. Faugeras,et al.  Camera Self-Calibration: Theory and Experiments , 1992, ECCV.

[42]  Martial Hebert,et al.  Provably-convergent iterative methods for projective structure from motion , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[43]  J. Oliensis,et al.  Fast and accurate self-calibration , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[44]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[45]  Anders Heyden,et al.  Outlier detection in video sequences under affine projection , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[46]  Gong Rubin,et al.  Quadratic Surface Reconstruction from Multiple Views Using SQP , 2003 .

[47]  Anders Heyden,et al.  Using conic correspondences in two images to estimate the epipolar geometry , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).