Algorithms for coplanar camera calibration

Abstract. Coplanar camera calibration is the process of determining the extrinsic and intrinsic camera parameters from a given set of image and world points, when the world points lie on a two-dimensional plane. Noncoplanar calibration, on the other hand, involves world points that do not lie on a plane. While optimal solutions for both the camera-calibration procedures can be obtained by solving a set of constrained nonlinear optimization problems, there are significant structural differences between the two formulations. We investigate the computational and algorithmic implications of such underlying differences, and provide a set of efficient algorithms that are specifically tailored for the coplanar case. More specifically, we offer the following: (1) four algorithms for coplanar calibration that use linear or iterative linear methods to solve the underlying nonlinear optimization problem, and produce sub-optimal solutions. These algorithms are motivated by their computational efficiency and are useful for real-time low-cost systems. (2) Two optimal solutions for coplanar calibration, including one novel nonlinear algorithm. A constraint for the optimal estimation of extrinsic parameters is also given. (3) A Lyapunov type convergence analysis for the new nonlinear algorithm. We test the validity and performance of the calibration procedures with both synthetic and real images. The results consistently show significant improvements over less complete camera models.

[1]  Duane C. Brown,et al.  Close-Range Camera Calibration , 1971 .

[2]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[3]  John A. Richards,et al.  Remote Sensing Digital Image Analysis: An Introduction , 1999 .

[4]  T. J. Lauterborn.  American Society Of Photogrammetry , 1984 .

[5]  Maher A. Sid-Ahmed,et al.  3-D Position Sensing Using a Passive Monocular Vision System , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Stephen J. Maybank,et al.  On plane-based camera calibration: A general algorithm, singularities, applications , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[7]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[8]  Roger Y. Tsai,et al.  Techniques for Calibration of the Scale Factor and Image Center for High Accuracy 3-D Machine Vision Metrology , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  K W Wong.  MATHEMATICAL FORMULATION AND DIGITAL ANALYSIS IN CLOSE-RANGE PHOTOGRAMMETRY , 1975 .

[10]  Emanuele Trucco,et al.  Computer and Robot Vision , 1995 .

[11]  Edwin K. P. Chong,et al.  A Nonlinear Gauss-Seidel Algorithm for Noncoplanar and Coplanar Camera Calibration with Convergence Analysis , 1997, Comput. Vis. Image Underst..

[12]  Soren W. Henriksen,et al.  Manual of photogrammetry , 1980 .

[13]  Hiroshi Naruse,et al.  Simple Calibration Algorithm for High-Distortion Lens Camera , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Ali R. Bani-Hashemi.  Finding the aspect-ratio of an imaging system , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  J. Y. S. Luh,et al.  A Three-Dimensional Vision by Off-Shelf System with Multi-Cameras , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Dean Brown,et al.  Decentering distortion of lenses , 1966 .

[17]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[18]  Yoram Yakimovsky,et al.  A system for extracting three-dimensional measurements from a stereo pair of TV cameras , 1976 .

[19]  Paul R. Cohen,et al.  Camera Calibration with Distortion Models and Accuracy Evaluation , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Sundaram Ganapathy,et al.  Decomposition of transformation matrices for robot vision , 1984, Pattern Recognition Letters.

[21]  Jim Z. C. Lai.  On the sensitivity of camera calibration , 1993, Image Vis. Comput..

[22]  Lai Jim Zc.  On the sensitivity of camera calibration , 1993 .

[23]  Brian James O'Kennedy,et al.  Stereo camera calibration , 2002 .

[24]  W. Faig.  CALIBRATION OF CLOSE-RANGE PHOTOGRAMMETRIC SYSTEMS: MATHEMATICAL FORMULATION , 1975 .

[25]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Michael A. Penna.  Camera Calibration: A Quick and Easy Way to Determine the Scale Factor , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Louis A. Tamburino,et al.  A Unified Approach to the Linear Camera Calibration Problem , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Steven A. Shafer,et al.  What is the center of the image? , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Akira Ishii,et al.  A non-iterative procedure for rapid and precise camera calibration , 1994, Pattern Recognit..

[30]  WangLing-Ling,et al.  Camera Calibration by Vanishing Lines for 3-D Computer Vision , 1991 .

[31]  H.A. Beyer,et al.  Accurate calibration of CCD-cameras , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.