Straight Lines Have to Be Straight Automatic Calibration and Removal of Distortion from Scenes of Structured Environments

Most algorithms in 3D computer vision rely on the pinhole camera model because of its simplicity, whereas video optics, especially low-cost wide-angle lens, generate a lot of nonlinear distortion which can be critical. To find the distortion parameters of a camera, we use the following fundamental property: a camera follows the pinhole model if and only if the projection of every line in space onto the camera is a line. Consequently, if we find the transformation on the video image so that every line in space is viewed in the transformed image as a line, then we know how to remove the distortion from the image. The algorithm consists of first doing edge extraction on a possibly distorted video sequence, then doing polygonal approximation with a large tolerance on these edges to extract possible lines from the sequence, and then finding the parameters of our distortion model that best transform these edges to segments. Results are presented on real video images, compared with distortion calibration obtained by a full camera calibration method which uses a calibration grid.

[1]  Duane C. Brown,et al.  Close-Range Camera Calibration , 1971 .

[2]  Soren W. Henriksen,et al.  Manual of photogrammetry , 1980 .

[3]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[4]  Roger Y. Tsai,et al.  Techniques for calibration of the scale factor and image center for high accuracy 3D machine vision metrology , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[5]  Olivier Faugeras,et al.  Structure from motion using the reconstruction and reprojection technique on noisy and incorrect point matches , 1987 .

[6]  Roger Y. Tsai,et al.  Techniques for Calibration of the Scale Factor and Image Center for High Accuracy 3-D Machine Vision Metrology , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Rachid Deriche,et al.  Accurate corner detection: an analytical study , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[8]  Michael A. Penna.  Camera Calibration: A Quick and Easy Way to Determine the Scale Factor , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Paul A. Beardsley,et al.  Camera Calibration Using Multiple Images , 1992, ECCV.

[10]  Philip H. S. Torr,et al.  Statistical detection of independent movement from a moving camera , 1993, Image Vis. Comput..

[11]  Rachid Deriche,et al.  From Noisy Edge Points to 3D Reconstruction of a Scene: A Robust Approach and its Uncertainty Analysis , 1992 .

[12]  O. D. Faugeras,et al.  Camera Self-Calibration: Theory and Experiments , 1992, ECCV.

[13]  Paul R. Cohen,et al.  Camera Calibration with Distortion Models and Accuracy Evaluation , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  H.A. Beyer,et al.  Accurate calibration of CCD-cameras , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  R. Deriche.  Recursively Implementing the Gaussian and its Derivatives , 1993 .

[16]  Gideon P. Stein.  Internal Camera Calibration using Rotation and Geometric Shapes , 1993 .

[17]  Pascal Brand,et al.  Distorsion optique : correction dans un modèle projectif , 1994 .

[18]  Richard I. Hartley,et al.  Projective Reconstruction and Invariants from Multiple Images , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Richard I. Hartley.  Self-Calibration from Multiple Views with a Rotating Camera , 1994, ECCV.

[20]  Gideon P. Stein.  Accurate internal camera calibration using rotation, with analysis of sources of error , 1995, Proceedings of IEEE International Conference on Computer Vision.

[21]  Frederic Devernay.  A Non-Maxima Suppression Method for Edge Detection with Sub-Pixel Accuracy , 1995 .

[22]  Rachid Deriche,et al.  A Robust Technique for Matching two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry , 1995, Artif. Intell..

[23]  Anup Basu,et al.  Alternative models for fish-eye lenses , 1995, Pattern Recognit. Lett..

[24]  Zhengyou Zhang,et al.  On the epipolar geometry between two images with lens distortion , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[25]  K. Kanatani.  Automatic Singularity Test for Motion Analysis by an Information Criterion , 1995, ECCV.

[26]  Jake K. Aggarwal,et al.  Intrinsic parameter calibration procedure for a (high-distortion) fish-eye lens camera with distortion model and accuracy estimation , 1996, Pattern Recognit..