A Unifying Model for Camera Calibration

This paper proposes a unified theory for calibrating a wide variety of camera models such as pinhole, fisheye, cata-dioptric, and multi-camera networks. We model any camera as a set of image pixels and their associated camera rays in space. Every pixel measures the light traveling along a (half-) ray in 3-space, associated with that pixel. By this definition, calibration simply refers to the computation of the mapping between pixels and the associated 3D rays. Such a mapping can be computed using images of calibration grids, which are objects with known 3D geometry, taken from unknown positions. This general camera model allows to represent non-central cameras; we also consider two special subclasses, namely central and axial cameras. In a central camera, all rays intersect in a single point, whereas the rays are completely arbitrary in a non-central one. Axial cameras are an intermediate case: the camera rays intersect a single line. In this work, we show the theory for calibrating central, axial and non-central models using calibration grids, which can be either three-dimensional or planar.

[1]  Marc Pollefeys,et al.  Multi-view geometry of 1D radial cameras and its application to omnidirectional camera calibration , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[2]  Patrick Rives,et al.  Single View Point Omnidirectional Camera Calibration from Planar Grids , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[3]  Shree K. Nayar,et al.  A theory of catadioptric image formation , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[4]  Peter F. Sturm,et al.  A generic structure-from-motion framework , 2006, Comput. Vis. Image Underst..

[5]  Helder Araújo,et al.  Calibration of Smooth Camera Models , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Helder Araújo,et al.  A simple and robust solution to the minimal general pose estimation , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Etienne Grossmann,et al.  Non-parametric self-calibration , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[8]  David Salesin,et al.  Multiperspective panoramas for cel animation , 1997, SIGGRAPH.

[9]  Ruzena Bajcsy,et al.  Catadioptric sensors that approximate wide-angle perspective projections , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[10]  Marc Pollefeys,et al.  Motion Estimation for Self-Driving Cars with a Generalized Camera , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Leonard McMillan,et al.  General Linear Cameras , 2004, ECCV.

[12]  Kostas Daniilidis,et al.  A Unifying Theory for Central Panoramic Systems and Practical Applications , 2000, ECCV.

[13]  Yiannis Aloimonos,et al.  Polydioptric camera design and 3D motion estimation , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[14]  Lior Wolf,et al.  Homography Tensors: On Algebraic Entities that Represent Three Views of Static or Moving Planar Points , 2000, ECCV.

[15]  M. Pollefeys,et al.  Radial Multi-focal Tensors Applications to Omnidirectional Camera Calibration , 2011 .

[16]  Peter F. Sturm,et al.  Multi-view geometry for general camera models , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  Aubrey K. Dunne,et al.  A Comparison of New Generic Camera Calibration with the Standard Parametric Approach , 2007, MVA.

[18]  Robert Pless,et al.  Using many cameras as one , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[19]  Daniel G. Aliaga.  Accurate catadioptric calibration for real-time pose estimation in room-size environments , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[20]  Peter F. Sturm,et al.  Towards complete generic camera calibration , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[21]  Jean Ponce.  What is a camera? , 2009, CVPR.

[22]  Francesco Orabona,et al.  Calibration from Statistical Properties of the Visual World , 2008, ECCV.

[23]  Marc Pollefeys,et al.  Radial Multi-focal Tensors , 2011, International Journal of Computer Vision.

[24]  David Nistér,et al.  A Minimal Solution to the Generalised 3-Point Pose Problem , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[25]  Aubrey K. Dunne,et al.  Efficient generic calibration method for general cameras with single centre of projection , 2010, Comput. Vis. Image Underst..

[26]  Visesh Chari,et al.  A theory of multi-layer flat refractive geometry , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Shree K. Nayar,et al.  A general imaging model and a method for finding its parameters , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[28]  An overview of non-central cameras 1 Hynek Bakstein , 2001 .

[29]  Roland Siegwart,et al.  A Toolbox for Easily Calibrating Omnidirectional Cameras , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[30]  Shree K. Nayar,et al.  A perspective on distortions , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[31]  Hongdong Li,et al.  A linear approach to motion estimation using generalized camera models , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[33]  Simone Gasparini,et al.  Camera Models and Fundamental Concepts Used in Geometric Computer Vision , 2011, Found. Trends Comput. Graph. Vis..

[34]  Marc Pollefeys,et al.  Minimal Solutions for Pose Estimation of a Multi-Camera System , 2013, ISRR.

[35]  Tomás Pajdla,et al.  Autocalibration & 3D reconstruction with non-central catadioptric cameras , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[36]  Srikumar Ramalingam,et al.  Generic Imaging Models: Calibration and 3D Reconstruction Algorithms. (Modèles de formation d'image génériques : calibrage et algorithmes de reconstruction 3D) , 2006 .

[37]  Yael Pritch,et al.  Omnistereo: Panoramic Stereo Imaging , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Andrew W. Fitzgibbon,et al.  Learning epipolar geometry from image sequences , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[39]  Tomás Pajdla.  Stereo with Oblique Cameras , 2004, International Journal of Computer Vision.

[40]  Peter F. Sturm,et al.  A Generic Concept for Camera Calibration , 2004, ECCV.

[41]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[42]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[43]  Steven M. Seitz,et al.  The Space of All Stereo Images , 2004, International Journal of Computer Vision.

[44]  Peter F. Sturm,et al.  Calibration of Cameras with Radially Symmetric Distortion , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Yuichi Taguchi,et al.  Analytical Forward Projection for Axial Non-central Dioptric and Catadioptric Cameras , 2010, ECCV.

[46]  Helder Araújo,et al.  Point-based calibration using a parametric representation of the general imaging model , 2011, 2011 International Conference on Computer Vision.

[47]  Suresh K. Lodha,et al.  A generic structure-from-motion algorithm for cross-camera scenarios , 2004 .

[48]  Daphna Weinshall,et al.  On the epipolar geometry of the Crossed-Slits projection , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[49]  E. Adelson,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[50]  Rajiv Gupta,et al.  Linear Pushbroom Cameras , 1994, ECCV.