Calibration of omnidirectional cameras in practice: A comparison of methods

Omnidirectional cameras are becoming increasingly popular in computer vision and robotics. Camera calibration is a step before performing any task involving metric scene measurement, required in nearly all robotics tasks. In recent years many different methods to calibrate central omnidirectional cameras have been developed, based on different camera models and often limited to a specific mirror shape. In this paper we review the existing methods designed to calibrate any central omnivision system and analyze their advantages and drawbacks doing a deep comparison using simulated and real data. We choose methods available as OpenSource and which do not require a complex pattern or scene. The evaluation protocol of calibration accuracy also considers 3D metric reconstruction combining omnidirectional images. Comparative results are shown and discussed in detail.

[1]  Pascal Vasseur,et al.  Central Catadioptric Line Detection , 2004, BMVC.

[2]  P. Sturm.  Mixing catadioptric and perspective cameras , 2002, Proceedings of the IEEE Workshop on Omnidirectional Vision 2002. Held in conjunction with ECCV'02.

[3]  Luis Puig,et al.  DLT-Like Calibration of Central Catadioptric Cameras , 2008 .

[4]  Zhanyi Hu,et al.  A new linear algorithm for calibrating central catadioptric cameras , 2008, Pattern Recognit..

[5]  Ferran Espuny,et al.  Generic Self-calibration of Central Cameras from Two Rotational Flows , 2010, International Journal of Computer Vision.

[6]  David Ryan Koes,et al.  Precise omnidirectional camera calibration , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[7]  Simone Gasparini,et al.  Camera Models and Fundamental Concepts Used in Geometric Computer Vision , 2011, Found. Trends Comput. Graph. Vis..

[8]  Andrew Zisserman,et al.  Multiple view geometry in computer visiond , 2001 .

[9]  Kostas Daniilidis,et al.  Paracatadioptric Camera Calibration , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Kostas Daniilidis,et al.  Epipolar Geometry of Central Projection Systems Using Veronese Maps , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[11]  Helder Araújo,et al.  Geometric Properties of Central Catadioptric Line Images , 2002, ECCV.

[12]  Philippe Martinet,et al.  A generic fisheye camera model for robotic applications , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Juho Kannala,et al.  A generic camera calibration method for fish-eye lenses , 2004, ICPR 2004.

[14]  Hugh F. Durrant-Whyte,et al.  Camera Calibration for Miniature, Low-cost, Wide-angle Imaging Systems , 2007, BMVC.

[15]  Roland Siegwart,et al.  A Flexible Technique for Accurate Omnidirectional Camera Calibration and Structure from Motion , 2006, Fourth IEEE International Conference on Computer Vision Systems (ICVS'06).

[16]  Shree K. Nayar,et al.  Non-metric calibration of wide-angle lenses and polycameras , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[17]  Peter F. Sturm,et al.  Plane-based calibration of central catadioptric cameras , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[18]  Shree K. Nayar,et al.  A general imaging model and a method for finding its parameters , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[19]  Helder Araújo,et al.  Issues on the geometry of central catadioptric image formation , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[20]  Vincenzo Caglioti,et al.  Single-Image Calibration of Off-Axis Catadioptric Cameras Using Lines , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[21]  Helder Araújo,et al.  Geometric properties of central catadioptric line images and their application in calibration , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Kostas Daniilidis,et al.  A Unifying Theory for Central Panoramic Systems and Practical Applications , 2000, ECCV.

[23]  Tomás Svoboda,et al.  Epipolar Geometry for Central Catadioptric Cameras , 2002, International Journal of Computer Vision.

[24]  Tomás Pajdla,et al.  Estimation of omnidirectional camera model from epipolar geometry , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[25]  Daniel G. Aliaga.  Accurate catadioptric calibration for real-time pose estimation in room-size environments , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[26]  Janne Heikkilä,et al.  A four-step camera calibration procedure with implicit image correction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[27]  Peter F. Sturm,et al.  Generic self-calibration of central cameras , 2010, Comput. Vis. Image Underst..

[28]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[29]  Hongbin Zha,et al.  Simultaneously calibrating catadioptric camera and detecting line features using Hough transform , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[30]  Kostas Daniilidis,et al.  Catadioptric camera calibration , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[31]  Tomás Pajdla,et al.  Structure from motion with wide circular field of view cameras , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Xianghua Ying,et al.  Catadioptric camera calibration using geometric invariants , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[33]  Peter F. Sturm,et al.  Towards complete generic camera calibration , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[34]  Pierre Gurdjos,et al.  A New Linear Calibration Method for Paracatadioptric Cameras , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[35]  Sing Bing Kang,et al.  Catadioptric self-calibration , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[36]  Peter F. Sturm,et al.  A Generic Concept for Camera Calibration , 2004, ECCV.

[37]  Shree K. Nayar,et al.  A Theory of Single-Viewpoint Catadioptric Image Formation , 1999, International Journal of Computer Vision.

[38]  Christian Toepfer,et al.  A Unifying Omnidirectional Camera Model and its Applications , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[39]  David Fofi,et al.  Calibration of Catadioptric Sensors by Polarization Imaging , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[40]  Fu-Chao Wu,et al.  An Easy Calibration Method for Central Catadioptric Cameras , 2007 .

[41]  Patrick Rives,et al.  Single View Point Omnidirectional Camera Calibration from Planar Grids , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[42]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[43]  Zhanyi Hu,et al.  Easy Calibration for Para-catadioptric-like Camera , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[44]  Zhanyi Hu,et al.  Geometric invariants and applications under catadioptric camera model , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[45]  Luis Puig,et al.  Calibration of Central Catadioptric Cameras Using a DLT-Like Approach , 2011, International Journal of Computer Vision.

[46]  Jiří Matas,et al.  Computer Vision - ECCV 2004 , 2004, Lecture Notes in Computer Science.