Direct Spherical Calibration of Omnidirectional Far Infrared Camera System

We investigate the calibration of omnidirectional (O-D) infrared (IR) camera for intelligent perception applications. Current O-D camera approaches are primarily focused on O-D color vision applications. The low-resolution O-D IR image edge boundaries are not as sharp as with color vision cameras, and as a result, the standard calibration methods were harder to use and less accurate with the low definition of the O-D IR camera. In order to more fully address O-D IR camera calibration, we propose a new calibration grid center which coordinates control point discovery methodology and a direct spherical calibration (DSC) approach for a more robust and accurate method of calibration. DSC will address the limitations of the existing methods by using the spherical coordinates of the centroid of the calibration board to directly triangulate the location of the camera center and iteratively solve the camera parameters. We compare DSC to three baseline visual calibration methodologies and augment them with additional output of the spherical results for comparison. We also look at the optimum number of calibration boards using an evolutionary algorithm and Pareto optimization to find the best method and combination of accuracy, methodology, and number of calibration boards. The benefits of DSC are both a more efficient calibration board geometry selection approach, and better accuracy than the three baseline visual calibration methodologies.

[1]  Juho Kannala,et al.  Geometric Camera Calibration , 2008, Wiley Encyclopedia of Computer Science and Engineering.

[2]  Luis Puig,et al.  Calibration of Central Catadioptric Cameras Using a DLT-Like Approach , 2011, International Journal of Computer Vision.

[3]  Roland Siegwart,et al.  A Toolbox for Easily Calibrating Omnidirectional Cameras , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Juho Kannala,et al.  A generic camera model and calibration method for conventional, wide-angle, and fish-eye lenses , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Yunhui Liu,et al.  Automatic Simultaneous Extrinsic-Odometric Calibration for Camera-Odometry System , 2018, IEEE Sensors Journal.

[6]  Xianghua Ying,et al.  Catadioptric camera calibration using geometric invariants , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[7]  Amit K. Agrawal,et al.  Single Image Calibration of Multi-axial Imaging Systems , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Marco Laumanns,et al.  A Tutorial on Evolutionary Multiobjective Optimization , 2004, Metaheuristics for Multiobjective Optimisation.

[9]  Christian Wöhler,et al.  Accurate chequerboard corner localisation for camera calibration , 2011, Pattern Recognit. Lett..

[10]  David Ryan Koes,et al.  Precise omnidirectional camera calibration , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[11]  Chu Kiong Loo,et al.  Optical approach based omnidirectional thermal visualization , 2010 .

[12]  Yuichi Motai,et al.  SmartView: hand-eye robotic calibration for active viewpoint generation and object grasping , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[13]  Roland Siegwart,et al.  A Flexible Technique for Accurate Omnidirectional Camera Calibration and Structure from Motion , 2006, Fourth IEEE International Conference on Computer Vision Systems (ICVS'06).

[14]  Zhiyong Xu,et al.  A Low-Cost Implementation of a 360° Vision Distributed Aperture System , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Andrea Bonarini,et al.  An omnidirectional vision sensor for fast tracking for mobile robots , 1999, IMTC/99. Proceedings of the 16th IEEE Instrumentation and Measurement Technology Conference (Cat. No.99CH36309).

[16]  Yuichi Motai,et al.  Dynamic 3-D Reconstruction of Human Targets via an Omni-Directional Thermal Sensor , 2018, IEEE Sensors Journal.

[17]  Peter F. Sturm,et al.  Generic self-calibration of central cameras , 2010, Comput. Vis. Image Underst..

[18]  João Pedro Barreto,et al.  A unifying geometric representation for central projection systems , 2006, Comput. Vis. Image Underst..

[19]  Helder Araújo,et al.  Geometric properties of central catadioptric line images and their application in calibration , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Éric Marchand,et al.  3D model based tracking for omnidirectional vision: A new spherical approach , 2012, Robotics Auton. Syst..

[21]  Tom Duckett,et al.  Self-localization in non-stationary environments using omni-directional vision , 2007, Robotics Auton. Syst..

[22]  Luis Puig,et al.  Calibration of omnidirectional cameras in practice: A comparison of methods , 2012, Comput. Vis. Image Underst..

[23]  Lipu Zhou,et al.  A New Minimal Solution for the Extrinsic Calibration of a 2D LIDAR and a Camera Using Three Plane-Line Correspondences , 2014, IEEE Sensors Journal.

[24]  Pascal Vasseur,et al.  Calibration of the omnidirectional vision sensor: SYCLOP , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[25]  Graeme West,et al.  The Influence of the Spatial Distribution of 2-D Features on Pose Estimation for a Visual Pipe Mapping Sensor , 2017, IEEE Sensors Journal.

[26]  Shaodi You,et al.  A Multiview Light Field Camera for Scene Depth Estimation from a Single Lens , 2016 .

[27]  Daniel Santana-Cedrés,et al.  Estimation of the Lens Distortion Model by Minimizing a Line Reprojection Error , 2017, IEEE Sensors Journal.

[28]  Patrick Garda,et al.  Multispectral omnidirectional vision sensor: design, calibration, and utilization , 2007 .

[29]  Yan Zhang,et al.  A Survey of Catadioptric Omnidirectional Camera Calibration , 2013 .

[30]  Kostas Daniilidis,et al.  Paracatadioptric Camera Calibration , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Kostas Daniilidis,et al.  Catadioptric Projective Geometry , 2001, International Journal of Computer Vision.

[32]  Nabil Aouf,et al.  Thermal Stereo Odometry for UAVs , 2015, IEEE Sensors Journal.

[33]  Shree K. Nayar,et al.  A Theory of Single-Viewpoint Catadioptric Image Formation , 1999, International Journal of Computer Vision.

[34]  Yuichi Motai,et al.  Hand–Eye Calibration Applied to Viewpoint Selection for Robotic Vision , 2008, IEEE Transactions on Industrial Electronics.

[35]  Kemper Lewis,et al.  Intuitive visualization of Pareto Frontier for multi-objective optimization in n-dimensional performance space , 2004 .

[36]  Huixian Duan,et al.  A calibration method for paracatadioptric camera from sphere images , 2012, Pattern Recognit. Lett..

[37]  Tieniu Tan,et al.  Practical Camera Calibration From Moving Objects for Traffic Scene Surveillance , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[38]  Patrick Rives,et al.  Single View Point Omnidirectional Camera Calibration from Planar Grids , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[39]  Liang Chang,et al.  Self-calibration of hybrid central catadioptric and perspective cameras , 2012, Comput. Vis. Image Underst..