Extrinsic Calibration of 3D Range Finder and Camera without Auxiliary Object or Human Intervention

Fusion of heterogeneous exteroceptive sensors is the most efficient and effective way to represent the environment precisely, as it overcomes various defects of each homogeneous sensor. The rigid transformation (aka. extrinsic parameters) of heterogeneous sensory systems should be available before precisely fusing the multisensor information. Researchers have proposed several approaches to estimate the extrinsic parameters. However, these approaches require either auxiliary objects, like chessboards, or extra help from human to select correspondences. In this paper, we propose a novel extrinsic calibration approach for the extrinsic calibration of range and image sensors which has no requirement of auxiliary objects or any human intervention. In this paper, we firstly estimate the initial extrinsic parameters from the individual motion of the 3D range finder and the camera. And then extract lines in the image and point-cloud pairs and match lines by the initial extrinsic parameters. Finally, we refine the extrinsic parameters by line feature associations.

[1]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[2]  Tao Xu,et al.  Online Active Calibration for a Multi-LRF System , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[3]  Hadi Aliakbarpour,et al.  An efficient algorithm for extrinsic calibration between a 3D laser range finder and a stereo camera for surveillance , 2009, 2009 International Conference on Advanced Robotics.

[4]  Andreas Geiger,et al.  Automatic camera and range sensor calibration using a single shot , 2012, 2012 IEEE International Conference on Robotics and Automation.

[5]  Robert Pless,et al.  Extrinsic calibration of a camera and laser range finder (improves camera calibration) , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[6]  Surya P. N. Singh,et al.  V-REP: A versatile and scalable robot simulation framework , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Jack C. K. Chou,et al.  Finding the Position and Orientation of a Sensor on a Robot Manipulator Using Quaternions , 1991, Int. J. Robotics Res..

[8]  Roland Siegwart,et al.  Extrinsic self calibration of a camera and a 3D laser range finder from natural scenes , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Reinhard Koch,et al.  Calibration of a Multi-camera Rig from Non-overlapping Views , 2007, DAGM-Symposium.

[10]  Marc Pollefeys,et al.  CamOdoCal: Automatic intrinsic and extrinsic calibration of a rig with multiple generic cameras and odometry , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..

[12]  Roland Siegwart,et al.  Comparing ICP variants on real-world data sets , 2013, Auton. Robots.

[13]  Wolfram Burgard,et al.  G2o: A general framework for graph optimization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[14]  Silvio Savarese,et al.  Automatic Targetless Extrinsic Calibration of a 3D Lidar and Camera by Maximizing Mutual Information , 2012, AAAI.

[15]  Naomi S. Altman,et al.  Quantile regression , 2019, Nature Methods.

[16]  Andrew Y. Ng,et al.  Regularization and feature selection in least-squares temporal difference learning , 2009, ICML '09.

[17]  Michael Bosse,et al.  Line-based extrinsic calibration of range and image sensors , 2013, 2013 IEEE International Conference on Robotics and Automation.

[18]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  ZhangZhengyou A Flexible New Technique for Camera Calibration , 2000 .

[20]  Jun-Sik Kim,et al.  Extrinsic Calibration of 2-D Lidars Using Two Orthogonal Planes , 2016, IEEE Transactions on Robotics.

[21]  R. Siegwart,et al.  Noise characterization of depth sensors for surface inspections , 2012, 2012 2nd International Conference on Applied Robotics for the Power Industry (CARPI).

[22]  Urbano Nunes,et al.  A Minimal Solution for the Extrinsic Calibration of a Camera and a Laser-Rangefinder , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Ying Lin,et al.  3D LIDAR-Camera Extrinsic Calibration Using an Arbitrary Trihedron , 2013, Sensors.

[24]  Vincent Frémont,et al.  Extrinsic calibration between a multi-layer lidar and a camera , 2008, 2008 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[25]  V. Lepetit,et al.  EPnP: An Accurate O(n) Solution to the PnP Problem , 2009, International Journal of Computer Vision.

[26]  Cuneyt Akinlar,et al.  EDLines: A real-time line segment detector with a false detection control , 2011, Pattern Recognit. Lett..

[27]  Silvio Savarese,et al.  Extrinsic Calibration of a 3D Laser Scanner and an Omnidirectional Camera , 2010 .