Research on Calibration Method of Multi-camera System without Overlapping Fields of View Based on SLAM

The basis of multi-camera system measurement is the calibration of the multi-camera system. Although multi-camera system calibration has achieved certain results, there are still problems such as tedious calibration process and high calibration cost. In this paper, we propose a practical calibration method for multi-camera systems without overlapping fields of view. Firstly, a global 3D model of the scene is reconstructed using Simultaneous Localization and Mapping (SLAM). Then, each camera is calibrated using the 2D-3D correspondence between the images acquired by the multi-camera system and the 3D model. Finally, the external parameters of the multi-camera system are calibrated. In the process of using SLAM to build the model, the graph optimization is used to improve the accuracy of the modeling, and the accuracy of the calibration depends on the accuracy of the modeling. After several experiments, the experimental results show that the method is feasible.

[1]  Wolfram Burgard,et al.  Robotics: Science and Systems XV , 2010 .

[2]  Ningqing Qian,et al.  Optimizing camera positions for multi-view 3D reconstruction , 2015, 2015 International Conference on 3D Imaging (IC3D).

[3]  Hui Zhao,et al.  Accurate facade feature extraction method for buildings from three-dimensional point cloud data considering structural information , 2018 .

[4]  Xianyu Su,et al.  A new approach for the bundle adjustment problem with fixed constraints in stereo vision , 2012 .

[5]  Yun Wang,et al.  Multi-camera global calibration for large-scale measurement based on plane mirror , 2015 .

[6]  Juan D. Tardós,et al.  ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras , 2016, IEEE Transactions on Robotics.

[7]  Wolfram Burgard,et al.  G2o: A general framework for graph optimization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[8]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Horst Bischof,et al.  Evaluations on multi-scale camera networks for precise and geo-accurate reconstructions from aerial and terrestrial images with user guidance , 2017, Comput. Vis. Image Underst..

[10]  Jibin Zhao,et al.  Global calibration of multi-cameras with non-overlapping fields of view based on photogrammetry and reconfigurable target , 2018 .

[11]  Zhen Liu,et al.  An external parameter calibration method for multiple cameras based on laser rangefinder , 2014 .

[12]  Torsten Sattler,et al.  3D visual perception for self-driving cars using a multi-camera system: Calibration, mapping, localization, and obstacle detection , 2017, Image Vis. Comput..