Calibration of non-overlapping cameras based on a mobile robot

This paper presents a calibration framework for calibrating the pose of two cameras with non-overlapping region with the help of a mobile robot. Firstly, intrinsic parameters are calibrated separately by using camera calibration toolbox for MATLAB. To establish the position relationship between the two fixed cameras, the movement of mobile robot at two different sites is obtained for utilizing. In our model, the unknown parameters include the pose relationship between two cameras and the poses of the calibration marker, and the aim is to minimize the errors between the detected and re-projection positions of the chess-board corners. Based on least square estimation (LSE) method, we get the optimal solution. The proposed method is verified on the platform of Pioneer patrol-bot, and the results demonstrate its effectiveness, allowing the use of collaborative calibration and computing the topology of a multi-camera system.

[1]  R. Y. Tsai,et al.  An Efficient and Accurate Camera Calibration Technique for 3D Machine Vision , 1986, CVPR 1986.

[2]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Yiannis Aloimonos,et al.  Structure from Motion: Beyond the Epipolar Constraint , 2000, International Journal of Computer Vision.

[4]  Nikolaos Papanikolopoulos,et al.  Multi-camera positioning to optimize task observability , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[5]  Manuel Mazo,et al.  Multi-Camera Sensor System for 3D Segmentation and Localization of Multiple Mobile Robots , 2010, Sensors.

[6]  Jean Ponce,et al.  Accurate Camera Calibration from Multi-View Stereo and Bundle Adjustment , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Andrew W. Fitzgibbon,et al.  A rational function lens distortion model for general cameras , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[8]  Andrea Cavallaro,et al.  Multi-Camera Networks: Principles and Applications , 2009 .

[9]  Marc Pollefeys,et al.  CamOdoCal: Automatic intrinsic and extrinsic calibration of a rig with multiple generic cameras and odometry , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Takeo Kanade,et al.  Extrinsic calibration of a single line scanning lidar and a camera , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Zhanyi Hu,et al.  Self-Calibration Under the Cayley Framework , 2013, International Journal of Computer Vision.

[12]  Scott Workman,et al.  A Pot of Gold: Rainbows as a Calibration Cue , 2014, ECCV.

[13]  Mubarak Shah,et al.  Consistent Labeling of Tracked Objects in Multiple Cameras with Overlapping Fields of View , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Alex Zelinsky,et al.  Learning OpenCV---Computer Vision with the OpenCV Library (Bradski, G.R. et al.; 2008)[On the Shelf] , 2009, IEEE Robotics & Automation Magazine.

[15]  Marek Kraft,et al.  Calibration of the Multi-camera Registration System for Visual Navigation Benchmarking , 2014 .

[16]  Michel Dhome,et al.  Flexible extrinsic calibration of non-overlapping cameras using a planar mirror: Application to vision-based robotics , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Xiaogang Wang,et al.  Intelligent multi-camera video surveillance: A review , 2013, Pattern Recognit. Lett..

[18]  Jiwon Seo,et al.  Multi-UAV-based stereo vision system without GPS for ground obstacle mapping to assist path planning of UGV , 2014 .

[19]  Trevor Darrell,et al.  Simultaneous calibration and tracking with a network of non-overlapping sensors , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[20]  Ulrich Rückert,et al.  Scalable and flexible vision-based multi-robot tracking system , 2012, 2012 IEEE International Symposium on Intelligent Control.

[21]  Giulio Fontana,et al.  Rawseeds ground truth collection systems for indoor self-localization and mapping , 2009, Auton. Robots.

[22]  Tieniu Tan,et al.  Practical camera auto-calibration based on object appearance and motion for traffic scene visual surveillance , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.