Calibration of Asynchronous Camera Networks: CALICO

Camera network and multi-camera calibration for external parameters is a necessary step for a variety of contexts in computer vision and robotics, ranging from three-dimensional reconstruction to human activity tracking. This paper describes CALICO, a method for camera network and/or multi-camera calibration suitable for challenging contexts: the cameras may not share a common field of view and the network may be asynchronous. The calibration object required is one or more rigidly attached planar calibration patterns, which are distinguishable from one another, such as aruco or charuco patterns. We formulate the camera network and/or multi-camera calibration problem using rigidity constraints, represented as a system of equations, and an approximate solution is found through a two-step process. Simulated and real experiments, including an asynchronous camera network, multicamera system, and rotating imaging system, demonstrate the method in a variety of settings. Median reconstruction accuracy error was less than $0.41$ mm$^2$ for all datasets. This method is suitable for novice users to calibrate a camera network, and the modularity of the calibration object also allows for disassembly, shipping, and the use of this method in a variety of large and small spaces.

[1]  Mili Shah,et al.  Solving the Robot-World/Hand-Eye Calibration Problem Using the Kronecker Product , 2013 .

[2]  Xiuzhen Huang,et al.  Novel Low Cost 3D Surface Model Reconstruction System for Plant Phenotyping , 2017, J. Imaging.

[3]  Hanno Scharr,et al.  Fast High Resolution Volume Carving for 3D Plant Shoot Reconstruction , 2017, Front. Plant Sci..

[4]  P. Cerveri,et al.  A fast method for calibrating video-based motion analysers using only a rigid bar , 2006, Medical and Biological Engineering and Computing.

[5]  Gordon Dobie,et al.  Spatial calibration of large volume photogrammetry based metrology systems , 2015 .

[6]  Esa Rahtu,et al.  Relative Camera Pose Estimation Using Convolutional Neural Networks , 2017, ACIVS.

[7]  Henry Medeiros,et al.  A robotic vision system to measure tree traits , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[8]  Francisco José Madrid-Cuevas,et al.  Automatic generation and detection of highly reliable fiducial markers under occlusion , 2014, Pattern Recognit..

[9]  Y. Aloimonos,et al.  Complete calibration of a multi-camera network , 2000, Proceedings IEEE Workshop on Omnidirectional Vision (Cat. No.PR00704).

[10]  Emanuele Menegatti,et al.  General Hand–Eye Calibration Based on Reprojection Error Minimization , 2019, IEEE Robotics and Automation Letters.

[11]  A. Cappozzo,et al.  Human movement analysis using stereophotogrammetry. Part 2: instrumental errors. , 2004, Gait & posture.

[12]  Steve Marschner,et al.  Caliber: Camera Localization and Calibration Using Rigidity Constraints , 2016, International Journal of Computer Vision.

[13]  Amy Tabb,et al.  Shape from Silhouette Probability Maps: Reconstruction of Thin Objects in the Presence of Silhouette Extraction and Calibration Error , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Volkan Isler,et al.  Tree Morphology for Phenotyping from Semantics-Based Mapping in Orchard Environments , 2018, ArXiv.

[15]  Xiaoping Lou,et al.  Simultaneous Robot–World and Hand–Eye Calibration without a Calibration Object , 2018, Sensors.

[16]  Khalil M. Ahmad Yousef,et al.  Solving the robot-world hand-eye(s) calibration problem with iterative methods , 2017, Machine Vision and Applications.

[17]  B. A Cook ACRONYM: Acronym CReatiON for You and Me , 2019 .

[18]  Timnit Gebru,et al.  Datasheets for datasets , 2018, Commun. ACM.

[19]  Valentin Peretroukhin,et al.  DPC-Net: Deep Pose Correction for Visual Localization , 2017, IEEE Robotics and Automation Letters.

[20]  Khalil Mustafa Ahmad Yousef,et al.  Parameterizations for reducing camera reprojection error for robot-world hand-eye calibration , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[21]  Carlos Hernandez,et al.  Multi-View Stereo: A Tutorial , 2015, Found. Trends Comput. Graph. Vis..

[22]  Jan-Michael Frahm,et al.  Structure-from-Motion Revisited , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Mili Shah Comparing two sets of corresponding six degree of freedom data , 2011, Comput. Vis. Image Underst..

[25]  Roberto Cipolla,et al.  Geometric Loss Functions for Camera Pose Regression with Deep Learning , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[27]  Takeo Kanade,et al.  Panoptic Studio: A Massively Multiview System for Social Interaction Capture , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.