Wide-area external multi-camera calibration using vision graphs and virtual calibration object

In this paper we address external calibration of distributed multi-camera system intended for tracking and observing. We present a robust and efficient method for wide area calibration using virtual calibration object created by two LED markers. Our algorithm does not require for all the cameras to share common volume; only pairwise overlap is required. We assume the cameras are internally calibrated prior to deployment. Calibration is performed by waiving the calibration bar over the camera coverage area. The initial pose of the cameras is calculated using essential matrix decompositions. Global calibration is solved by automatically constructing weighted vision graph and finding optimal transformation paths between the cameras. In the optimization process, we introduce novel parametrization for two-point calibration using direction normal. The results are increased accuracy and robustness of the method under the presence of noise. In the paper, we present experimental results on a synthetic and real camera setup. We have performed image noise analysis on a synthetic wide-area setup of 5 cameras. Finally, we present the results obtained on a real setup with 12 cameras. The results obtained on the real camera setup show that our approach compensates for error propagation when the path transformation includes two to three nodes. No significant difference in reprojection error was found between the cameras on non-direct and direct path of the vision graph. The mean reprojection error for the real cameras was below 0.4 pixels.

[1]  Timothy A. Clarke,et al.  Comparison of some techniques for the subpixel location of discrete target images , 1994, Other Conferences.

[2]  Thomas Rösgen,et al.  Two-step calibration of a stereo camera system for measurements in large volumes , 2003 .

[3]  Adam W. Hoover,et al.  Calibrating a camera network using a domino grid , 2001, Pattern Recognit..

[4]  Tomás Svoboda,et al.  A Convenient Multicamera Self-Calibration for Virtual Environments , 2005, Presence: Teleoperators & Virtual Environments.

[5]  J. A. Bondy,et al.  Graph Theory with Applications , 1978 .

[6]  Ruzena Bajcsy,et al.  A Framework for Constructing Real-time Immersive Environments for Training Physical Activities , 2006, J. Multim..

[7]  Hyeokho Choi,et al.  Distributed camera network localization , 2004, Conference Record of the Thirty-Eighth Asilomar Conference on Signals, Systems and Computers, 2004..

[8]  Manolis I. A. Lourakis,et al.  The design and implementation of a generic sparse bundle adjustment software package based on the Le , 2004 .

[9]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .

[10]  Maarten Vergauwen,et al.  Image-based 3D acquisition of archaeological heritage and applications , 2001, VAST '01.

[11]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[12]  Pietro Cerveri,et al.  Calibrating a video camera pair with a rigid bar , 2000, Pattern Recognit..

[13]  Marcus A. Magnor,et al.  External Camera Calibration for Synchronized Multi-video Systems , 2004, WSCG.

[14]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[15]  Zhengyou Zhang,et al.  Camera calibration with one-dimensional objects , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Zhaolin Cheng,et al.  Determining Vision Graphs for Distributed Camera Networks Using Feature Digests , 2007, EURASIP J. Adv. Signal Process..

[17]  Philipp Slusallek,et al.  Wide area camera calibration using virtual calibration objects , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[18]  Yoshihiko Nomura,et al.  Error analysis and optimization of camera calibration , 1991, Proceedings IROS '91:IEEE/RSJ International Workshop on Intelligent Robots and Systems '91.

[19]  Hong Bingrong,et al.  Novel Method for Monocular Vision Based Mobile Robot Localization , 2006, 2006 International Conference on Computational Intelligence and Security.