Wand-based Multiple Camera Studio Calibration

To meet the demands of the many emerging multiple camera studio systems in entertainment content production, a novel wand-based system is presented for calibration of both intrinsic (focal length,lens distortion) and extrinsic (position, orientation) parameters of multiple cameras. Full metric calibration is obtained solely from observations of a wand comprising two visible markers at a known fixed distance. It is not necessary for all cameras to see the wand simultaneously, cameras may face each other, and have non-overlapping fields of view. High accuracy is achieved by using iterative bundle adjustment of tracked feature points across multiple views to refine calibration parameters until re-projection errors are minimised over the required measurement volume. The approach involves a new automatic initialisation procedure and novel application of bundle adjustment to refine calibration estimates. Evaluation of wand-calibration is performed using an eight-camera system. Results demonstrate a reprojection error of approximately 0.5 pixels rms and 3D reconstruction error of less than 2mm rms for a capture volume of 2x3x2m. Advantages of wand-based calibration over conventional chart-based calibration include time-efficient calibration of multiple camera systems and calibration of camera configurations without all cameras having to view the same objects or having overlapping fields of view.

[1]  J. J. Moré,et al.  Levenberg--Marquardt algorithm: implementation and theory , 1977 .

[2]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[3]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[4]  Janne Heikkilä,et al.  A four-step camera calibration procedure with implicit image correction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  R. Hartley.  Extraction of Focal Lengths from the Fundamental Matrix , 2001 .

[6]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[7]  Olivier D. Faugeras,et al.  Camera Calibration, Scene Motion and Structure recovery from point correspondences and fundamental m , 1997 .

[8]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[9]  Thomas S. Huang,et al.  Motion and Structure from Image Sequences , 1992 .

[10]  Hans-Gerd Maas,et al.  Dynamic photogrammetric calibration of industrial robots , 1997, Optics & Photonics.

[11]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[12]  Richard I. Hartley,et al.  Estimation of Relative Camera Positions for Uncalibrated Cameras , 1992, ECCV.

[13]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[14]  Zhengyou Zhang,et al.  Determining the Epipolar Geometry and its Uncertainty: A Review , 1998, International Journal of Computer Vision.

[15]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[16]  Joel R. Mitchelson.  Multiple-camera studio methods for automated measurement of human motion , 2003 .

[17]  Zhengyou Zhang,et al.  Camera calibration with one-dimensional objects , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  O. D. Faugeras,et al.  Camera Self-Calibration: Theory and Experiments , 1992, ECCV.

[19]  Martial Hebert,et al.  Provably-convergent iterative methods for projective structure from motion , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[20]  William H. Press,et al.  The Art of Scientific Computing Second Edition , 1998 .

[21]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Peter F. Sturm,et al.  A Factorization Based Algorithm for Multi-Image Projective Structure and Motion , 1996, ECCV.

[23]  Tomáš Svoboda.  Quick Guide to Multi-Camera Self-Calibration , 2003 .

[24]  Zhengyou Zhang.  Camera Calibration with One-Dimensional Objects , 2002, ECCV.

[25]  Tunc Geveci,et al.  Advanced Calculus , 2014, Nature.

[26]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Daniel D. Morris,et al.  Factorization methods for structure from motion , 1998, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[28]  Y. Aloimonos,et al.  Complete calibration of a multi-camera network , 2000, Proceedings IEEE Workshop on Omnidirectional Vision (Cat. No.PR00704).

[29]  Reinhard Koch,et al.  Self-Calibration and Metric Reconstruction Inspite of Varying and Unknown Intrinsic Camera Parameters , 1999, International Journal of Computer Vision.

[30]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[31]  Reinhard Koch,et al.  Self-Calibration and Metric Reconstruction Inspite of Varying and Unknown Intrinsic Camera Parameters , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[32]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..