A Note on Geometric Calibration of Multiple Cameras and Projectors

Geometric calibration of cameras and projectors is an essential step that must be performed before any imaging system can be used. There are many well-known geometric calibration methods for calibrating systems comprised of multiple cameras, but simultaneous geometric calibration of multiple projectors and cameras has received less attention. This leaves unresolved several practical issues which must be considered to achieve the simplicity of use required for real world applications. In this work we discuss several important components of a real-world geometric calibration procedure used in our laboratory to calibrate surface imaging systems comprised of many projectors and cameras. We specifically discuss the design of the calibration object and the image processing pipeline used to analyze it in the acquired images. We also provide quantitative calibration results in the form of reprojection errors and compare them to the classic approaches such as Zhang’s calibration method.

[1]  Q. Guan,et al.  A Multiple View Self-Calibration and Metric Reconstruction Method for Structured Light System , 2010, 2010 Chinese Conference on Pattern Recognition (CCPR).

[2]  Arcangelo Distante,et al.  Camera Calibration and 3D Reconstruction , 2020 .

[3]  Aditi Majumder,et al.  Photometric Self-Calibration of a Projector-Camera System , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Xavier Armangué,et al.  A comparative review of camera calibrating methods with accuracy evaluation , 2002, Pattern Recognit..

[5]  Clive S. Fraser,et al.  Digital camera self-calibration , 1997 .

[6]  Fei Qi,et al.  Constraints on general motions for camera calibration with one-dimensional objects , 2007, Pattern Recognit..

[7]  Jake K. Aggarwal,et al.  Intrinsic parameter calibration procedure for a (high-distortion) fish-eye lens camera with distortion model and accuracy estimation , 1996, Pattern Recognit..

[8]  Mark Fiala,et al.  Automatic Projector Calibration Using Self-Identifying Patterns , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[9]  Charles K. Toth,et al.  Remote sensing platforms and sensors: A survey , 2016 .

[10]  Joung Hwan Mun,et al.  A multi-camera calibration method using a 3-axis frame and wand , 2012 .

[11]  Tomislav Petković,et al.  Multi-Projector Multi-Camera Structured Light 3D Body Scanner , 2017 .

[12]  Jason Geng,et al.  Structured-light 3D surface imaging: a tutorial , 2011 .

[13]  Tomislav Pribanić,et al.  Research activities of the Advanced Shape Reconstruction and Registration Laboratory , 2018 .

[14]  Fumiaki Tomita,et al.  Plane-based calibration algorithm for multi-camera systems via factorization of homography matrices , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[15]  Peisen S. Huang,et al.  Novel method for structured light system calibration , 2006 .

[16]  Sven Loncaric,et al.  Tiled 360° panoramic projection system , 2012, 2012 Proceedings of the 35th International Convention MIPRO.

[17]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[18]  Luc Van Gool,et al.  Automatic Interactive Calibration of Multi-Projector-Camera Systems , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[19]  Carsten Steger,et al.  An Unbiased Detector of Curvilinear Structures , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  N. Benı́tez,et al.  The Photometric Performance and Calibration of the Hubble Space Telescope Advanced Camera for Surveys , 2000, astro-ph/0507614.

[21]  Gabriel Taubin,et al.  Simple, Accurate, and Robust Projector-Camera Calibration , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[22]  Beiwen Li,et al.  Novel calibration method for structured-light system with an out-of-focus projector. , 2014, Applied optics.

[23]  Sam Van der Jeught,et al.  Real-time structured light profilometry: a review , 2016 .

[24]  Tomás Svoboda,et al.  A Convenient Multicamera Self-Calibration for Virtual Environments , 2005, Presence: Teleoperators & Virtual Environments.

[25]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[26]  C. Fraser,et al.  Sensor modelling and camera calibration for close-range photogrammetry , 2016 .

[27]  Stephen J. Maybank,et al.  On plane-based camera calibration: A general algorithm, singularities, applications , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[28]  Pietro Cerveri,et al.  Calibrating a video camera pair with a rigid bar , 2000, Pattern Recognit..

[29]  Peter F. Sturm,et al.  Efficient Separation Between Projected Patterns for Multiple Projector 3D People Scanning , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[30]  Juho Kannala,et al.  A generic camera model and calibration method for conventional, wide-angle, and fish-eye lenses , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Youping Chen,et al.  A flexible and high precision calibration method for the structured light vision system , 2016 .

[32]  Lilong Cai,et al.  A calibration method for uncoupling projector and camera of a structured light system , 2008, 2008 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[33]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[34]  B. Trubic,et al.  System for multiple projector-based tiled video playbacks , 2010, The 33rd International Convention MIPRO.

[35]  Takeo Kanade,et al.  Projector Calibration using Arbitrary Planes and Calibrated Camera , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[37]  Masatoshi Okutomi,et al.  A user-friendly method to geometrically calibrate projector-camera systems , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[38]  Tomislav Pribanić,et al.  Temporal phase unwrapping using orthographic projection , 2017 .

[39]  Hans-Peter Seidel,et al.  Markerless Motion Capture with unsynchronized moving cameras , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Tomislav Pribanić,et al.  A COMPARISON BETWEEN 2D PLATE CALIBRATION AND WAND CALIBRATION FOR 3D KINEMATIC SYSTEMS , 2009 .