Calibration of a synchronized multi-camera setup for 3D videoconferencing

In this paper we present an efficient camera calibration workflow. Our target application is the calibration of a 3D videoconferencing setup. Nevertheless, it is also well suited for almost every small-scale environment and any number of cameras. The main contribution of this work is a novel integrated high precision pattern based calibration workflow which accounts for color channel-wise lens un-distortion, chromatic aberration correction and linear camera parameter estimation simultaneously. Moreover, our calibration workflow incorporates a convenient automatic spatial camera registration, in case the calibration pattern is not concurrently visible for all cameras.

[1]  David W. Murray,et al.  The impact of radial distortion on the self-calibration of rotating cameras , 2004, Comput. Vis. Image Underst..

[2]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[3]  Marcus A. Magnor,et al.  External Camera Calibration for Synchronized Multi-video Systems , 2004, WSCG.

[4]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Manolis I. A. Lourakis,et al.  SBA: A software package for generic sparse bundle adjustment , 2009, TOMS.

[6]  Oliver Schreer,et al.  Stereo analysis by hybrid recursive matching for real-time immersive video conferencing , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .

[8]  Peter Eisert,et al.  Parallel high resolution real-time Visual Hull on GPU , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[9]  Dean Brown,et al.  Decentering distortion of lenses , 1966 .

[10]  Olivier D. Faugeras,et al.  Automatic calibration and removal of distortion from scenes of structured environments , 1995, Optics & Photonics.

[11]  Tomás Svoboda,et al.  A Convenient Multicamera Self-Calibration for Virtual Environments , 2005, Presence: Teleoperators & Virtual Environments.

[12]  H. Opower.  Multiple view geometry in computer vision , 2002 .

[13]  Peter Eisert,et al.  3DPresence -A System Concept for Multi-User and Multi-Party Immersive 3D Videoconferencing , 2008 .

[14]  Paul F. Whelan,et al.  Precise radial un-distortion of images , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[15]  Zeyu Li,et al.  Framework for hierarchical calibration of multi-camera systems for teleimmersion , 2009, IMMERSCOM.

[16]  P. Perona,et al.  Visual methods for three-dimensional modeling , 1999 .