Calibration method for an omnidirectional multicamera system

Telepresence systems using an omnidirectional image sensor enable us to experience remote site. A omnidirectional multi-camera system is more useful to acquire outdoor scenes than a monocular camera system, because the multi-camera system can easily capture high-resolution omnidirectional images. However, exact calibration of the camera system is necessary to virtualize the real world accurately. In this paper, we describe a geometric and photometric camera calibration and a panorama movie generation method for the omnidirectional multi-camera system. In the geometric calibration, intrinsic and extrinsic parameters of each camera are estimated using a calibration board and a laser measurement system called total station. In the photometric calibration, the limb darkening and color balances among the cameras are corrected. The result of the calibration is used in the panorama movie generation. In experiments, we have actually calibrated the multi-camera system and have generated spherical panorama movies by using the estimated camera parameters. A telepresence system was prototyped in order to confirm that the panorama movie can be used for telepresence well. In addition, we have evaluated the discontinuity in generated panoramic images.

[1]  Anup Basu,et al.  Line Segment Extraction in Panoramic Images , 2002, WSCG.

[2]  Naokazu Yokoya,et al.  Telepresence by Real-Time View-Dependent Image Generation from Omnidirectional Video Streams , 1998, Comput. Vis. Image Underst..

[3]  Naokazu Yokoya,et al.  Dense 3-D Reconstruction of an Outdoor Scene by Hundreds-Baseline Stereo Using a Hand-Held Video Camera , 2004, International Journal of Computer Vision.

[4]  Naokazu Yokoya,et al.  Construction of an immersive mixed environment using an omnidirectional stereo image sensor , 2000, Proceedings IEEE Workshop on Omnidirectional Vision (Cat. No.PR00704).

[5]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[6]  Masashi Baba,et al.  Photometric calibration of zoom lens systems , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[7]  H. Bakstein,et al.  Panoramic mosaicing with a 180/spl deg/ field of view lens , 2002, Proceedings of the IEEE Workshop on Omnidirectional Vision 2002. Held in conjunction with ECCV'02.