A Novel Method for Geometric Correction of Multi-cameras in Panoramic Video System

This paper describes a novel method based on self-adaptive subdivision mesh for geometry correction of multi-cameras in a panoramic video system. The system hardware consists of an array of six board cameras pointing outwardly. Digitally combining synchronized frames from each camera, a wide-field panoramic video can be created. Using sparse initial corresponding points between the ideal target surface and camera image, the proposed method can subdivide the grid into a dense one in arbitrary precision. Hence, the bijection between camera image and projection surface can be established in pixel level. This mapping can be used to warp a camera image to ideal panorama surface. The method is robust to lens distortion and camera relative position, and can seamlessly integrate with image matting processing. With the GPU processing, the real time frame rate panoramic video can be available. The experiment proves the effectiveness and simpleness of the method.

[1]  K. Niski,et al.  Registration Techniques for Using Imperfect and Partially Calibrated Devices in Planar Multi-Projector Displays , 2007, IEEE Transactions on Visualization and Computer Graphics.

[2]  W. Brent Seales,et al.  Immersive teleconferencing: a new algorithm to generate seamless panoramic video imagery , 1999, MULTIMEDIA '99.

[3]  Richard Szeliski,et al.  Systems and Experiment Paper: Construction of Panoramic Image Mosaics with Global and Local Alignment , 2000, International Journal of Computer Vision.

[4]  MajumderAditi,et al.  Registration Techniques for Using Imperfect and Partially Calibrated Devices in Planar Multi-Projector Displays , 2007 .

[5]  Matthew A. Brown,et al.  Recognising panoramas , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[6]  Jianhua Wang,et al.  A new calibration model of camera lens distortion , 2008, Pattern Recognit..

[7]  Richard Szeliski,et al.  Construction of Panoramic Image Mosaics with Global and Local Alignment , 2001 .

[8]  Ulrich Neumann,et al.  Immersive panoramic video , 2000, ACM Multimedia.

[9]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[10]  H.-G. Maas,et al.  COMBINED BUNDLE ADJUSTMENT OF PANORAMIC AND CENTRAL PERSPECTIVE IMAGES , 2005 .

[11]  Don Kimber,et al.  FlyCam: practical panoramic video and automatic camera control , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[12]  Xiaofeng Li,et al.  Geometric Calibration of Projector Imagery on Curved Screen Based-on Subdivision Mesh , 2008, GMP.

[13]  Thomas Sikora,et al.  Recent developments in panoramic image generation and sprite coding , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[14]  Aly A. Farag,et al.  Nonmetric lens distortion calibration: closed-form solutions, robust estimation and model selection , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.