Focal length and registration correction for building panorama from photographs

An approach is presented that can simultaneously correct focal length error and improve pair-wise registration for the task of panorama composition from a sequence of photographs taken from a fixed view position by a rotating camera. In building such panorama image covering a full view, a 3-parameter rotation model with a roughly estimated focal length is frequently used to relate adjacent images in the sequence. However, the pair-wise registration thus obtained may not be perfect due to the error of focal length. Whereas, accumulated errors in subsequent pairs may result in an obvious end-gap or overlap when wrapping up the images onto the viewing surface. By analyzing the relationship between focal length and panning angle parameter of the pair-wise registration model, we propose a new method that can iteratively refine both the focal length as well as the panning angles at the same time. The approach produces physically correct pair-wise registration and seamlessly closed end-gap in final panorama composition. The advantages of the method are (a) no reliance on prior camera calibration; (b) no repeat of pair-wise registration and panorama construction with the updated focal length each round, which considerably reduces the computational cost. Experiments show that our method can obtain the same visual effect as re-performing image registration, but much faster. Results of the algorithm are presented.

[1]  Frank M. Candocia Simultaneous homographic and comparametric alignment of multiple exposure-adjusted pictures of the same scene , 2003, IEEE Trans. Image Process..

[2]  Richard Szeliski,et al.  Construction of Panoramic Image Mosaics with Global and Local Alignment , 2001 .

[3]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Sing Bing Kang,et al.  Characterization of errors in compositing panoramic images , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Long Ai Building Panoramas from Photographs Taken with An Uncalibrated Hand-Held Camera , 2009 .

[6]  Harpreet S. Sawhney,et al.  Automated Mosaics via Topology Inference , 2002, IEEE Computer Graphics and Applications.

[7]  Sang Wook Lee,et al.  Multiview registration of 3D scenes by minimizing error between coordinate frames , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Radu Horaud,et al.  Motion Panoramas , 2004, Comput. Animat. Virtual Worlds.

[9]  Harpreet S. Sawhney,et al.  True Multi-Image Alignment and Its Application to Mosaicing and Lens Distortion Correction , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Hui Chen Gradient-based approach for fine registration of panorama images , 2008, Journal of Computer Science and Technology.

[11]  Radu Horaud,et al.  Motion Panoramas: Research Articles , 2004 .

[12]  Richard I. Hartley Self-Calibration from Multiple Views with a Rotating Camera , 1994, ECCV.

[13]  Hui Chen,et al.  Building Panoramas from Photographs Taken with an Uncalibrated Hand-Held Camera , 2000, VMV.