A technique for matching projective views with application to color image mosaicing

This paper presents an original coarse-to-fine technique for creating mosaics of color images related by projective transformations. The actual projective transformation is first approximated with an affine transformation whose parameters are estimated by means of an algorithm operating in the frequency domain. The projective transformation is then computed with an algorithm based on feature matching; the computational complexity of this operation is substantially reduced by the preliminary affine approximation which reduces the search area for corresponding points. A practical example of mosaicing of two color images of a planar fresco is reported and discussed. Some experimental results are also reported in order to assess the practical performance of our technique.

[1]  Shmuel Peleg,et al.  Universal mosaicing using pipe projection , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[2]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[3]  Fábio Gagliardi Cozman,et al.  Industrial applications of image mosaicing and stabilization , 1998, 1998 Second International Conference. Knowledge-Based Intelligent Electronic Systems. Proceedings KES'98 (Cat. No.98EX111).

[4]  Richard Szeliski,et al.  Image mosaicing for tele-reality applications , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[5]  Shmuel Peleg,et al.  Panoramic mosaics by manifold projection , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  M. J. D. Powell,et al.  The differential correction algorithm for rational L∞ approximation , 1971 .

[7]  Tat-Jen Cham,et al.  A statistical framework for long-range feature matching in uncalibrated image mosaicing , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[8]  Harry Shum,et al.  Construction and refinement of panoramic mosaics with global and local alignment , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[9]  Steve Mann,et al.  Video orbits of the projective group a simple approach to featureless estimation of parameters , 1997, IEEE Trans. Image Process..

[10]  Harpreet S. Sawhney,et al.  True Multi-Image Alignment and Its Application to Mosaicing and Lens Distortion Correction , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  C. Monti,et al.  Estimation of affine transformations between images pairs via Fourier transform , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[12]  Shmuel Peleg,et al.  Applying super-resolution to panoramic mosaics , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[13]  Michal Irani,et al.  Representation of scenes from collections of images , 1995, Proceedings IEEE Workshop on Representation of Visual Scenes (In Conjunction with ICCV'95).

[14]  Annick Montanvert,et al.  Image mosaicking applied to three-dimensional surfaces , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[15]  M. J. D. Powell,et al.  The Differential Correction Algorithm for Rational $\ell _\infty $-Approximation , 1972 .

[16]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and environment maps , 1997, SIGGRAPH.

[17]  Michal Irani,et al.  Video indexing based on mosaic representations , 1998, Proc. IEEE.

[18]  Andrew Zisserman,et al.  Automated mosaicing with super-resolution zoom , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[19]  Richard W. Hall,et al.  Image registration and mosaicing using a self-calibrating camera , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[20]  Richard Szeliski,et al.  Video mosaics for virtual environments , 1996, IEEE Computer Graphics and Applications.

[21]  Ioannis Pitas,et al.  Mosaicing of paintings on curved surfaces , 1996, Proceedings Third IEEE Workshop on Applications of Computer Vision. WACV'96.

[22]  Rama Chellappa,et al.  Image stabilization and mosaicking using the overlapped basis optical flow field , 1997, Proceedings of International Conference on Image Processing.

[23]  C Tomasi,et al.  Shape and motion from image streams: a factorization method. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[24]  Harpreet S. Sawhney,et al.  Model-based 2D&3D dominant motion estimation for mosaicing and video representation , 1995, Proceedings of IEEE International Conference on Computer Vision.

[25]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[26]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.