Complex wavelet-based image mosaics using edge-preserving visual perception modeling

Abstract This paper presents a robust panoramic image mosaics scheme in the complex wavelet domain that employs the edge-preserving visual preceptive thresholding techniques. Complex wavelet transform guarantees both the scale and translation invariance for the image alignment, which enables us to calculate the transformation based on the correspondence in the wavelet domain and its application to the original image. The transformation obtained from the wavelet images is sufficiently accurate when applied to the original images due to the scale and translation invariance. In the wavelet domain, the coefficients can be compressed significantly (50–100 : 1 ratios) through the edge-preserving visual perception modeling while the details of the structured information can be retained. The complexity of the transformation calculation on the thresholded wavelet coefficients can be significantly reduced. Moreover, the transformation can be progressively refined through the multiresolution wavelet decomposition. It results in a mosaicking scheme with a great robustness and significantly better performance compared with the traditional mosaicking techniques with no or little loss of the visual quality of the images.

[1]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[2]  A. Said,et al.  Manuscript Submitted to the Ieee Transactions on Circuits and Systems for Video Technology a New Fast and Eecient Image Codec Based on Set Partitioning in Hierarchical Trees , 2007 .

[3]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.

[4]  Richard Szeliski,et al.  Hierarchical spline-based image registration , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[5]  He-Ping Pan,et al.  General stereo image matching using symmetric complex wavelets , 1996, Optics & Photonics.

[6]  Xu Dan.  Image Mosaics Based on Complex Wavelet Decomposition , 1998 .

[7]  Julian Magarey,et al.  Motion estimation using complex wavelets , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[8]  John Snyder,et al.  Rendering with coherent layers , 1997, SIGGRAPH.

[9]  Edward H. Adelson,et al.  Layered representations for vision and video , 1995, Proceedings IEEE Workshop on Representation of Visual Scenes (In Conjunction with ICCV'95).

[10]  Richard Szeliski,et al.  Video mosaics for virtual environments , 1996, IEEE Computer Graphics and Applications.

[11]  William A. Pearlman,et al.  A new, fast, and efficient image codec based on set partitioning in hierarchical trees , 1996, IEEE Trans. Circuits Syst. Video Technol..

[12]  Dan Xu,et al.  Panoramic image mosaics via complex wavelet pyramid , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[13]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.

[14]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[15]  David J. Sakrison,et al.  The effects of a visual fidelity criterion of the encoding of images , 1974, IEEE Trans. Inf. Theory.

[16]  He-Ping Pan,et al.  Uniform Full-Information Image Matching Using Complex Conjugate Wavelet Pyramids , 1996 .

[17]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[18]  Paul Debevec,et al.  Modeling and Rendering Architecture from Photographs , 1996, SIGGRAPH 1996.

[19]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[20]  Paul Bao,et al.  Wavelet transform image coding based on visual perception modeling , 1998, Defense, Security, and Sensing.

[21]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and environment maps , 1997, SIGGRAPH.