Image Resolution Enhancement via Data-Driven Parametric Models in the Wavelet Space

We present a data-driven, project-based algorithm which enhances image resolution by extrapolating high-band wavelet coefficients. High-resolution images are reconstructed by alternating the projections onto two constraint sets: the observation constraint defined by the given low-resolution image and the prior constraint derived from the training data at the high resolution (HR). Two types of prior constraints are considered: spatially homogeneous constraint suitable for texture images and patch-based inhomogeneous one for generic images. A probabilistic fusion strategy is developed for combining reconstructed HR patches when overlapping (redundancy) is present. It is argued that objective fidelity measure is important to evaluate the performance of resolution enhancement techniques and the role of antialiasing filter should be properly addressed. Experimental results are reported to show that our projection-based approach can achieve both good subjective and objective performance especially for the class of texture images.

[1]  Thomas W. Parks,et al.  Image interpolation using wavelet based hidden Markov trees , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[2]  Martin Vetterli,et al.  Resolution enhancement of images using wavelet transform extrema extrapolation , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[3]  Jeremy S. De Bonet,et al.  Multiresolution sampling procedure for analysis and synthesis of texture images , 1997, SIGGRAPH.

[4]  Sheila S. Hemami,et al.  Regularity-preserving image interpolation , 1999, IEEE Trans. Image Process..

[5]  Giovanni Ramponi,et al.  A simple edge-sensitive image interpolation filter , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[6]  Narendra Ahuja,et al.  POCS based adaptive image magnification , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[7]  S. Mallat A wavelet tour of signal processing , 1998 .

[8]  R. Mersereau,et al.  Iterative methods for image deblurring , 1990 .

[9]  Song-Chun Zhu,et al.  Filters, Random Fields and Maximum Entropy (FRAME): Towards a Unified Theory for Texture Modeling , 1998, International Journal of Computer Vision.

[10]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Harry C. Andrews,et al.  Digital Interpolation of Discrete Images , 1976, IEEE Transactions on Computers.

[12]  Michael T. Orchard,et al.  Wavelet domain image interpolation via statistical estimation , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[13]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[14]  Bernd Girod,et al.  Light field compression using disparity-compensated lifting and shape adaptation , 2006, IEEE Transactions on Image Processing.

[15]  P. L. Combettes The foundations of set theoretic estimation , 1993 .

[16]  Béla Julesz,et al.  Visual Pattern Discrimination , 1962, IRE Trans. Inf. Theory.

[17]  James R. Bergen,et al.  Pyramid-based texture analysis/synthesis , 1995, Proceedings., International Conference on Image Processing.

[18]  Pierre Moulin,et al.  Information-theoretic analysis of interscale and intrascale dependencies between image wavelet coefficients , 2001, IEEE Trans. Image Process..

[19]  Il Kyu Eom,et al.  Image interpolation based on inter-scale dependency in wavelet domain , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[20]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[21]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[22]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[23]  S. Grace Chang Image Interpolation Using Wavelet-Based Edge Enhancement and Texture Analysis , 1995 .

[24]  Dimitris Anastassiou,et al.  Subpixel edge localization and the interpolation of still images , 1995, IEEE Trans. Image Process..

[25]  Yutaka Tanaka,et al.  Image enhancement based on estimation of high resolution component using wavelet transform , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[26]  Klamer Schutte,et al.  Resolution enhancement of low-quality videos using a high-resolution frame , 2006, Electronic Imaging.

[27]  Yu-Len Huang,et al.  Wavelet-based image interpolation using multilayer perceptrons , 2005, Neural Computing & Applications.

[28]  Avideh Zakhor,et al.  Resolution enhancement of color video sequences , 1999, IEEE Trans. Image Process..

[29]  Jean-Michel Morel,et al.  An axiomatic approach to image interpolation , 1997, Proceedings of International Conference on Image Processing.

[30]  Thomas W. Parks,et al.  Prediction of image detail , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[31]  Ping Wah Wong,et al.  Edge-directed interpolation , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[32]  Harry Wechsler,et al.  Texture analysis — a survey , 1980 .