Wavelet Domain Image Resolution Enhancement Methods.

Resolution enhancement of pictorial data is desirable in many applications such as monitoring, surveillance, medical imaging and remote sensing when images at desirable resolution levels are not available. It is a classic signal interpolation problem and several conventional approaches such as zero-order interpolation (sample-and-hold), bilinear and spline interpolation are widely used. However, undesirable levels of smoothing across salient edges in the higher resolution images obtained using these conventional methods resulted in a search for more effective algorithms. Recently several efforts in the field have utilised wavelet-domain methodologies with the intention of overcoming some of the problems associated with conventional treatment. In this thesis, we propose three wavelet domain image resolution enhancement algorithms. The first proposed algorithm is based on the estimation of detail wavelet coefficients at high resolution scales by exploiting the wavelet coefficient correlation in a local neighbourhood sense. The unknown detail coefficients are estimated by employing linear least-squares regression parameters of which are obtained from the quad-tree decomposition of the low-resolution image. The second algorithm starts with an initial high-resolution approximation to the original image obtained by means of zero-padding in the wavelet domain. This is further processed using the cycle spinning methodology which reduces ringing. Linear regression using a minimal training set of high-resolution originals is finally employed to rectify the degraded edges. For the third algorithm we propose a directional variant of the cycle spinning methodology with an aim of reducing the over-smoothing of salient image features as well as offering a reduction in computational complexity. In particular we take into account local edge orientation information derived from a wavelet decomposition of the available low resolution image to influence key parameters of the cycle spinning algorithm. Our results show that the proposed methods are considerably superior to conventional image interpolation techniques, both in objective and subjective terms, while also comparing favourably with competing methods.

[1]  Raymond H. Chan,et al.  Wavelet Algorithms for High-Resolution Image Reconstruction , 2002, SIAM J. Sci. Comput..

[2]  Alptekin Temizel,et al.  Wavelet domain image resolution enhancement , 2006 .

[3]  Ruey-Feng Chang,et al.  MLP interpolation for digital image processing using wavelet transform , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[4]  Hyun Wook Park,et al.  Design and analysis of an image resizing filter in the block-DCT domain , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Guoliang Fan,et al.  Model-based edge reconstruction for low bit-rate wavelet-compressed images , 2000, IEEE Trans. Circuits Syst. Video Technol..

[6]  David Suter,et al.  Shift-invariant wavelet denoising using interscale dependency , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[7]  Eero P. Simoncelli Modeling the joint statistics of images in the wavelet domain , 1999, Optics & Photonics.

[8]  Luigi Cinque,et al.  Improvements to image magnification , 2002, Pattern Recognit..

[9]  Hwang Soo Lee,et al.  Adaptive image interpolation based on local gradient features , 2004, IEEE Signal Process. Lett..

[10]  Rabab Kreidieh Ward,et al.  A contour-preserving image interpolation method , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[11]  R. Keys Cubic convolution interpolation for digital image processing , 1981 .

[12]  Thierry Blu,et al.  Linear interpolation revitalized , 2004, IEEE Transactions on Image Processing.

[13]  Arnaud E. Jacquin,et al.  Image coding based on a fractal theory of iterated contractive image transformations , 1992, IEEE Trans. Image Process..

[14]  Bryan S. Morse,et al.  Image magnification using level-set reconstruction , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[15]  M. Unser SPLINES : A PERFECT FIT FOR SIGNAL / IMAGE PROCESSING , 1999 .

[16]  Hao Jiang,et al.  A new direction adaptive scheme for image interpolation , 2002, Proceedings. International Conference on Image Processing.

[17]  Yuk-Hee Chan,et al.  Image enlargement using fractal , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[18]  Bryan S. Morse,et al.  Isophote-based interpolation , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[19]  Kannan Ramchandran,et al.  Wavelet denoising by recursive cycle spinning , 2002, Proceedings. International Conference on Image Processing.

[20]  Stéphane Mallat,et al.  Singularity detection and processing with wavelets , 1992, IEEE Trans. Inf. Theory.

[21]  Narendra Ahuja,et al.  A fast scheme for image size change in the compressed domain , 2001, IEEE Trans. Circuits Syst. Video Technol..

[22]  Jae Lim,et al.  Spatial interpolation of interlaced television pictures , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[23]  Alptekin Temizel,et al.  Image resolution upscaling in the wavelet domain using directional cycle spinning , 2005, J. Electronic Imaging.

[24]  Alptekin Temizel,et al.  Wavelet domain image resolution enhancement using cycle spinning and edge modelling , 2005, 2005 13th European Signal Processing Conference.

[25]  D. Donoho,et al.  Translation-Invariant DeNoising , 1995 .

[26]  Thomas W. Parks,et al.  Image interpolation using wavelet based hidden Markov trees , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[27]  Robert L. Stevenson,et al.  Extraction of high-resolution frames from video sequences , 1996, IEEE Trans. Image Process..

[28]  Philip J. Willis,et al.  Image Interpolation by Pixel‐Level Data‐Dependent Triangulation , 2004, Comput. Graph. Forum.

[29]  Stephen A. Martucci,et al.  Symmetric convolution and the discrete sine and cosine transforms , 1993, IEEE Trans. Signal Process..

[30]  Sanjit K. Mitra,et al.  Image resizing in the compressed domain using subband DCT , 2002, IEEE Trans. Circuits Syst. Video Technol..

[31]  C.-C. Jay Kuo,et al.  Review of Postprocessing Techniques for Compression Artifact Removal , 1998, J. Vis. Commun. Image Represent..

[32]  Frédéric Truchetet,et al.  Image magnification using decimated orthogonal wavelet transform , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[33]  Thomas W. Parks,et al.  Adaptive, optimal-recovery image interpolation , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[34]  Peyman Milanfar,et al.  An efficient wavelet-based algorithm for image superresolution , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[35]  Narendra Ahuja,et al.  POCS based adaptive image magnification , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[36]  Dimitris Anastassiou,et al.  Subpixel edge localization and the interpolation of still images , 1995, IEEE Trans. Image Process..

[37]  Michael Unser,et al.  Image interpolation and resampling , 2000 .

[38]  Mikio Takagi,et al.  High-quality image magnification applying the gerchberg-papoulis iterative algorithm with DCT , 1994, Systems and Computers in Japan.

[39]  P.J.L. van Beek,et al.  Edge-Based Image Representation and Coding , 1995 .

[40]  Thomas W. Sederberg,et al.  Image Reconstruction Using Data-Dependent Triangulation , 2001, IEEE Computer Graphics and Applications.

[41]  Hsieh Hou,et al.  Cubic splines for image interpolation and digital filtering , 1978 .

[42]  Sanjit K. Mitra,et al.  EDGE-ENHANCED IMAGE ZOOMING , 1996 .

[43]  Hyun Wook Park,et al.  L=M -Fold Image Resizing in Block-DCT Domain Using Symmetric Convolution , 2001 .

[44]  R. Macedonia,et al.  APPLICATION OF MULTIRESOLUTIONAL BASIS FITTING RECONSTRUCTION IN IMAGE MAGNIFYING , 2001 .

[45]  B. Ayazifar,et al.  PEL-adaptive model-based interpolation of spatially subsampled images , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[46]  Ping Wah Wong,et al.  Edge-directed interpolation , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[47]  邱睿 Adobe公司的又一次飞跃——Photoshop CS浮出水面 , 2003 .

[48]  Jin-Jang Leou,et al.  An adaptive image interpolation algorithm for image/video processing , 2001, Pattern Recognit..

[49]  Thomas W. Parks,et al.  Adaptively quadratic (AQua) image interpolation , 2004, IEEE Transactions on Image Processing.

[50]  Thomas W. Parks,et al.  NEW IMAGE INTERPOLATION TECHNIQUES , 2022 .

[51]  S.A. Martucci Image resizing in the discrete cosine transform domain , 1995, Proceedings., International Conference on Image Processing.

[52]  T. Chan,et al.  Edge-preserving and scale-dependent properties of total variation regularization , 2003 .

[53]  Jerome M. Shapiro,et al.  Embedded image coding using zerotrees of wavelet coefficients , 1993, IEEE Trans. Signal Process..

[54]  Aria Nosratinia Postprocessing of JPEG-2000 images to remove compression artifacts , 2003, IEEE Signal Processing Letters.

[55]  Lee-Sup Kim,et al.  Winscale: an image-scaling algorithm using an area pixel model , 2003, IEEE Trans. Circuits Syst. Video Technol..

[56]  Jan P. Allebach,et al.  Optimal image scaling using pixel classification , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[57]  Sebastiano Battiato,et al.  A locally adaptive zooming algorithm for digital images , 2002, Image Vis. Comput..

[58]  Martin Vetterli,et al.  Resolution enhancement of images using wavelet transform extrema extrapolation , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[59]  Alptekin Temizel,et al.  Wavelet domain image resolution enhancement using cycle-spinning , 2005 .

[60]  Thomas S. Huang,et al.  Resolution enhancement of images using fractal coding , 1997, Electronic Imaging.

[61]  D. M. Etter,et al.  Wavelet basis reconstruction of nonuniformly sampled data , 1998 .

[62]  Takeo Kanade,et al.  Limits on super-resolution and how to break them , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[63]  Miki Haseyama,et al.  Fractal interpolation for natural images , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[64]  S. Rippa,et al.  Data Dependent Triangulations for Piecewise Linear Interpolation , 1990 .

[65]  Hua Han,et al.  Wavelet-domain HMT-based image super-resolution , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[66]  Sheila S. Hemami,et al.  Regularity-preserving image interpolation , 1999, IEEE Trans. Image Process..

[67]  Robert L. Stevenson,et al.  A Bayesian approach to image expansion for improved definitio , 1994, IEEE Trans. Image Process..

[68]  Il Kyu Eom,et al.  Image interpolation based on inter-scale dependency in wavelet domain , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[69]  Image interpolation based on universal hidden Markov tree model , 2004, Proceedings 7th International Conference on Signal Processing, 2004. Proceedings. ICSP '04. 2004..

[70]  Kwan Pyo Hong Kwan Pyo Hong,et al.  An edge-preserving image interpolation system for a digital camcorder , 1996, 1996. Digest of Technical Papers., International Conference on Consumer Electronics.

[71]  A. W. M. van den Enden,et al.  Discrete Time Signal Processing , 1989 .

[72]  Eric Dubois,et al.  Image up-sampling using total-variation regularization with a new observation model , 2005, IEEE Transactions on Image Processing.

[73]  William A. Pearlman,et al.  A new, fast, and efficient image codec based on set partitioning in hierarchical trees , 1996, IEEE Trans. Circuits Syst. Video Technol..

[74]  Brendt Wohlberg,et al.  A review of the fractal image coding literature , 1999, IEEE Trans. Image Process..

[75]  Russell M. Mersereau,et al.  A new method for directional image interpolation , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[76]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[77]  Thomas W. Parks,et al.  Optimal recovery approach to image interpolation , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).