Wavelet domain dictionary learning-based single image superresolution

Recently sparse representations over learned dictionaries have been proven to be a very successful representation method for many image processing applications. This paper proposes a new approach for increasing the resolution from a single low-resolution image. This approach is based on learned dictionaries in the wavelet domain. The proposed method combines many desired properties of wavelet-based representations such as compactness, directionality and analysis in many scales with the flexibility of redundant sparse representations. Such an approach serves for two main purposes. First, it sparsifies the training set, and second, it allows the design of structured dictionaries. Structured dictionaries better capture intrinsic image characteristics. Furthermore, the design of multiple structured dictionaries serves to reduce the number of dictionary atoms and consequently reduces the computational complexity. Three couples of wavelet subband dictionaries are designed using the K-SVD algorithm: three for the low-resolution and three for the high-resolution wavelet subband images. The image patch size and dictionary redundancy issues are empirically investigated in this work. Extensive tests indicate that a patch size of $$6\times 6$$6×6 and a dictionary width of 216 is a good compromise between computational complexity and representation quality. The proposed algorithm is shown to be superior to the leading spatial domain sparse representation techniques both visually and quantitatively with an average PSNR increase of 1.71 dB as tested over the Kodak data set. This result is also validated in terms of SSIM as a perceptual quality metric. It is shown that the proposed approach better restores the lost high-frequency details in the three wavelet detail subbands. Furthermore, the proposed algorithm is shown to significantly reduce the dictionary learning and sparse coding computational complexity.

[1]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[2]  Pierre Vandergheynst,et al.  Fast orthogonal sparse approximation algorithms over local dictionaries , 2011, Signal Process..

[3]  Lei Zhang,et al.  Sparse Representation Based Image Interpolation With Nonlocal Autoregressive Modeling , 2013, IEEE Transactions on Image Processing.

[4]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[5]  Thomas W. Parks,et al.  Prediction of image detail , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[6]  Thomas S. Huang,et al.  Image super-resolution as sparse representation of raw image patches , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Michael Elad,et al.  On Single Image Scale-Up Using Sparse-Representations , 2010, Curves and Surfaces.

[8]  Michael Elad,et al.  A Plurality of Sparse Representations Is Better Than the Sparsest One Alone , 2009, IEEE Transactions on Information Theory.

[9]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[10]  Bhaskar D. Rao,et al.  Sparse signal reconstruction from limited data using FOCUSS: a re-weighted minimum norm algorithm , 1997, IEEE Trans. Signal Process..

[11]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[12]  Chun-Shien Lu,et al.  Dictionary learning-based distributed compressive video sensing , 2010, 28th Picture Coding Symposium.

[13]  Michael Elad,et al.  Dictionaries for Sparse Representation Modeling , 2010, Proceedings of the IEEE.

[14]  Michael Elad,et al.  From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images , 2009, SIAM Rev..

[15]  Rama Chellappa,et al.  Sparse Representations, Compressive Sensing and dictionaries for pattern recognition , 2011, The First Asian Conference on Pattern Recognition.

[16]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[17]  Guillermo Sapiro,et al.  Online dictionary learning for sparse coding , 2009, ICML '09.

[18]  Alptekin Temizel Image Resolution Enhancement using Wavelet Domain Hidden Markov Tree and Coefficient Sign Estimation , 2007, 2007 IEEE International Conference on Image Processing.

[19]  Guillermo Sapiro,et al.  Supervised Dictionary Learning , 2008, NIPS.

[20]  Michael Elad,et al.  Multi-Scale Dictionary Learning Using Wavelets , 2011, IEEE Journal of Selected Topics in Signal Processing.

[21]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[22]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.

[23]  Huimin Yu,et al.  Shape Sparse Representation for Joint Object Classification and Segmentation , 2013, IEEE Transactions on Image Processing.

[24]  Minh N. Do,et al.  Image interpolation using multiscale geometric representations , 2007, Electronic Imaging.

[25]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[26]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..