Coupled multiple dictionary learning based on edge sharpness for single-image super-resolution

In this article a new strategy for single-image super-resolution is proposed. A selective sparse coding strategy based on patch sharpness is assumed to be invariant for patch resolution. This sharpness criterion is used at training stage to classify image patches into different clusters. It is suggested that the use of coupled dictionary learning, with a mapping function can improve the representation quality. By this strategy clustered dictionaries are designed along with a mapping function for each cluster which can provide the coupling link between low-resolution and high-resolution image patches. During the reconstruction, image patch sharpness is used as a criterion for the selection of a clustered dictionary and the mapping function. The high-resolution patches are recovered by high-resolution cluster dictionary atoms and the mapping function with sparse representation coefficients from low resolution patches. The algorithm is tested over a set of benchmark images from different data sets. Peak-signal-to-noise ratio and structural-similarity-index measures indicate that the given algorithm is competitive in general with existing baseline algorithms. The proposed algorithm performs better for images with high-frequency components.

[1]  Quan Pan,et al.  Semi-coupled dictionary learning with applications to image super-resolution and photo-sketch synthesis , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Stéphane Mallat,et al.  Image modeling and enhancement via structured sparse model selection , 2010, 2010 IEEE International Conference on Image Processing.

[3]  Reinhard Klette,et al.  Sharpness and contrast measures on videos , 2015, 2015 International Conference on Image and Vision Computing New Zealand (IVCNZ).

[4]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[5]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[6]  Yiguang Chen,et al.  Single-Image Super-Resolution Reconstruction via Learned Geometric Dictionaries and Clustered Sparse Coding , 2012, IEEE Transactions on Image Processing.

[7]  Mahmoud Nazzal,et al.  Image super-resolution via sparse representation over multiple learned dictionaries based on edge sharpness , 2016, Signal Image Video Process..

[8]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.

[9]  Stéphane Mallat,et al.  Super-Resolution With Sparse Mixing Estimators , 2010, IEEE Transactions on Image Processing.

[10]  Thomas S. Huang,et al.  Coupled Dictionary Training for Image Super-Resolution , 2012, IEEE Transactions on Image Processing.

[11]  Xiaokang Yang,et al.  Learning dictionary via subspace segmentation for sparse representation , 2011, 2011 18th IEEE International Conference on Image Processing.

[12]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[13]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[14]  David S. Doermann,et al.  Sharpness estimation for document and scene images , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[15]  Harry Shum,et al.  Gradient Profile Prior and Its Applications in Image Super-Resolution and Enhancement , 2011, IEEE Transactions on Image Processing.