Face Image Super-Resolution via Sparse Representation and Local Texture Constraints

Recent researches have proved the efficiency of sparse representation based methods in single image super resolution (SISR) reconstruction. However, these classic methods fail to consider the image edge information and local texture details during reconstruction process, thus result in unwanted edge artifacts and local texture blurring of the reconstructed high-resolution (HR) images. In this paper, considering that the HR image and its corresponding low-resolution (LR) image share similar texture structure in corresponding positions, we propose a new SISR reconstruction method by combining sparse representation and a local texture constraint. In our method, the HR and LR image patch pairs are firstly extracted from training samples and then are used to train a HR and LR dictionary pair. Then, in code stage, we apply a local texture constraint to restrict the local texture similarity between the input LR image patches and reconstructed HR image patches. Furthermore, we introduce a global texture constraint to a global optimization model to further enhance the reconstructed image quality. Experimental results prove that the proposed method can generate sharper edges and clearer texture details than some state-of-the-art image super-resolution methods.

[1]  D. Donoho For most large underdetermined systems of linear equations the minimal 𝓁1‐norm solution is also the sparsest solution , 2006 .

[2]  Weiguo Gong,et al.  Combining sparse representation and local rank constraint for single image super resolution , 2015, Inf. Sci..

[3]  D. Donoho For most large underdetermined systems of equations, the minimal 𝓁1‐norm near‐solution approximates the sparsest near‐solution , 2006 .

[4]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[5]  Pong C. Yuen,et al.  Very low resolution face recognition problem , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[6]  Christopher M. Bishop,et al.  Bayesian Image Super-Resolution , 2002, NIPS.

[7]  F. Parmiggiani,et al.  An investigation of the textural characteristics associated with gray level cooccurrence matrix statistical parameters , 1995, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Wen Gao,et al.  Group-Based Sparse Representation for Image Restoration , 2014, IEEE Transactions on Image Processing.

[9]  Shutao Li,et al.  Sparse representation with morphologic regularizations for single image super-resolution , 2014, Signal Process..

[10]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[11]  Harry Shum,et al.  Gradient Profile Prior and Its Applications in Image Super-Resolution and Enhancement , 2011, IEEE Transactions on Image Processing.

[12]  Michal Irani,et al.  Super-resolution from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[13]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[14]  Harry Shum,et al.  A two-step approach to hallucinating faces: global parametric model and local nonparametric model , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[15]  Zongxu Pan,et al.  Super-Resolution Based on Compressive Sensing and Structural Self-Similarity for Remote Sensing Images , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Stéphane Mallat,et al.  Super-Resolution With Sparse Mixing Estimators , 2010, IEEE Transactions on Image Processing.

[17]  Xiang Ma,et al.  Sparse Support Regression for Image Super-Resolution , 2015, IEEE Photonics Journal.

[18]  Shuyuan Yang,et al.  Compressive Sampling based Single-Image Super-resolution Reconstruction by dual-sparsity and Non-local Similarity Regularizer , 2012, Pattern Recognit. Lett..

[19]  Nanning Zheng,et al.  Image hallucination with primal sketch priors , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[20]  Hsieh Hou,et al.  Cubic splines for image interpolation and digital filtering , 1978 .

[21]  Xuelong Li,et al.  Heterogeneous image transformation , 2013, Pattern Recognit. Lett..

[22]  Raanan Fattal Image upsampling via imposed edge statistics , 2007, SIGGRAPH 2007.

[23]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[24]  Junping Zhang,et al.  An Improved Super-Resolution with Manifold Learning and Histogram Matching , 2006, ICB.

[25]  Jing Li,et al.  A Simplified Method of Making Flexible Blue LEDs on a Plastic Substrate , 2015, IEEE Photonics Journal.

[26]  Takeo Kanade,et al.  Limits on Super-Resolution and How to Break Them , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  D. Yeung,et al.  Super-resolution through neighbor embedding , 2004, CVPR 2004.

[28]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.