Coupled deep auto-encoder with image edge information for image super-resolution

Image super-resolution aims to recover a fine-resolution image from one or more low-resolution image(s). In this paper, we propose a novel image super-resolution approach based on the recent development of coupled deep auto-encoder. In the training step, the vector of the local low resolution (LR) and high resolution image (HR) patches and the corresponding edge information are extracted to be the input of the autoencoder. Then we learn the intrinsic representations of LR and HR image patches by auto-encoders respectively. Then we learn their relationship by a two-layer neural network. In the test step, given a LR image patch, we can obtain the corresponding HR patch through the trained deep network efficiently and effectively. Expensive experimentation results show that the proposed algorithm generates higher-quality super-resolution image compared to other state-of-the-art methods.

[1]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[2]  Elsevier Sdol,et al.  Graphical Models and Image Processing , 2009 .

[3]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[4]  Stephen Lin,et al.  Super resolution using edge prior and single image detail synthesis , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[6]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[7]  Xiaoou Tang,et al.  Learning a Deep Convolutional Network for Image Super-Resolution , 2014, ECCV.

[8]  Hayit Greenspan,et al.  Super-Resolution in Medical Imaging , 2009, Comput. J..

[9]  Jun Yu,et al.  Coupled Deep Autoencoder for Single Image Super-Resolution , 2017, IEEE Transactions on Cybernetics.

[10]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[11]  Cao Ming-min Super Resolution Through Neighbor Embedding with Adaptive Neighbor Selection , 2015 .

[12]  Michal Irani,et al.  Motion Analysis for Image Enhancement: Resolution, Occlusion, and Transparency , 1993, J. Vis. Commun. Image Represent..

[13]  Liangpei Zhang,et al.  Classification and Extraction of Spatial Features in Urban Areas Using High-Resolution Multispectral Imagery , 2007, IEEE Geoscience and Remote Sensing Letters.

[14]  Eero P. Simoncelli,et al.  Differentiation of Discrete Multi-Dimensional Signals , 2004 .

[15]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[16]  Thomas S. Huang,et al.  Non-Local Kernel Regression for Image and Video Restoration , 2010, ECCV.