Image Super-Resolution Reconstruction Based on Multi-scale Convolutional Neural Network

For image super-resolution based on convolutional neural network, there are many problems such as large amount of calculation, many parameters, and unresolved images. This paper proposes an image super-resolution reconstruction algorithm based on multi-scale convolutional neural network. The multi-scale convolution kernel method is introduced into convolutional neural networks. Multi-scale feature extraction is achieved for different sizes of convolutional layers, at the same time, the learning parameters are improved and the network parameters are reduced. Maxout is used as an activation function to introduce competing elements. At the same time, the Skip Connection in the residual network is added to the network model to accelerate the training of deep neural networks. Experiments show that the subjective visual and objective evaluation of this algorithm has been improved to a certain extent. The edge effect of the reconstructed high-resolution image is more clear when reducing the number of network parameters, and more detailed image information is recovered.

[1]  Nita D. Maheta A comparative study of image super resolution approaches , 2011, 2011 3rd International Conference on Electronics Computer Technology.

[2]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[3]  Rob Fergus,et al.  Stochastic Pooling for Regularization of Deep Convolutional Neural Networks , 2013, ICLR.

[4]  Henry Stark,et al.  Projection-based image restoration , 1992 .

[5]  Fan Guo-liang Overview on Super Resolution Image Reconstruction , 2011 .

[6]  Robert L. Stevenson,et al.  Extraction of high-resolution frames from video sequences , 1996, IEEE Trans. Image Process..

[7]  Robert L. Stevenson,et al.  Motion-compensated scan conversion of interlaced video sequences , 1996, Electronic Imaging.

[8]  Kyoung Mu Lee,et al.  Deeply-Recursive Convolutional Network for Image Super-Resolution , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  H Stark,et al.  High-resolution image recovery from image-plane arrays, using convex projections. , 1989, Journal of the Optical Society of America. A, Optics and image science.

[10]  Gholamreza Anbarjafari,et al.  Improved Iterative Back Projection for video super-resolution , 2014, 2014 22nd Signal Processing and Communications Applications Conference (SIU).

[11]  Michael Elad,et al.  Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images , 1997, IEEE Trans. Image Process..

[12]  Aggelos K. Katsaggelos,et al.  Reconstruction of a high-resolution image by simultaneous registration, restoration, and interpolation of low-resolution images , 1995, Proceedings., International Conference on Image Processing.

[13]  Seung P. Kim,et al.  High‐resolution restoration of dynamic image sequences , 1994, Int. J. Imaging Syst. Technol..

[14]  J. L. Harris,et al.  Diffraction and Resolving Power , 1964 .

[15]  Russell C. Hardie,et al.  Joint MAP registration and high-resolution image estimation using a sequence of undersampled images , 1997, IEEE Trans. Image Process..

[16]  J. Goodman Introduction to Fourier optics , 1969 .

[17]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[18]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Mei Han,et al.  Bilateral Back-Projection for Single Image Super Resolution , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[20]  J. D. van Ouwerkerk,et al.  Image super-resolution survey , 2006, Image Vis. Comput..

[21]  Nirmal K. Bose,et al.  Recursive reconstruction of high resolution image from noisy undersampled multiframes , 1990, IEEE Trans. Acoust. Speech Signal Process..

[22]  Xiaoou Tang,et al.  Learning a Deep Convolutional Network for Image Super-Resolution , 2014, ECCV.