Swift single image super resolution using deep convolution neural network

Now a days, Image Super resolution is one of the most important and challenging issue in the image processing area. Aim of Super resolution is to generate high-resolution image from single or multiple low resolution of the same scene or image. With single low resolution image it's very challenging to produce high-resolution image because a single low-resolution image contain the less information. Due to the ability of preserving edges, kind of method called TV (Total Variation)-based method was proposed as regularization function for some inverse problems. Due to ill-posed nature of problem, existing super resolution method which based on combine total variation regularization term including the Non Local Total Variation (NLTV) and Steering Kernel Regularization Total Variation (SKRTV) which takes the more execution time due to the non-local weight calculation. We propose the Example based Convolution neural network which consists of three layers namely convolution layer, max-pooling layer and reconstruction layer. Using Convolution neural network approach we achieved to reduce the execution time as well as increased the PSNR ratio.

[1]  Stanley Osher,et al.  Image Super-Resolution by TV-Regularization and Bregman Iteration , 2008, J. Sci. Comput..

[2]  William T. Freeman,et al.  Learning low-level vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[3]  Marco Bevilacqua,et al.  Algorithms for super-resolution of images and videos based on learning methods. (Algorithmes de super-résolution d'images et de vidéos basés sur des méthodes d'apprentissage) , 2014 .

[4]  Somchai Jitapunkul,et al.  An Iterative Super-Resolution Reconstruction of Image Sequences using a Bayesian Approach with BTV prior and Affine Block-Based Registration , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[5]  Aline Roumy,et al.  Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding , 2012, BMVC.

[6]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[7]  Charu C. Aggarwal,et al.  Neural Networks and Deep Learning , 2018, Springer International Publishing.

[8]  Bhabatosh Chanda,et al.  Super Resolution Image Reconstruction Through Bregman Iteration Using Morphologic Regularization , 2012, IEEE Transactions on Image Processing.

[9]  Trevor Darrell,et al.  Part-Based R-CNNs for Fine-Grained Category Detection , 2014, ECCV.

[10]  Tingting Wu,et al.  Image-zooming technique based on Bregmanized nonlocal total variation regularization , 2011 .

[11]  Martin M. Richter,et al.  Total variation regularization filtering for video signal processing , 2009, 2009 IEEE 13th International Symposium on Consumer Electronics.

[12]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[13]  Ting-Zhu Huang,et al.  Split Bregman Iteration Algorithm for Image Deblurring Using Fourth-Order Total Bounded Variation Regularization Model , 2013, J. Appl. Math..

[14]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[15]  Bernhard Schölkopf,et al.  Multiframe blind deconvolution, super-resolution, and saturation correction via incremental EM , 2010, 2010 IEEE International Conference on Image Processing.

[16]  B. G. Vijay Kumar,et al.  Computationally efficient algorithm for face super-resolution using (2D) 2 -PCA based prior , 2010 .

[17]  Xiaogang Wang,et al.  DeepID-Net: multi-stage and deformable deep convolutional neural networks for object detection , 2014, ArXiv.

[18]  James Hays,et al.  Super-resolution from internet-scale scene matching , 2012, 2012 IEEE International Conference on Computational Photography (ICCP).

[19]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[21]  Bo Li,et al.  Single-image super-resolution using directional total variation regularization and alternating direction method of multiplier solver , 2015, J. Electronic Imaging.

[22]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[23]  Guy Gilboa,et al.  Nonlocal Operators with Applications to Image Processing , 2008, Multiscale Model. Simul..

[24]  Feng Xiao,et al.  Resolution and light sensitivity tradeoff with pixel size , 2006, Electronic Imaging.

[25]  Xiaogang Wang,et al.  Deep Learning Face Representation by Joint Identification-Verification , 2014, NIPS.

[26]  ANTONIN CHAMBOLLE,et al.  An Algorithm for Total Variation Minimization and Applications , 2004, Journal of Mathematical Imaging and Vision.

[27]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Marc Teboulle,et al.  Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems , 2009, IEEE Transactions on Image Processing.

[29]  H.R. Wu,et al.  A generalized block-edge impairment metric for video coding , 1997, IEEE Signal Processing Letters.

[30]  Xiaogang Wang,et al.  Joint Deep Learning for Pedestrian Detection , 2013, 2013 IEEE International Conference on Computer Vision.

[31]  Edmund Y. Lam,et al.  A Total Variation Regularization Based Super-Resolution Reconstruction Algorithm for Digital Video , 2007, EURASIP J. Adv. Signal Process..

[32]  Yuan Xie,et al.  Single image super-resolution using combined total variation regularization by split Bregman Iteration , 2014, Neurocomputing.

[33]  Eric Dubois,et al.  Image up-sampling using total-variation regularization with a new observation model , 2005, IEEE Transactions on Image Processing.

[34]  François Malgouyres,et al.  Total variation based interpolation , 1998, 9th European Signal Processing Conference (EUSIPCO 1998).

[35]  Antonin Chambolle,et al.  Image Decomposition into a Bounded Variation Component and an Oscillating Component , 2005, Journal of Mathematical Imaging and Vision.

[36]  Takahiro Saito,et al.  Image-Processing Approach Based on Nonlinear Image-Decomposition , 2009, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[37]  Dumitru Erhan,et al.  Scalable, High-Quality Object Detection , 2014, ArXiv.

[38]  Jacques Froment,et al.  Adapted Total Variation for Artifact Free Decompression of JPEG Images , 2005, Journal of Mathematical Imaging and Vision.

[39]  H. Sebastian Seung,et al.  Natural Image Denoising with Convolutional Networks , 2008, NIPS.

[40]  Xavier Bresson,et al.  Bregmanized Nonlocal Regularization for Deconvolution and Sparse Reconstruction , 2010, SIAM J. Imaging Sci..

[41]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[42]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.