New single-image super-resolution reconstruction using MRF model

Abstract Learning-based single-image super-resolution reconstruction (LSISRR) problem using Markov Random Field (LSISRR-MRF) is a robust and integrated framework for both natural and face image super-resolution. The spatial relationships between patches are learned from the training images using the Markov network, and the missing details in the unknown high-resolution (HR) images are predicted using the learned relationship. However, selection of efficient training images with better structural similarity to the input low-resolution (LR) image and appropriate selection of compatibility constraints to measure the correlation between patches affect a lot to the reconstruction results. Besides these, selection of optimal candidate patches for each input LR patch from a pool of training patches is a time-consuming process. To avoid these pitfalls, an improved and fast LSISRR-MRF model is proposed here. A statistical framework, i.e., spatiogram based matching is used to choose efficient training images. Searching of candidate patches is performed in a compact and well-structured search space known as epitomic representation. Smoothness preserving compatibility functions are utilized to well constraint the correlation between patches. Efficacy of the suggested method for generating a high-quality HR image is validated via several experimental analyses on both synthetic and real-time images over some of the state of art methods.

[1]  Liangpei Zhang,et al.  A super-resolution reconstruction algorithm for surveillance images , 2010, Signal Process..

[2]  Stanley T. Birchfield,et al.  Spatiograms versus histograms for region-based tracking , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[3]  Stanley Osher,et al.  Image Super-Resolution by TV-Regularization and Bregman Iteration , 2008, J. Sci. Comput..

[4]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[5]  Michael Elad,et al.  On Single Image Scale-Up Using Sparse-Representations , 2010, Curves and Surfaces.

[6]  Banshidhar Majhi,et al.  Development of robust neighbor embedding based super-resolution scheme , 2016, Neurocomputing.

[7]  Alan C. Bovik,et al.  A Two-Step Framework for Constructing Blind Image Quality Indices , 2010, IEEE Signal Processing Letters.

[8]  Xuelong Li,et al.  Single Image Super-Resolution With Non-Local Means and Steering Kernel Regression , 2012, IEEE Transactions on Image Processing.

[9]  Daniel Rueckert,et al.  Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Joseph Y. Lo,et al.  New Applications of Super-Resolution in Medical Imaging , 2017 .

[11]  Denis Kouame,et al.  Super-resolution in medical imaging : An illustrative approach through ultrasound , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[12]  Yan Zhang,et al.  On the Euclidean distance of images , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Kyoung Mu Lee,et al.  Deeply-Recursive Convolutional Network for Image Super-Resolution , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Zheng Liu,et al.  Single-image super-resolution based on Markov random field and contourlet transform , 2011, J. Electronic Imaging.

[15]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.

[16]  Truong Q. Nguyen,et al.  Single Image Superresolution Based on Gradient Profile Sharpness , 2015, IEEE Transactions on Image Processing.

[17]  Narendra Ahuja,et al.  Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolution , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Zhenzhong Chen,et al.  Remote sensing image super-resolution: Challenges and approaches , 2015, 2015 IEEE International Conference on Digital Signal Processing (DSP).

[19]  S. Holden,et al.  DAOSTORM: an algorithm for high- density super-resolution microscopy , 2011, Nature Methods.

[20]  D. Yeung,et al.  Super-resolution through neighbor embedding , 2004, CVPR 2004.

[21]  K. Puschmann,et al.  On super-resolution in astronomical imaging , 2005 .

[22]  Dipti Patra,et al.  Enhanced Super-Resolution Image Reconstruction Using MRF Model , 2018 .

[23]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[24]  Quan Pan,et al.  Semi-coupled dictionary learning with applications to image super-resolution and photo-sketch synthesis , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Chun Qi,et al.  Document image super-resolution using structural similarity and Markov random field , 2014, IET Image Process..

[26]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Brendan J. Frey,et al.  Epitomic analysis of appearance and shape , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[28]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[29]  Christian Böhm,et al.  Searching in high-dimensional spaces: Index structures for improving the performance of multimedia databases , 2001, CSUR.

[30]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[31]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[32]  Xiaoou Tang,et al.  Accelerating the Super-Resolution Convolutional Neural Network , 2016, ECCV.

[33]  Junjun Jiang,et al.  Single Image Super-Resolution via Locally Regularized Anchored Neighborhood Regression and Nonlocal Means , 2017, IEEE Transactions on Multimedia.

[34]  Nanning Zheng,et al.  Image hallucination with primal sketch priors , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[35]  Stefan Winkler,et al.  Perceptual blur and ringing metrics: application to JPEG2000 , 2004, Signal Process. Image Commun..

[36]  Zongliang Gan,et al.  Super-resolution algorithm through neighbor embedding with new feature selection and example training , 2012, 2012 IEEE 11th International Conference on Signal Processing.

[37]  Kyoung Mu Lee,et al.  Accurate Image Super-Resolution Using Very Deep Convolutional Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Michael Felsberg,et al.  Continuous dimensionality characterization of image structures , 2009, Image Vis. Comput..

[39]  Roger Y. Tsai,et al.  Multiframe image restoration and registration , 1984 .

[40]  Tsuhan Chen,et al.  Adaptive Markov Random Fields for Example-Based Super-resolution of Faces , 2006, EURASIP J. Adv. Signal Process..

[41]  C. V. Jawahar,et al.  Contextual restoration of severely degraded document images , 2009, CVPR.

[42]  Wan-Chi Siu,et al.  Robust Soft-Decision Interpolation Using Weighted Least Squares , 2012, IEEE Transactions on Image Processing.

[43]  Santanu Chaudhury,et al.  Feature Combination in Kernel Space for Distance Based Image Hashing , 2012, IEEE Transactions on Multimedia.

[44]  Dipti Patra,et al.  Super resolution image reconstruction using penalized-spline and phase congruency , 2017, Comput. Electr. Eng..

[45]  J. Paul Siebert,et al.  Super-Resolution of Face Images Based on Adaptive Markov Network , 2007, 2007 Third International IEEE Conference on Signal-Image Technologies and Internet-Based System.

[46]  Ezzatollah Salari,et al.  Single-image super resolution using evolutionary sparse coding technique , 2017, IET Image Process..

[47]  Hua Zhang,et al.  A Novel Super-Resolution Image Reconstruction Based on MRF , 2009, 2009 2nd International Congress on Image and Signal Processing.

[48]  Hua Huang,et al.  Neighbor embedding based super-resolution algorithm through edge detection and feature selection , 2009, Pattern Recognit. Lett..

[49]  Alexandr Andoni,et al.  Near-Optimal Hashing Algorithms for Approximate Nearest Neighbor in High Dimensions , 2006, 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06).

[50]  Luc Van Gool,et al.  Anchored Neighborhood Regression for Fast Example-Based Super-Resolution , 2013, 2013 IEEE International Conference on Computer Vision.

[51]  William T. Freeman,et al.  Learning Low-Level Vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[52]  Lei Zhang,et al.  An edge-guided image interpolation algorithm via directional filtering and data fusion , 2006, IEEE Transactions on Image Processing.

[53]  Horst Bischof,et al.  Fast and accurate image upscaling with super-resolution forests , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[55]  Thomas S. Huang,et al.  Deep Networks for Image Super-Resolution with Sparse Prior , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[56]  Feng Li,et al.  Super Resolution for Remote Sensing Images Based on a Universal Hidden Markov Tree Model , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[57]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.