Single-Image Super-Resolution Algorithm Based on Structural Self-Similarity and Deformation Block Features

To solve the problem of insufficient sample resources and poor noise immunity in single-image super-resolution (SR) restoration procedure, the paper has proposed the single-image SR algorithm based on structural self-similarity and deformation block features (SSDBF). First, the proposed method constructs a scale model, expands the search space as much as possible, and overcomes the shortcomings caused by the lack of a single-image SR training sample; Second, the limited internal dictionary size is increased by the geometric deformation of the sample block; Finally, in order to improve the anti-noise performance of the reconstructed picture, a group sparse learning dictionary is used to reconstruct the pending image. The experimental results show that, compared with state-of-the-art algorithms such as bicubic interpolation (BI), sparse coding (SC), deep recursive convolutional network (DRCN), multi-scale deep SR network (MDSR), super-resolution convolutional neural network (SRCNN) and second-order directional total generalized variation (DTGV). The SR images with more subjective visual effects and higher objective evaluation can be obtained through the proposed method. Compared with existing algorithms, the structural network converges more rapidly, the image edge and texture reconstruction effects are obviously improved, and the image quality evaluation, such as peak signal-noise ratio (PSNR), root mean square error (RMSE), and structural similarity (SSIM), are also superior and popular in image evaluation.

[1]  R. Keys Cubic convolution interpolation for digital image processing , 1981 .

[2]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[3]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[4]  D. Yeung,et al.  Super-resolution through neighbor embedding , 2004, CVPR 2004.

[5]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[6]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[7]  Thomas S. Huang,et al.  Image super-resolution as sparse representation of raw image patches , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Eli Shechtman,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, ACM Trans. Graph..

[9]  Raanan Fattal,et al.  Image upsampling via texture hallucination , 2010, 2010 IEEE International Conference on Computational Photography (ICCP).

[10]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[11]  Michal Irani,et al.  Internal statistics of a single natural image , 2011, CVPR 2011.

[12]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.

[13]  Ilker Bayram,et al.  Directional Total Variation , 2012, IEEE Signal Processing Letters.

[14]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[15]  Eli Shechtman,et al.  Image melding , 2012, ACM Trans. Graph..

[16]  Chih-Yuan Yang,et al.  Fast Direct Super-Resolution by Simple Functions , 2013, 2013 IEEE International Conference on Computer Vision.

[17]  Zhe L. Lin,et al.  Fast Image Super-Resolution Based on In-Place Example Regression , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Luc Van Gool,et al.  Anchored Neighborhood Regression for Fast Example-Based Super-Resolution , 2013, 2013 IEEE International Conference on Computer Vision.

[19]  Xiaoou Tang,et al.  Learning a Deep Convolutional Network for Image Super-Resolution , 2014, ECCV.

[20]  Narendra Ahuja,et al.  Super-Resolution Using Sub-Band Self-Similarity , 2014, ACCV.

[21]  Weisi Lin,et al.  No-Reference Image Sharpness Assessment in Autoregressive Parameter Space , 2015, IEEE Transactions on Image Processing.

[22]  Wenjun Zhang,et al.  Using Free Energy Principle For Blind Image Quality Assessment , 2015, IEEE Transactions on Multimedia.

[23]  Kyoung Mu Lee,et al.  Deeply-Recursive Convolutional Network for Image Super-Resolution , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Kyoung Mu Lee,et al.  Accurate Image Super-Resolution Using Very Deep Convolutional Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Weisi Lin,et al.  A Fast Reliable Image Quality Predictor by Fusing Micro- and Macro-Structures , 2017, IEEE Transactions on Industrial Electronics.

[28]  Jian Yang,et al.  MemNet: A Persistent Memory Network for Image Restoration , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[29]  Kyoung Mu Lee,et al.  Enhanced Deep Residual Networks for Single Image Super-Resolution , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[30]  Zhou Wang,et al.  Unified Blind Quality Assessment of Compressed Natural, Graphic, and Screen Content Images , 2017, IEEE Transactions on Image Processing.

[31]  GUN: Gradual Upsampling Network for Single Image Super-Resolution , 2017, IEEE Access.

[32]  Evandro Ottoni Teatini Salles,et al.  Modification in the SAR Super-Resolution Model Using the Fractal Descriptor LMME in the Term Regularizer , 2018, IEEE Access.

[33]  Yun Lin,et al.  Semi-Supervised Learning with Generative Adversarial Networks on Digital Signal Modulation Classification , 2018 .

[34]  Nam Ik Cho,et al.  High Dynamic Range and Super-Resolution Imaging From a Single Image , 2018, IEEE Access.

[35]  Dafang Zhang,et al.  Energy-Aware Routing for SWIPT in Multi-Hop Energy-Constrained Wireless Network , 2018, IEEE Access.

[36]  Wen Gao,et al.  Local patch encoding-based method for single image super-resolution , 2018, Inf. Sci..

[37]  Jin Wang,et al.  Spatial and semantic convolutional features for robust visual object tracking , 2018, Multimedia Tools and Applications.

[38]  Naixue Xiong,et al.  A Greedy Deep Learning Method for Medical Disease Analysis , 2018, IEEE Access.

[39]  Jie Xiong,et al.  A novel online incremental and decremental learning algorithm based on variable support vector machine , 2019, Cluster Computing.

[40]  Jin Wang,et al.  A Fast Object Tracker Based on Integrated Multiple Features and Dynamic Learning Rate , 2018 .

[41]  Lei Yu,et al.  Data Fusion-Based Multi-Object Tracking for Unconstrained Visual Sensor Networks , 2018, IEEE Access.

[42]  R. Sherratt,et al.  Adversarial learning for distant supervised relation extraction , 2018 .

[43]  Feng Li,et al.  TUMK-ELM: A Fast Unsupervised Heterogeneous Data Learning Approach , 2018, IEEE Access.

[44]  Jianguo Luo,et al.  Complex Network Construction of Multivariate Time Series Using Information Geometry , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[45]  Hye-Jin Kim,et al.  Deep Learning-Based Data Storage for Low Latency in Data Center Networks , 2019, IEEE Access.

[46]  Yan Gui,et al.  Joint learning of visual and spatial features for edit propagation from a single image , 2019, The Visual Computer.

[47]  Miaomiao Yu,et al.  Full-Reference Image Quality Assessment by Combining Features in Spatial and Frequency Domains , 2019, IEEE Transactions on Broadcasting.