Modification in the SAR Super-Resolution Model Using the Fractal Descriptor LMME in the Term Regularizer

This paper presents a modified simultaneous auto regressive (SAR) super-resolution model, by adding a fractal operator as a new regularized term. We propose the local morphologic multifractal exponent (LMME) descriptor to determine the hyperparameters estimation of the probability distribution function representing the high resolution (HR) image. Due to the LMME’s texture sensibility characteristic, the estimated HR images showed good enhancements in their edge elements and detail regions when compared with the images generated by the original SAR model, at the same time that mitigates the unwanted noise. The proposed modification was also extended to the model that combines the SAR method with $\ell _{1}$ -norm. A comparison using peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM) metrics is presented in order to measure the quality of the HR images estimated by the proposed methods in relation to other available. The use of the LMME descriptor presented better adjustments of the restored image estimation distributions parameters, reflected on the values of PSNR and SSIM obtained in the experiments using low resolution images with moderate noise levels (SNR of 30 dB and 40 dB). In addition, our proposal converges in fewer iterations.

[1]  Jie Li,et al.  Image super-resolution: The techniques, applications, and future , 2016, Signal Process..

[2]  Rafael Molina,et al.  Image restoration in astronomy: a Bayesian perspective , 2001, IEEE Signal Process. Mag..

[3]  Harry Shum,et al.  Gradient Profile Prior and Its Applications in Image Super-Resolution and Enhancement , 2011, IEEE Transactions on Image Processing.

[4]  Aggelos K. Katsaggelos,et al.  Super Resolution of Images and Video , 2006, Super Resolution of Images and Video.

[5]  Edmund Y. Lam,et al.  A Total Variation Regularization Based Super-Resolution Reconstruction Algorithm for Digital Video , 2007, EURASIP J. Adv. Signal Process..

[6]  Liangpei Zhang,et al.  A Blind Super-Resolution Reconstruction Method Considering Image Registration Errors , 2015, Int. J. Fuzzy Syst..

[7]  Truong Q. Nguyen,et al.  Single Image Super-Resolution via Adaptive High-Dimensional Non-Local Total Variation and Adaptive Geometric Feature , 2017, IEEE Transactions on Image Processing.

[8]  Nikolas P. Galatsanos,et al.  Variational Bayesian Image Restoration With a Product of Spatially Weighted Total Variation Image Priors , 2010, IEEE Transactions on Image Processing.

[9]  Aggelos K. Katsaggelos,et al.  A bayesian multi-frame image super-resolution algorithm using the Gaussian Information Filter , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[10]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[11]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[12]  J. Idier Bayesian Approach to Inverse Problems: Idier/Bayesian , 2010 .

[13]  Hu Liang,et al.  Integrating the Missing Information Estimation into Multi-frame Super-Resolution , 2016, Circuits Syst. Signal Process..

[14]  Michihiko Minoh,et al.  Variational Bayesian Approach to Multiframe Image Restoration , 2017, IEEE Transactions on Image Processing.

[15]  Mário Sarcinelli Filho,et al.  Topographic independent component analysis based on fractal theory and morphology applied to texture segmentation , 2007, Signal Process..

[16]  Russell C. Hardie,et al.  Joint MAP registration and high-resolution image estimation using a sequence of undersampled images , 1997, IEEE Trans. Image Process..

[17]  Xuelong Li,et al.  Similarity Constraints-Based Structured Output Regression Machine: An Approach to Image Super-Resolution , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Nirupam Sarkar,et al.  An Efficient Differential Box-Counting Approach to Compute Fractal Dimension of Image , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[19]  Jun Sun,et al.  Multi-Frame Super-Resolution Reconstruction Based on Gradient Vector Flow Hybrid Field , 2017, IEEE Access.

[20]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[21]  Junjun Jiang,et al.  Single Image Super-Resolution via Locally Regularized Anchored Neighborhood Regression and Nonlocal Means , 2017, IEEE Transactions on Multimedia.

[22]  Siome Goldenstein,et al.  Eyes on the Target: Super-Resolution and License-Plate Recognition in Low-Quality Surveillance Videos , 2017, IEEE Access.

[23]  Mudar Sarem,et al.  A Generalized Detail-Preserving Super-Resolution method , 2016, Signal Process..

[24]  Xuesong Zhang,et al.  Commutability of Blur and Affine Warping in Super-Resolution With Application to Joint Estimation of Triple-Coupled Variables , 2012, IEEE Transactions on Image Processing.

[25]  Youji Iiguni,et al.  Image interpolation for progressive transmission by using radial basis function networks , 1999, IEEE Trans. Neural Networks.

[26]  Guillermo Sapiro,et al.  Non-local sparse models for image restoration , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[27]  Stephen Lin,et al.  Super resolution using edge prior and single image detail synthesis , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[28]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[29]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Aggelos K. Katsaggelos,et al.  Using the Kullback-Leibler divergence to combine image priors in Super-Resolution image reconstruction , 2010, 2010 IEEE International Conference on Image Processing.

[31]  Emre Turgay,et al.  Texture and edge preserving multiframe super-resolution , 2014, IET Image Process..

[32]  Mário Sarcinelli Filho,et al.  Super-Resolution Image Reconstruction Using Nonparametric Bayesian INLA Approximation , 2012, IEEE Transactions on Image Processing.

[33]  Yuanying Qiu,et al.  A New Single Image Super-Resolution Method Based on the Infinite Mixture Model , 2017, IEEE Access.

[34]  Xu Zhou,et al.  Fast iteratively reweighted least squares for lp regularized image deconvolution and reconstruction , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[35]  Aggelos K. Katsaggelos,et al.  Bayesian combination of sparse and non-sparse priors in image super resolution , 2013, Digit. Signal Process..

[36]  Wenhan Yang,et al.  Image Super-Resolution Based on Structure-Modulated Sparse Representation , 2015, IEEE Transactions on Image Processing.

[37]  Rongchun Zhao,et al.  Morphology-based multifractal estimation for texture segmentation , 2006, IEEE Transactions on Image Processing.

[38]  Martin Turner,et al.  Fractal geometry in digital imaging , 1998 .

[39]  Aggelos K. Katsaggelos,et al.  Variational Bayesian Super Resolution , 2011, IEEE Transactions on Image Processing.

[40]  Luc Van Gool,et al.  Anchored Neighborhood Regression for Fast Example-Based Super-Resolution , 2013, 2013 IEEE International Conference on Computer Vision.