Image super-resolution employing a spatial adaptive prior model

Super-resolution (SR) methods based on total variation (TV) prior model is a very popular method because of its ability of edge preservation. However, as TV prior model favors a piecewise constant solution, some pseudoedges in the smooth regions which are also called block effect may be produced, especially at high noise levels. In order to overcome such shortcoming, an adaptive SR model based on a new edge indicator is proposed. In our proposed model, a robust trilateral structure tensor by simultaneously considering the spatial similarity, gray similarity and gradient similarity is first constructed to examine the image local pattern, and then we develop a new edge indicator based on the eigenvalues of the trilateral structure tensor to identify the local spatial property of each pixel. Finally, an adaptive prior model controlled by the new edge indicator is proposed, in which the prior model at edges is approximate to the L1 norm in order to preserve edges, while the prior model in smooth regions and noises is approximate to the L2 norm in order to remove the noises. Experimental results on both simulated and real image sequences, our proposed method can better preserve edges and reduce the block effects in smooth regions when compared with the state-of-the-art methods.

[1]  Michal Irani,et al.  Motion Analysis for Image Enhancement: Resolution, Occlusion, and Transparency , 1993, J. Vis. Commun. Image Represent..

[2]  Yuan Xie,et al.  Single image super-resolution using combined total variation regularization by split Bregman Iteration , 2014, Neurocomputing.

[3]  Takeo Kanade,et al.  Limits on Super-Resolution and How to Break Them , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Jie Ren,et al.  Context-Aware Sparse Decomposition for Image Denoising and Super-Resolution , 2013, IEEE Transactions on Image Processing.

[5]  Edmund Y. Lam,et al.  A Total Variation Regularization Based Super-Resolution Reconstruction Algorithm for Digital Video , 2007, EURASIP J. Adv. Signal Process..

[6]  Lisimachos P. Kondi,et al.  Accurate image registration for MAP image super-resolution , 2013, Signal Process. Image Commun..

[7]  Manjunath V. Joshi,et al.  A learning-based method for image super-resolution from zoomed observations , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  Roger Y. Tsai,et al.  Multiframe image restoration and registration , 1984 .

[9]  Stanley Osher,et al.  Image Super-Resolution by TV-Regularization and Bregman Iteration , 2008, J. Sci. Comput..

[10]  Shutao Li,et al.  Multi-morphology image super-resolution via sparse representation , 2013, Neurocomputing.

[11]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[12]  Biao Wang,et al.  Super-resolution for face image by bilateral patches , 2012 .

[13]  Stanley Osher,et al.  Explicit Algorithms for a New Time Dependent Model Based on Level Set Motion for Nonlinear Deblurring and Noise Removal , 2000, SIAM J. Sci. Comput..

[14]  Deepu Rajan,et al.  An MRF-Based Approach to Generation of Super-Resolution Images from Blurred Observations , 2004, Journal of Mathematical Imaging and Vision.

[15]  Michael Elad,et al.  Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images , 1997, IEEE Trans. Image Process..

[16]  Pheng-Ann Heng,et al.  Adaptive total variation denoising based on difference curvature , 2010, Image Vis. Comput..

[17]  Stéphane Mallat,et al.  Super-Resolution With Sparse Mixing Estimators , 2010, IEEE Transactions on Image Processing.

[18]  Jian Yang,et al.  A novel sparse representation based framework for face image super-resolution , 2014, Neurocomputing.

[19]  Shin Ishii,et al.  Superresolution with compound Markov random fields via the variational EM algorithm , 2009, Neural Networks.

[20]  Kai-Kuang Ma,et al.  A survey on super-resolution imaging , 2011, Signal Image Video Process..

[21]  Michael Elad,et al.  On the origin of the bilateral filter and ways to improve it , 2002, IEEE Trans. Image Process..

[22]  Peyman Milanfar,et al.  A computationally efficient superresolution image reconstruction algorithm , 2001, IEEE Trans. Image Process..

[23]  Thomas Brox,et al.  Nonlinear structure tensors , 2006, Image Vis. Comput..

[24]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[25]  Yücel Altunbasak,et al.  Artifact reduction for set theoretic super resolution image reconstruction with edge adaptive constraints and higher-order interpolants , 2001, IEEE Trans. Image Process..

[26]  Li Chen,et al.  A soft MAP framework for blind super-resolution image reconstruction , 2009, Image Vis. Comput..

[27]  Xuelong Li,et al.  A multi-frame image super-resolution method , 2010, Signal Process..

[28]  Fermín S. Viloche Bazán,et al.  Estimation of the parameters in regularized simultaneous super-resolution , 2011, Pattern Recognit. Lett..

[29]  Mohammed Ghanbari,et al.  Scope of validity of PSNR in image/video quality assessment , 2008 .

[30]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.

[31]  Chuanjiang He,et al.  Fractional order total variation regularization for image super-resolution , 2013, Signal Process..

[32]  Wen-Yu Su,et al.  Recursive high-resolution reconstruction of blurred multiframe images , 1993, IEEE Trans. Image Process..

[33]  W. Zeng,et al.  A robust variational approach to super-resolution with nonlocal TV regularisation term , 2013 .

[34]  A. N. Rajagopalan,et al.  Superresolution of License Plates in Real Traffic Videos , 2007, IEEE Transactions on Intelligent Transportation Systems.

[35]  Nirmal K. Bose,et al.  Simultaneous noise filtering and super-resolution with second-generation wavelets , 2005, IEEE Signal Processing Letters.

[36]  Sabine Süsstrunk,et al.  A Frequency Domain Approach to Registration of Aliased Images with Application to Super-resolution , 2006, EURASIP J. Adv. Signal Process..

[37]  Hayit Greenspan,et al.  Super-Resolution in Medical Imaging , 2009, Comput. J..

[38]  Xiaohai He,et al.  Video superresolution reconstruction based on subpixel registration and iterative back projection , 2009, J. Electronic Imaging.

[39]  Zongxu Pan,et al.  Super-Resolution Based on Compressive Sensing and Structural Self-Similarity for Remote Sensing Images , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Robert L. Stevenson,et al.  Extraction of high-resolution frames from video sequences , 1996, IEEE Trans. Image Process..

[41]  Michael K. Ng,et al.  Fast minimization methods for solving constrained total-variation superresolution image reconstruction , 2011, Multidimens. Syst. Signal Process..

[42]  Kwang In Kim,et al.  Single-Image Super-Resolution Using Sparse Regression and Natural Image Prior , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Xiaobo Lu,et al.  A local structure adaptive super-resolution reconstruction method based on BTV regularization , 2012, Multimedia Tools and Applications.

[44]  Nelson D. A. Mascarenhas,et al.  Multispectral image data fusion using POCS and super-resolution , 2006, Comput. Vis. Image Underst..

[45]  Peyman Milanfar,et al.  Super-resolution imaging , 2011 .

[46]  Liangpei Zhang,et al.  Multiframe Super-Resolution Employing a Spatially Weighted Total Variation Model , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[47]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[48]  Suk Ho Lee,et al.  Noise removal with Gauss curvature-driven diffusion , 2005, IEEE Trans. Image Process..

[49]  Michael Elad,et al.  Advances and challenges in super‐resolution , 2004, Int. J. Imaging Syst. Technol..

[50]  Nirmal K. Bose,et al.  Recursive reconstruction of high resolution image from noisy undersampled multiframes , 1990, IEEE Trans. Acoust. Speech Signal Process..

[51]  Emre Turgay,et al.  Texture and edge preserving multiframe super-resolution , 2014, IET Image Process..

[52]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[53]  Xinbo Gao,et al.  Video super-resolution with 3D adaptive normalized convolution , 2012, Neurocomputing.