A noise-suppressing and edge-preserving multiframe super-resolution image reconstruction method

Super-resolution technology is an approach that helps to restore high quality images and videos from degraded ones. The method stems from an ill-posed minimization problem, which is usually solved using the L2 norm and some regularization techniques. Most of the classical regularizing functionals are based on the Total Variation and the Perona-Malik frameworks, which suffer from undesirable artifacts (blocking and staircasing). To address these problems, we have developed a super-resolution framework that integrates an adaptive diffusion-based regularizer. The model is feature-dependent: linear isotropic in flat regions, a condition that regularizes an image uniformly and removes noise more effectively; and nonlinear anisotropic near boundaries, which helps to preserve important image features, such as edges and contours. Additionally, the new regularizing kernel incorporates a shape-defining parameter that can be automatically updated to ensure convexity and stability of the corresponding energy functional. Comparisons with other methods show that our method is superior and, more importantly, can achieve higher reconstruction factors. Graphical abstractDisplay Omitted HighlightsWe have proposed a diffusion-based regularizing functional to address the ill-posedness of the multiframe super-resolution problem.The new regularizer can effectively suppress noise, preserve critical image features, and enhance edges.The proposed regularizer contains a shape-defining parameter that is automatically updated to ensure that the corresponding energy potential is convex.The new super-resolution method can achieve higher resolution factors while maintaining stability and appealing results.

[1]  Sabine Süsstrunk,et al.  A Frequency Domain Approach to Registration of Aliased Images with Application to Super-resolution , 2006, EURASIP J. Adv. Signal Process..

[2]  Mudar Sarem,et al.  A novel multi-image super-resolution reconstruction method using anisotropic fractional order adaptive norm , 2014, The Visual Computer.

[3]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Huijun Gao,et al.  Edge preservation image enlargement and enhancement method based on the adaptive Perona-Malik non-linear diffusion model , 2014, IET Image Process..

[5]  Shmuel Peleg,et al.  Robust super-resolution , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[6]  Hamed Bouzari,et al.  An improved regularization method for artifact rejection in image super-resolution , 2012, Signal Image Video Process..

[7]  Michel Barlaud,et al.  Two deterministic half-quadratic regularization algorithms for computed imaging , 1994, Proceedings of 1st International Conference on Image Processing.

[8]  Lihua Yang,et al.  A robust multiframe super-resolution algorithm based on half-quadratic estimation with modified BTV regularization , 2013, Digit. Signal Process..

[9]  Qiang Liu,et al.  Adaptive Charbonnier superresolution method with robust edge preservation capabilities , 2013, J. Electronic Imaging.

[10]  Max A. Viergever,et al.  Efficient and reliable schemes for nonlinear diffusion filtering , 1998, IEEE Trans. Image Process..

[11]  K. Höllig Existence of infinitely many solutions for a forward backward heat equation , 1983 .

[12]  Hanno Scharr,et al.  An Anisotropic Diffusion Algorithm with Optimized Rotation Invariance , 2000, DAGM-Symposium.

[13]  Boying Wu,et al.  Adaptive Perona–Malik Model Based on the Variable Exponent for Image Denoising , 2012, IEEE Transactions on Image Processing.

[14]  Xuelong Li,et al.  A multi-frame image super-resolution method , 2010, Signal Process..

[15]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[16]  Hanno Scharr,et al.  A Scheme for Coherence-Enhancing Diffusion Filtering with Optimized Rotation Invariance , 2002, J. Vis. Commun. Image Represent..

[17]  Joachim Weickert,et al.  Coherence-Enhancing Shock Filters , 2003, DAGM-Symposium.

[18]  Jiasong Mu,et al.  Throat polyp detection based on compressed big data of voice with support vector machine algorithm , 2014, EURASIP Journal on Advances in Signal Processing.

[19]  Stanley Osher,et al.  Image Super-Resolution by TV-Regularization and Bregman Iteration , 2008, J. Sci. Comput..

[20]  Qiang Liu,et al.  A robust super-resolution method with improved high-frequency components estimation and aliasing correction capabilities , 2014, J. Frankl. Inst..

[21]  Hyeran Byun,et al.  Regularization based super-resolution image processing algorithm using edge-adaptive non-local means filter , 2013, ICUIMC '13.

[22]  T. Pock,et al.  Second order total generalized variation (TGV) for MRI , 2011, Magnetic resonance in medicine.

[23]  Liangpei Zhang,et al.  Multiframe image super-resolution adapted with local spatial information. , 2011, Journal of the Optical Society of America. A, Optics, image science, and vision.

[24]  Klamer Schutte,et al.  Robust Fusion of Irregularly Sampled Data Using Adaptive Normalized Convolution , 2006, EURASIP J. Adv. Signal Process..

[25]  Aggelos K. Katsaggelos,et al.  Bayesian combination of sparse and non-sparse priors in image super resolution , 2013, Digit. Signal Process..

[26]  Boying Wu,et al.  An Alternative Variational Framework for Image Denoising , 2014 .

[27]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[28]  R. Quentin Grafton,et al.  Mean Squared Error , 2017, Encyclopedia of Machine Learning and Data Mining.

[29]  Russell C Hardie,et al.  Fast super-resolution using an adaptive Wiener filter with robustness to local motion. , 2012, Optics express.

[30]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[31]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[32]  Russell C. Hardie,et al.  A Fast Image Super-Resolution Algorithm Using an Adaptive Wiener Filter , 2007, IEEE Transactions on Image Processing.

[33]  R. Courant,et al.  On the Partial Difference Equations, of Mathematical Physics , 2015 .

[34]  Ki-Sang Hong,et al.  Edge-enhancing super-resolution using anisotropic diffusion , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[35]  Satyanad Kichenassamy,et al.  The Perona-Malik Paradox , 1997, SIAM J. Appl. Math..

[36]  Ron Kimmel,et al.  A general framework for low level vision , 1998, IEEE Trans. Image Process..

[37]  Russell C. Hardie,et al.  Multiframe adaptive Wiener filter super-resolution with JPEG2000-compressed images , 2014, EURASIP J. Adv. Signal Process..

[38]  Gouda I. Salama,et al.  Adaptive regularization-based super resolution reconstruction technique for multi-focus low-resolution images , 2014, Signal Process..

[39]  Ki-Sang Hong,et al.  Variational approaches to super-resolution with contrast enhancement and anisotropic diffusion , 2003, J. Electronic Imaging.

[40]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[41]  Gunamani Jena,et al.  POCS Based Super-Resolution Image Reconstruction Using an Adaptive Regularization Parameter , 2011, ArXiv.

[42]  Liangpei Zhang,et al.  Multiframe Super-Resolution Employing a Spatially Weighted Total Variation Model , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[43]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[44]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[45]  I. J. Day On the inversion of diffusion NMR data: Tikhonov regularization and optimal choice of the regularization parameter. , 2011, Journal of magnetic resonance.

[46]  Wenyuan Xu,et al.  Behavioral analysis of anisotropic diffusion in image processing , 1996, IEEE Trans. Image Process..

[47]  Eric A. Shields,et al.  Efficient multiframe super-resolution for imagery with lateral shifts. , 2014, Applied optics.

[48]  Joachim Weickert,et al.  Coherence-Enhancing Diffusion Filtering , 1999, International Journal of Computer Vision.

[49]  Zhichang Guo,et al.  A Total Variation Model Based on the Strictly Convex Modification for Image Denoising , 2014 .

[50]  Joachim Weickert,et al.  A Review of Nonlinear Diffusion Filtering , 1997, Scale-Space.

[51]  Guillermo Sapiro,et al.  Robust anisotropic diffusion , 1998, IEEE Trans. Image Process..