Diffusion-steered super-resolution method based on the Papoulis-Gerchberg algorithm

Papoulis-Gerchberg (PG) algorithm, a technique to extrapolate signals, has attracted many researchers for its lower complexity, higher computational efficiency, and effectiveness. One field that receives these merits is super-resolution, which fuses multiple band-limited scenes to generate a high-resolution image. Most super-resolution methods based on the PG algorithm, however, underperform when input images are seriously degraded by blur, noise, and sampling. The current study addresses the challenges by embedding the PG algorithm into a super-resolution minimization problem. The proposed method is iterative and incorporates a diffusion-driven smoothness prior that updates its regularisation process according to the local image features. This well-crafted prior, which attempts to overcome the super-resolution ill-posedness, provides an automatic interplay between flat and contour regions, and ensures necessary levels of regularisations to generate sharper and detailed images. Results show that the current method outperforms some state-of-the-art super-resolution approaches including those based on total variation. Even more importantly, the authors' method contains a robust noise suppressor that treats comfortably noisy scenes.

[1]  Mudar Sarem,et al.  A novel multi-image super-resolution reconstruction method using anisotropic fractional order adaptive norm , 2014, The Visual Computer.

[2]  Hideitsu Hino,et al.  Multi-frame image super resolution based on sparse coding , 2015, Neural Networks.

[3]  Addisson Salazar,et al.  Optimum Detection of Ultrasonic Echoes Applied to the Analysis of the First Layer of a Restored Dome , 2007, EURASIP J. Adv. Signal Process..

[4]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Guoyu Wang,et al.  Anisotropic fourth-order diffusion regularization for multiframe super-resolution reconstruction , 2013 .

[6]  Michel Barlaud,et al.  Two deterministic half-quadratic regularization algorithms for computed imaging , 1994, Proceedings of 1st International Conference on Image Processing.

[7]  Max A. Viergever,et al.  Efficient and reliable schemes for nonlinear diffusion filtering , 1998, IEEE Trans. Image Process..

[8]  Liangpei Zhang,et al.  Multiframe Super-Resolution Employing a Spatially Weighted Total Variation Model , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Xuelong Li,et al.  A multi-frame image super-resolution method , 2010, Signal Process..

[10]  Bart M. ter Haar Romeny,et al.  Geometry-Driven Diffusion in Computer Vision , 1994, Computational Imaging and Vision.

[11]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[12]  Nadia Magnenat-Thalmann Welcome to the year 2015 , 2014, The Visual Computer.

[13]  Jie Yang,et al.  Natural cooperation in wireless networks , 2009, IEEE Signal Processing Magazine.

[14]  Jiasong Mu,et al.  Throat polyp detection based on compressed big data of voice with support vector machine algorithm , 2014, EURASIP Journal on Advances in Signal Processing.

[15]  Stanley Osher,et al.  Image Super-Resolution by TV-Regularization and Bregman Iteration , 2008, J. Sci. Comput..

[16]  Zhichang Guo,et al.  A Total Variation Model Based on the Strictly Convex Modification for Image Denoising , 2014 .

[17]  Thomas B. Moeslund,et al.  Super-resolution: a comprehensive survey , 2014, Machine Vision and Applications.

[18]  Chuanjiang He,et al.  Fractional order total variation regularization for image super-resolution , 2013, Signal Process..

[19]  Simon Setzer,et al.  Operator Splittings, Bregman Methods and Frame Shrinkage in Image Processing , 2011, International Journal of Computer Vision.

[20]  Huijun Gao,et al.  A multi-frame super-resolution method based on the variable-exponent nonlinear diffusion regularizer , 2015, EURASIP J. Image Video Process..

[21]  Qiang Liu,et al.  A robust super-resolution method with improved high-frequency components estimation and aliasing correction capabilities , 2014, J. Frankl. Inst..

[22]  Boying Wu,et al.  An Alternative Variational Framework for Image Denoising , 2014 .

[23]  Ezzatollah Salari,et al.  Super-resolution using an enhanced Papoulis-Gerchberg algorithm , 2012 .

[24]  Qiang He,et al.  Robust Super-resolution for UAS Video Data , 2013 .

[25]  Edmund Y. Lam,et al.  A Total Variation Regularization Based Super-Resolution Reconstruction Algorithm for Digital Video , 2007, EURASIP J. Adv. Signal Process..

[26]  Huijun Gao,et al.  A noise-suppressing and edge-preserving multiframe super-resolution image reconstruction method , 2015, Signal Process. Image Commun..

[27]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[28]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[29]  Humberto Bustince,et al.  A generalization of the Perona-Malik anisotropic diffusion method using restricted dissimilarity functions , 2013, Int. J. Comput. Intell. Syst..

[30]  Jing Wang,et al.  Split Bregman iterative algorithm for sparse reconstruction of electrical impedance tomography , 2012, Signal Process..

[31]  Russell C. Hardie,et al.  Multiframe adaptive Wiener filter super-resolution with JPEG2000-compressed images , 2014, EURASIP J. Adv. Signal Process..

[32]  Liangpei Zhang,et al.  A locally adaptive L1-L2 norm for multi-frame super-resolution of images with mixed noise and outliers , 2014, Signal Process..

[33]  Boying Wu,et al.  Adaptive Perona–Malik Model Based on the Variable Exponent for Image Denoising , 2012, IEEE Transactions on Image Processing.

[34]  Saeid Nahavandi,et al.  Performance Evaluation of Multi-Frame Super-Resolution Algorithms , 2012, 2012 International Conference on Digital Image Computing Techniques and Applications (DICTA).

[35]  Eric A. Shields,et al.  Efficient multiframe super-resolution for imagery with lateral shifts. , 2014, Applied optics.

[36]  Robert B. Fisher,et al.  Special issue on animal and insect behaviour understanding in image sequences , 2015, EURASIP J. Image Video Process..

[37]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[38]  Enhua Wu,et al.  Handling motion blur in multi-frame super-resolution , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  A. Papoulis A new algorithm in spectral analysis and band-limited extrapolation. , 1975 .

[40]  Weili Zeng,et al.  Image super-resolution employing a spatial adaptive prior model , 2015, Neurocomputing.

[41]  Yehoshua Y. Zeevi,et al.  Forward-and-backward diffusion processes for adaptive image enhancement and denoising , 2002, IEEE Trans. Image Process..

[42]  Hugues Talbot,et al.  A Majorize-Minimize Subspace Approach for ℓ2-ℓ0 Image Regularization , 2011, SIAM J. Imaging Sci..

[43]  R. Gerchberg Super-resolution through Error Energy Reduction , 1974 .

[44]  P. Ferreira Iterative and Noniterative Recovery of Missing Samples for 1-D Band-Limited Signals , 2001 .

[45]  Joachim Weickert,et al.  Coherence-Enhancing Diffusion Filtering , 1999, International Journal of Computer Vision.

[46]  Shmuel Peleg,et al.  Robust super-resolution , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[47]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[48]  R. Courant,et al.  On the Partial Difference Equations, of Mathematical Physics , 2015 .