Multi-frame super-resolution for mixed Gaussian and impulse noise based on blind inpainting

This paper proposes a robust multi-frame super-resolution algorithm to produce a high-resolution image. In merging the non-redundant information from shifted, rotated, blurred, noise-corrupted, low-resolution observations of the same scene, the approach registers the frame and reduces the impact of the distortions. The method is a generalization of a recently published blind inpainting algorithm to the multi-frame super-resolution case including both Gaussian and Impulse noises. Most multi-frame super-resolution algorithms, only consider blurring and Gaussian noise, ignoring noises that arise in real applications such as when processing time-of-flight camera depth images. Examples on simulated scenarios and real images produce results that compare favorably with other methods and clearly justify the benefits of this imaging model and the reconstruction method presented.

[1]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[2]  Alan C. Bovik,et al.  Handbook of Image and Video Processing (Communications, Networking and Multimedia) , 2005 .

[3]  Aggelos K. Katsaggelos,et al.  Super Resolution of Images and Video , 2006, Super Resolution of Images and Video.

[4]  Ming Yan,et al.  Restoration of Images Corrupted by Impulse Noise and Mixed Gaussian Impulse Noise using Blind Inpainting , 2013, SIAM J. Imaging Sci..

[5]  Horst Bischof,et al.  Image Guided Depth Upsampling Using Anisotropic Total Generalized Variation , 2013, 2013 IEEE International Conference on Computer Vision.

[6]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[7]  Brendt Wohlberg,et al.  MIxed gaussian-impulse noise image restoration via total variation , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[8]  IEEE Signal Processing and Signal Processing Education Workshop, SP/SPE 2015, Salt Lake City, UT, USA, August 9-12, 2015 , 2015, SP/SPE.

[9]  R. Molina,et al.  Bayesian Super-Resolution image reconstruction using an ℓ1 prior , 2009, 2009 Proceedings of 6th International Symposium on Image and Signal Processing and Analysis.

[10]  Radu Horaud,et al.  Time-of-Flight Cameras: Principles, Methods and Applications , 2012 .

[11]  Aggelos K. Katsaggelos,et al.  Variational Bayesian Super Resolution , 2011, IEEE Transactions on Image Processing.

[12]  Aggelos K. Katsaggelos,et al.  Image prior combination in super-resolution image registration & reconstruction , 2010, 2010 IEEE International Workshop on Machine Learning for Signal Processing.

[13]  Radu Horaud,et al.  Time-of-Flight Cameras , 2012, SpringerBriefs in Computer Science.

[14]  Nirmal K. Bose,et al.  Recursive reconstruction of high resolution image from noisy undersampled multiframes , 1990, IEEE Trans. Acoust. Speech Signal Process..

[15]  Robert L. Stevenson,et al.  Improved definition image expansion , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[16]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[17]  Shmuel Peleg,et al.  Robust super-resolution , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[18]  Roger Y. Tsai,et al.  Multiframe image restoration and registration , 1984 .

[20]  Jerry D. Gibson,et al.  Handbook of Image and Video Processing , 2000 .

[21]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[22]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[23]  Reinhard Koch,et al.  Time-of-Flight and Depth Imaging. Sensors, Algorithms, and Applications , 2013, Lecture Notes in Computer Science.

[24]  Robert L. Stevenson,et al.  A Bayesian approach to image expansion for improved definitio , 1994, IEEE Trans. Image Process..

[25]  Peyman Milanfar,et al.  Super-resolution imaging , 2011 .

[26]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[27]  Yin Zhang,et al.  A Fast Algorithm for Image Deblurring with Total Variation Regularization , 2007 .

[28]  Maeda Shin-ichi,et al.  Bayesian image superresolution under moving occlusion , 2008 .