Removing Turbulence Effect via Hybrid Total Variation and Deformation-Guided Kernel Regression

It remains a challenge to simultaneously remove geometric distortion and space-time-varying blur in frames captured through a turbulent atmospheric medium. To solve, or at least reduce these effects, we propose a new scheme to recover a latent image from observed frames by integrating a new hybrid total variation model and deformation-guided spatial-temporal kernel regression. The proposed scheme first constructs a high-quality reference image from the observed frames using low-rank decomposition. Then, to generate an improved registered sequence, the reference image is iteratively optimized using a variational model containing the combined regularization of local and non-local total variations. The proposed optimization algorithm efficiently solves this model with convergence guarantee. Next, to reduce blur variation, deformation-guided spatial-temporal kernel regression is carried out to fuse the registered sequence into one image by introducing the concept of the near-stationary patch. Applying a blind deconvolution algorithm to the fused image produces the final output. Extensive experimental testing shows, both qualitatively and quantitatively, that the proposed method can effectively alleviate distortion, and blur and recover details of the original scene compared to the state-of-the-art methods.

[1]  Peyman Milanfar,et al.  Kernel Regression for Image Processing and Reconstruction , 2007, IEEE Transactions on Image Processing.

[2]  Yi Chang,et al.  Anisotropic Spectral-Spatial Total Variation Model for Multispectral Remote Sensing Image Destriping , 2015, IEEE Transactions on Image Processing.

[3]  Bernhard Schölkopf,et al.  Efficient filter flow for space-variant multiframe blind deconvolution , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Hanqing Zhao,et al.  A fast algorithm for the total variation model of image denoising , 2010, Adv. Comput. Math..

[5]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[6]  Andriy Myronenko,et al.  Intensity-Based Image Registration by Minimizing Residual Complexity , 2010, IEEE Transactions on Medical Imaging.

[7]  Stanley Osher,et al.  Iterative Regularization and Nonlinear Inverse Scale Space Applied to Wavelet-Based Denoising , 2007, IEEE Transactions on Image Processing.

[8]  Patrick L. Combettes,et al.  Signal Recovery by Proximal Forward-Backward Splitting , 2005, Multiscale Model. Simul..

[9]  M A Vorontsov,et al.  Anisoplanatic imaging through turbulent media: image recovery by local information fusion from a set of short-exposure images. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[10]  Thomas G. Stockham,et al.  High-speed convolution and correlation , 1966, AFIPS '66 (Spring).

[11]  Steven J. Simske,et al.  Atmospheric Turbulence-Degraded Image Restoration Using Principal Components Analysis , 2007, IEEE Geoscience and Remote Sensing Letters.

[12]  Mikhail A. Vorontsov,et al.  Automated video enhancement from a stream of atmospherically-distorted images: the lucky-region fusion approach , 2009, Optical Engineering + Applications.

[13]  Tristan Dagobert,et al.  Atmospheric Turbulence Restoration by Diffeomorphic Image Registration and Blind Deconvolution , 2008, ACIVS.

[14]  Wotao Yin,et al.  An Iterative Regularization Method for Total Variation-Based Image Restoration , 2005, Multiscale Model. Simul..

[15]  I. Dror,et al.  RESTORATION OF ATMOSPHERICALLY BLURRED IMAGES ACCORDING TO WEATHER-PREDICTED ATMOSPHERIC MODULATION TRANSFER FUNCTIONS , 1997 .

[16]  Guy Gilboa,et al.  Nonlocal Operators with Applications to Image Processing , 2008, Multiscale Model. Simul..

[17]  L. Bregman The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming , 1967 .

[18]  Xiang Zhu,et al.  Image reconstruction from videos distorted by atmospheric turbulence , 2010, Electronic Imaging.

[19]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[20]  D. Fried Probability of getting a lucky short-exposure image through turbulence* , 1978 .

[21]  S. John,et al.  Multiframe selective information fusion from robust error estimation theory , 2005, IEEE Transactions on Image Processing.

[22]  Xiang Zhu,et al.  Removing Atmospheric Turbulence via Space-Invariant Deconvolution , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Mark J. T. Smith,et al.  Suppression of atmospheric turbulence in video using an adaptive control grid interpolation approach , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[24]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[25]  J. Pearson,et al.  Atmospheric turbulence compensation using coherent optical adaptive techniques. , 1976, Applied optics.

[26]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[27]  Wotao Yin,et al.  Parametric Maximum Flow Algorithms for Fast Total Variation Minimization , 2009, SIAM J. Sci. Comput..

[28]  Barak Fishbain,et al.  Restoration of atmospheric turbulent video containing real motion using rank filtering and elastic image registration , 2004, 2004 12th European Signal Processing Conference.

[29]  Xavier Bresson,et al.  Bregmanized Nonlocal Regularization for Deconvolution and Sparse Reconstruction , 2010, SIAM J. Imaging Sci..

[30]  Mubarak Shah,et al.  A two-stage reconstruction approach for seeing through water , 2011, CVPR 2011.

[31]  Masatoshi Okutomi,et al.  Super-resolution from image sequence under influence of hot-air optical turbulence , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Michael F. Cohen,et al.  Seeing Mt. Rainier: Lucky imaging for multi-image denoising, sharpening, and haze removal , 2010, 2010 IEEE International Conference on Computational Photography (ICCP).

[33]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, ACM Trans. Graph..

[34]  Mikhail A. Vorontsov Parallel image processing based on an evolution equation with anisotropic gain: integrated optoelectronic architectures , 1999 .

[35]  Guoying Zhao,et al.  Background Subtraction Based on Low-Rank and Structured Sparse Decomposition , 2015, IEEE Transactions on Image Processing.

[36]  Bhabatosh Chanda,et al.  Super Resolution Image Reconstruction Through Bregman Iteration Using Morphologic Regularization , 2012, IEEE Transactions on Image Processing.

[37]  Nicholas M. Law,et al.  Lucky imaging: diffraction-limited astronomy from the ground in the visible , 2007 .

[38]  Jérôme Gilles,et al.  Non rigid geometric distortions correction - Application to atmospheric turbulence stabilization , 2012 .

[39]  James G. Nagy,et al.  Fast iterative image restoration with a spatially varying PSF , 1997, Optics & Photonics.

[40]  Michael C. Roggemann,et al.  Image-spectrum signal-to-noise-ratio improvements by statistical frame selection for adaptive-optics imaging through atmospheric turbulence , 1994 .

[41]  Mikhail A. Vorontsov,et al.  Image enhancement by local information fusion with pre-processing and composed metric , 2008, Optical Engineering + Applications.

[42]  Shinichiro Omachi,et al.  Asymmetric Gaussian and Its Application to Pattern Recognition , 2002, SSPR/SPR.

[43]  Lei Zhang,et al.  Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index , 2013, IEEE Transactions on Image Processing.

[44]  Robert K. Tyson,et al.  Adaptive optics compensation of atmospheric turbulence: the past, the present, and the promise , 1994, Defense, Security, and Sensing.

[45]  E. Nadaraya On Estimating Regression , 1964 .