Joint regularization and low-rank fusion for atmospheric turbulence removal

Atmospheric turbulence removal remains a challenging task, because it is very difficult to mitigate geometric distortion and remove spatially and temporally variant blur. This paper presents a novel strategy for atmospheric turbulence removal by characterizing local smoothness, nonlocal similarity and low-rank property of natural images. The main contributions are three folds. First, a joint regularization model is made which combines nonlocal total variation regularization and steering kernel regression total variation regularization in order that reference image enhancement and image registration are jointly implemented on geometric distortion reduction. Secondly, a fast split Bregman iteration algorithm is designed to address the joint variation optimization problem. Finally, a weighted nuclear norm is introduced to constrain the low-rank optimization problem to reduce blur variation and generate a fusion image. Extensive experimental results show that our method can effectively mitigate geometric deformation as well as blur variations and that it outperforms several other state-of-the-art turbulence removal methods.

[1]  Michael F. Cohen,et al.  Seeing Mt. Rainier: Lucky imaging for multi-image denoising, sharpening, and haze removal , 2010, 2010 IEEE International Conference on Computational Photography (ICCP).

[2]  Liangpei Zhang,et al.  Hyperspectral Image Denoising With a Spatial–Spectral View Fusion Strategy , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Jérôme Gilles,et al.  Non rigid geometric distortions correction - Application to atmospheric turbulence stabilization , 2012 .

[4]  David Zhang,et al.  Fast block-based image restoration employing the improved best neighborhood matching approach , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[5]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[6]  Andrew Lambert,et al.  Self-tuning Kalman filter estimation of atmospheric warp , 2008, Optical Engineering + Applications.

[7]  Mikhail A. Vorontsov,et al.  Automated video enhancement from a stream of atmospherically-distorted images: the lucky-region fusion approach , 2009, Optical Engineering + Applications.

[8]  Guy Gilboa,et al.  Nonlocal Operators with Applications to Image Processing , 2008, Multiscale Model. Simul..

[9]  Thomas G. Stockham,et al.  High-speed convolution and correlation , 1966, AFIPS '66 (Spring).

[10]  Mubarak Shah,et al.  A two-stage reconstruction approach for seeing through water , 2011, CVPR 2011.

[11]  M A Vorontsov,et al.  Anisoplanatic imaging through turbulent media: image recovery by local information fusion from a set of short-exposure images. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[12]  Jean-Luc Starck,et al.  Deconvolution and Blind Deconvolution in Astronomy , 2007 .

[13]  Xiang Zhu,et al.  Removing Atmospheric Turbulence via Space-Invariant Deconvolution , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Tie Qiu,et al.  A Review on Intelligence Dehazing and Color Restoration for Underwater Images , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[15]  Yuan Xie,et al.  Hyperspectral Image Restoration via Iteratively Regularized Weighted Schatten $p$-Norm Minimization , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Rafael Molina,et al.  Image restoration in astronomy: a Bayesian perspective , 2001, IEEE Signal Process. Mag..

[17]  Michael C. Roggemann,et al.  Image-spectrum signal-to-noise-ratio improvements by statistical frame selection for adaptive-optics imaging through atmospheric turbulence , 1994 .

[18]  Yan Liang,et al.  Nonlocal Spectral Prior Model for Low-Level Vision , 2012, ACCV.

[19]  Peyman Milanfar,et al.  Kernel Regression for Image Processing and Reconstruction , 2007, IEEE Transactions on Image Processing.

[20]  Suvrit Sra,et al.  Online blind deconvolution for astronomical imaging , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[21]  D. Fried Probability of getting a lucky short-exposure image through turbulence* , 1978 .

[22]  Bernhard Schölkopf,et al.  Efficient filter flow for space-variant multiframe blind deconvolution , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Lei Zhang,et al.  Weighted Nuclear Norm Minimization with Application to Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Sung-Bae Cho,et al.  A Novel Evolutionary Approach to Image Enhancement Filter Design: Method and Applications , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  Robert N. Tubbs,et al.  Lucky Exposures:: Diffraction Limited Astronomical Imaging through the Atmosphere , 2003 .

[26]  Andriy Myronenko,et al.  Intensity-Based Image Registration by Minimizing Residual Complexity , 2010, IEEE Transactions on Medical Imaging.

[27]  Masatoshi Okutomi,et al.  Super-resolution from image sequence under influence of hot-air optical turbulence , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  David R. Thompson,et al.  Real-Time Atmospheric Correction of AVIRIS-NG Imagery , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Yuan Xie,et al.  Removing Turbulence Effect via Hybrid Total Variation and Deformation-Guided Kernel Regression , 2016, IEEE Transactions on Image Processing.

[30]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, ACM Trans. Graph..

[31]  Steven J. Simske,et al.  Atmospheric Turbulence-Degraded Image Restoration Using Principal Components Analysis , 2007, IEEE Geoscience and Remote Sensing Letters.

[32]  James G. Nagy,et al.  Fast iterative image restoration with a spatially varying PSF , 1997, Optics & Photonics.

[33]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[34]  Xiang Zhu,et al.  Image reconstruction from videos distorted by atmospheric turbulence , 2010, Electronic Imaging.