Removing Atmospheric Turbulence Effects in Unified Complex Steerable Pyramid Framework

Simultaneously removing atmospheric turbulence-induced geometric distortion and blurry degradation is a challenging task. In this paper, we propose an effective method to remove or at least reduce turbulence effects in unified complex steerable pyramid (CSP) framework. The proposed method first decomposes the degraded image sequence by CSP. Then, the local motion and the energy information of the image sequence can be represented by multiscale and multidirectional phases and amplitudes. To mitigate turbulence-induced random oscillation, we use temporal average phase as the initial reference phase. Then, the reference phase is iteratively corrected, using the proposed phase correction method which is capable of correcting the large displacement. To reduce blurry degradation, optimal amplitude selection and fusion methods are proposed to reduce blur variation and CSP reconstruction errors. Finally, the corrected phase and fused amplitude can be synthesized to generate a reconstructed image. To further enhance the image quality, a blind deconvolution approach is adopted to deblur the reconstructed image. Through a variety of experiments on the simulated and real data, experimental results show that the proposed method can effectively alleviate the turbulence effects, recover image details, and significantenhance visual quality.

[1]  Lok Ming Lui,et al.  Restoration of atmospheric turbulence-distorted images via RPCA and quasiconformal maps , 2017, Inverse Problems.

[2]  Manoranjan Paul,et al.  Correction of geometrically distorted underwater images using shift map analysis. , 2017, Journal of the Optical Society of America. A, Optics, image science, and vision.

[3]  Hongyu Li,et al.  SR-SIM: A fast and high performance IQA index based on spectral residual , 2012, 2012 19th IEEE International Conference on Image Processing.

[4]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[5]  Hernan D. Benítez-Restrepo,et al.  Non-reference assessment of sharpness in blur/noise degraded images , 2016, J. Vis. Commun. Image Represent..

[6]  Laurie Davies,et al.  The identification of multiple outliers , 1993 .

[7]  M A Vorontsov,et al.  Anisoplanatic imaging through turbulent media: image recovery by local information fusion from a set of short-exposure images. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[8]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, ACM Trans. Graph..

[9]  Stanley Osher,et al.  Wavelet burst accumulation for turbulence mitigation , 2016, J. Electronic Imaging.

[10]  Junshan Li,et al.  Image restoration from sequences under atmospheric turbulence effects , 2017, Applied Optics and Photonics China.

[11]  K. K. Halder,et al.  Simple and efficient approach for restoration of non-uniformly warped images. , 2014, Applied optics.

[12]  Jérôme Gilles,et al.  Non rigid geometric distortions correction - Application to atmospheric turbulence stabilization , 2012 .

[13]  Sreenatha G. Anavatti,et al.  Moving object detection and tracking in videos through turbulent medium , 2016 .

[14]  Enric Meinhardt,et al.  Implementation of the Centroid Method for the Correction of Turbulence , 2014, Image Process. Line.

[15]  Bernhard Schölkopf,et al.  Efficient filter flow for space-variant multiframe blind deconvolution , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  J. Pearson,et al.  Atmospheric turbulence compensation using coherent optical adaptive techniques. , 1976, Applied optics.

[17]  Mubarak Shah,et al.  A two-stage reconstruction approach for seeing through water , 2011, CVPR 2011.

[18]  Yuan Xie,et al.  Removing Turbulence Effect via Hybrid Total Variation and Deformation-Guided Kernel Regression , 2016, IEEE Transactions on Image Processing.

[19]  Xiang Zhu,et al.  Removing Atmospheric Turbulence via Space-Invariant Deconvolution , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  William T. Freeman,et al.  Presented at: 2nd Annual IEEE International Conference on Image , 1995 .

[21]  Masatoshi Okutomi,et al.  Super-resolution from image sequence under influence of hot-air optical turbulence , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[23]  Xiangzhi Bai,et al.  Video stabilization in atmosphere turbulent conditions based on the Laplacian-Riesz pyramid. , 2016, Optics express.

[24]  Andrew Lambert,et al.  Restoring atmospheric-turbulence-degraded images. , 2016, Applied optics.

[25]  Zhou Wang,et al.  Multi-scale structural similarity for image quality assessment , 2003 .

[26]  Kalyan Kumar Halder,et al.  Geometric correction of atmospheric turbulence-degraded video containing moving objects. , 2015, Optics express.

[27]  Nick G. Kingsbury,et al.  Atmospheric Turbulence Mitigation Using Complex Wavelet-Based Fusion , 2013, IEEE Transactions on Image Processing.

[28]  Stefano Soatto,et al.  Video stabilization of atmospheric turbulence distortion , 2013 .

[29]  Robert K. Tyson,et al.  Adaptive optics compensation of atmospheric turbulence: the past, the present, and the promise , 1994, Defense, Security, and Sensing.

[30]  Nafiz Arica,et al.  Atmospheric Turbulence Mitigation Using Optical Flow , 2014, 2014 22nd International Conference on Pattern Recognition.

[31]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[32]  Endre Repasi,et al.  Analysis of image distortions by atmospheric turbulence and computer simulation of turbulence effects , 2008, SPIE Defense + Commercial Sensing.

[33]  Frédo Durand,et al.  Phase-based video motion processing , 2013, ACM Trans. Graph..