Atmospheric Turbulence Mitigation Using Complex Wavelet-Based Fusion

Restoring a scene distorted by atmospheric turbulence is a challenging problem in video surveillance. The effect, caused by random, spatially varying, perturbations, makes a model-based solution difficult and in most cases, impractical. In this paper, we propose a novel method for mitigating the effects of atmospheric distortion on observed images, particularly airborne turbulence which can severely degrade a region of interest (ROI). In order to extract accurate detail about objects behind the distorting layer, a simple and efficient frame selection method is proposed to select informative ROIs only from good-quality frames. The ROIs in each frame are then registered to further reduce offsets and distortions. We solve the space-varying distortion problem using region-level fusion based on the dual tree complex wavelet transform. Finally, contrast enhancement is applied. We further propose a learning-based metric specifically for image quality assessment in the presence of atmospheric distortion. This is capable of estimating quality in both full- and no-reference scenarios. The proposed method is shown to significantly outperform existing methods, providing enhanced situational awareness in a range of surveillance scenarios.

[1]  R. Gregory A Technique for Minimizing the Effects of Atmospheric Disturbance on Photographic Telescopes , 1964, Nature.

[2]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[3]  Richard G. Lane,et al.  Blind deconvolution of noisy complex-valued image , 1989 .

[4]  Karel J. Zuiderveld,et al.  Contrast Limited Adaptive Histogram Equalization , 1994, Graphics Gems.

[5]  L. Andrews,et al.  Theory of optical scintillation , 1999 .

[6]  Lam,et al.  Iterative statistical approach to blind image deconvolution , 2000, Journal of the Optical Society of America. A, Optics, image science, and vision.

[7]  Zhou Wang,et al.  No-reference perceptual quality assessment of JPEG compressed images , 2002, Proceedings. International Conference on Image Processing.

[8]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[9]  Gemma Piella,et al.  A general framework for multiresolution image fusion: from pixels to regions , 2003, Inf. Fusion.

[10]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[11]  Timur E. Gureyev,et al.  Image deblurring by means of defocus , 2004 .

[12]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[13]  David R. Bull,et al.  Combined morphological-spectral unsupervised image segmentation , 2005, IEEE Transactions on Image Processing.

[14]  Alan C. Bovik,et al.  No-reference quality assessment using natural scene statistics: JPEG2000 , 2005, IEEE Transactions on Image Processing.

[15]  Richard Baraniuk,et al.  The Dual-tree Complex Wavelet Transform , 2007 .

[16]  Zhiying Wen,et al.  Bicoherence Used to Predict Lucky Regions in Turbulence Affected Surveillance , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[17]  Sheila S. Hemami,et al.  VSNR: A Wavelet-Based Visual Signal-to-Noise Ratio for Natural Images , 2007, IEEE Transactions on Image Processing.

[18]  Cedric Nishan Canagarajah,et al.  Pixel- and region-based image fusion with complex wavelets , 2007, Inf. Fusion.

[19]  S. Gabarda,et al.  Blind image quality assessment through anisotropy. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[20]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, ACM Trans. Graph..

[21]  Tristan Dagobert,et al.  Atmospheric Turbulence Restoration by Diffeomorphic Image Registration and Blind Deconvolution , 2008, ACIVS.

[22]  Harbinder S. Rana Towards generic military imaging adaptive optics , 2008, Security + Defence.

[23]  Dalong Li,et al.  Suppressing atmospheric turbulent motion in video through trajectory smoothing , 2009, Signal Process..

[24]  Mikhail A. Vorontsov,et al.  Automated video enhancement from a stream of atmospherically-distorted images: the lucky-region fusion approach , 2009, Optical Engineering + Applications.

[25]  Peter Carr,et al.  Improved Single Image Dehazing Using Geometry , 2009, 2009 Digital Image Computing: Techniques and Applications.

[26]  Claudia S. Huebner Compensating image degradation due to atmospheric turbulence in anisoplanatic conditions , 2009, Defense + Commercial Sensing.

[27]  Jian Sun,et al.  Single image haze removal using dark channel prior , 2009, CVPR.

[28]  Cedric Nishan Canagarajah,et al.  Segmentation-Driven Image Fusion Based on Alpha-Stable Modeling of Wavelet Coefficients , 2009, IEEE Transactions on Multimedia.

[29]  Michael F. Cohen,et al.  Seeing Mt. Rainier: Lucky imaging for multi-image denoising, sharpening, and haze removal , 2010, 2010 IEEE International Conference on Computational Photography (ICCP).

[30]  Xiang Zhu,et al.  Image reconstruction from videos distorted by atmospheric turbulence , 2010, Electronic Imaging.

[31]  Alan C. Bovik,et al.  A Two-Step Framework for Constructing Blind Image Quality Indices , 2010, IEEE Signal Processing Letters.

[32]  Jp Delport Scintillation mitigation for long-range surveillance video , 2010 .

[33]  Cedric Nishan Canagarajah,et al.  Non-Gaussian model-based fusion of noisy images in the wavelet domain , 2010, Comput. Vis. Image Underst..

[34]  Bernhard Schölkopf,et al.  Efficient filter flow for space-variant multiframe blind deconvolution , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[35]  Claudia S. Huebner,et al.  Software-based mitigation of image degradation due to atmospheric turbulence , 2010, Remote Sensing.

[36]  Alan C. Bovik,et al.  Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos , 2010, IEEE Transactions on Image Processing.

[37]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[38]  Fan Zhang,et al.  A Parametric Framework for Video Compression Using Region-Based Texture Models , 2011, IEEE Journal of Selected Topics in Signal Processing.

[39]  N. Canagarajah,et al.  Segmentation of noisy colour images using cauchy distribution in the complex wavelet domain , 2011 .

[40]  Wai-kuen Cham,et al.  Single-Image Refocusing and Defocusing , 2012, IEEE Transactions on Image Processing.

[41]  Huizhong Chen,et al.  Efficient Registration of Nonrigid 3-D Bodies , 2012, IEEE Transactions on Image Processing.

[42]  Xiang Zhu,et al.  Removing Atmospheric Turbulence via Space-Invariant Deconvolution , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  R. Vijaya Durga,et al.  Region-Based Image Fusion Using Complex Wavelets , 2014 .