Comparison of turbulence mitigation algorithms

Abstract. When capturing imagery over long distances, atmospheric turbulence often degrades the data, especially when observation paths are close to the ground or in hot environments. These issues manifest as time-varying scintillation and warping effects that decrease the effective resolution of the sensor and reduce actionable intelligence. In recent years, several image processing approaches to turbulence mitigation have shown promise. Each of these algorithms has different computational requirements, usability demands, and degrees of independence from camera sensors. They also produce different degrees of enhancement when applied to turbulent imagery. Additionally, some of these algorithms are applicable to real-time operational scenarios while others may only be suitable for postprocessing workflows. EM Photonics has been developing image-processing-based turbulence mitigation technology since 2005. We will compare techniques from the literature with our commercially available, real-time, GPU-accelerated turbulence mitigation software. These comparisons will be made using real (not synthetic), experimentally obtained data for a variety of conditions, including varying optical hardware, imaging range, subjects, and turbulence conditions. Comparison metrics will include image quality, video latency, computational complexity, and potential for real-time operation. Additionally, we will present a technique for quantitatively comparing turbulence mitigation algorithms using real images of radial resolution targets.

[1]  D. Fried Probability of getting a lucky short-exposure image through turbulence* , 1978 .

[2]  Fouad Kiamilev,et al.  Hardware acceleration of lucky-region fusion (LRF) algorithm for high-performance real-time video processing , 2015, Defense + Security Symposium.

[3]  Andrew Lambert,et al.  Bicoherence: a new lucky region technique in anisoplanatic image restoration. , 2009, Applied optics.

[4]  Carmen J. Carrano Speckle imaging over horizontal paths , 2002, SPIE Optics + Photonics.

[5]  Dan Slater High resolution long range terrestrial imaging , 2005, SPIE Optics + Photonics.

[6]  Xiang Zhu,et al.  Image reconstruction from videos distorted by atmospheric turbulence , 2010, Electronic Imaging.

[7]  Hongdong Li,et al.  Reconstruction of Underwater Image by Bispectrum , 2007, 2007 IEEE International Conference on Image Processing.

[8]  Eric J. Kelmelis,et al.  Real-time embedded atmospheric compensation for long-range imaging using the average bispectrum speckle method , 2009, Electronic Imaging.

[9]  Carmen J. Carrano Anisoplanatic performance of horizontal-path speckle imaging , 2003, SPIE Optics + Photonics.

[10]  C. R. de Boer,et al.  Noise filtering in solar speckle masking reconstructions , 1996 .

[11]  Kevin R. Leonard,et al.  Novel methodologies for the measurement of atmospheric turbulence effects , 2010, Defense + Commercial Sensing.

[12]  D. Korff,et al.  Analysis of a method for obtaining near-diffraction-limited information in the presence of atmospheric turbulence , 1973 .

[13]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, ACM Trans. Graph..

[14]  Erik M. Johansson,et al.  Speckle imaging of satellites , 1991 .

[15]  Michael C. Roggemann,et al.  A comparison of the mean square error performance of speckle and MFBD image reconstruction techniques under anisoplanatic long-horizontal-path imaging , 2013, Defense, Security, and Sensing.

[16]  Eric J. Kelmelis,et al.  Comparison of turbulence mitigation algorithms , 2016, SPIE Defense + Security.

[17]  Mikhail A. Vorontsov,et al.  Automated video enhancement from a stream of atmospherically-distorted images: the lucky-region fusion approach , 2009, Optical Engineering + Applications.

[18]  Zhiying Wen,et al.  Bicoherence Used to Predict Lucky Regions in Turbulence Affected Surveillance , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[19]  K. Knox,et al.  Recovery of Images from Atmospherically Degraded Short-Exposure Photographs , 1974 .

[20]  Kevin R. Leonard,et al.  DARPA super resolution vision system (SRVS) robust turbulence data collection and analysis , 2014, Defense + Security Symposium.

[21]  Xiang Zhu,et al.  Removing Atmospheric Turbulence via Space-Invariant Deconvolution , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Mathieu Aubailly,et al.  Hardware acceleration of lucky-region fusion (LRF) algorithm for imaging , 2014, Defense + Security Symposium.

[23]  S Yang,et al.  Modulation Transfer Function Measurement Using Three- and Four-bar Targets. , 1995, Applied optics.

[24]  Nobuhiko Hata,et al.  Graphics Processing Unit-Accelerated Nonrigid Registration of MR Images to CT Images During CT-Guided Percutaneous Liver Tumor Ablations. , 2015, Academic radiology.

[25]  D. Fried Optical Resolution Through a Randomly Inhomogeneous Medium for Very Long and Very Short Exposures , 1966 .

[26]  Andrew Lambert,et al.  Bispectral analysis and recovery of images distorted by a moving water surface. , 2010, Applied optics.

[27]  M A Vorontsov,et al.  Anisoplanatic imaging through turbulent media: image recovery by local information fusion from a set of short-exposure images. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.