Comparison of turbulence mitigation algorithms

When capturing image data over long distances (0.5 km and above), images are often degraded by atmospheric turbulence, especially when imaging paths are close to the ground or in hot environments. These issues manifest as time-varying scintillation and warping effects that decrease the effective resolution of the sensor and reduce actionable intelligence. In recent years, several image processing approaches to turbulence mitigation have shown promise. Each of these algorithms have different computational requirements, usability demands, and degrees of independence from camera sensors. They also produce different degrees of enhancement when applied to turbulent imagery. Additionally, some of these algorithms are applicable to real-time operational scenarios while others may only be suitable for post-processing workflows. EM Photonics has been developing image-processing-based turbulence mitigation technology since 2005 as a part of our ATCOM [1] image processing suite. In this paper we will compare techniques from the literature with our commercially available real-time GPU accelerated turbulence mitigation software suite, as well as in-house research algorithms. These comparisons will be made using real, experimentally-obtained data for a variety of different conditions, including varying optical hardware, imaging range, subjects, and turbulence conditions. Comparison metrics will include image quality, video latency, computational complexity, and potential for real-time operation.

[1]  Carmen J. Carrano Speckle imaging over horizontal paths , 2002, SPIE Optics + Photonics.

[2]  Nobuhiko Hata,et al.  Graphics Processing Unit-Accelerated Nonrigid Registration of MR Images to CT Images During CT-Guided Percutaneous Liver Tumor Ablations. , 2015, Academic radiology.

[3]  D. Fried Optical Resolution Through a Randomly Inhomogeneous Medium for Very Long and Very Short Exposures , 1966 .

[4]  Mikhail A. Vorontsov,et al.  Automated video enhancement from a stream of atmospherically-distorted images: the lucky-region fusion approach , 2009, Optical Engineering + Applications.

[5]  C. R. de Boer,et al.  Noise filtering in solar speckle masking reconstructions , 1996 .

[6]  Eric J. Kelmelis,et al.  Real-time embedded atmospheric compensation for long-range imaging using the average bispectrum speckle method , 2009, Electronic Imaging.

[7]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, ACM Trans. Graph..

[8]  Fouad Kiamilev,et al.  Hardware acceleration of lucky-region fusion (LRF) algorithm for high-performance real-time video processing , 2015, Defense + Security Symposium.

[9]  Xiang Zhu,et al.  Removing Atmospheric Turbulence via Space-Invariant Deconvolution , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Xiang Zhu,et al.  Image reconstruction from videos distorted by atmospheric turbulence , 2010, Electronic Imaging.

[11]  Aaron Paolini,et al.  ATCOM: accelerated image processing for terrestrial long-range imaging through atmospheric effects , 2013, Defense, Security, and Sensing.

[12]  Mathieu Aubailly,et al.  Hardware acceleration of lucky-region fusion (LRF) algorithm for imaging , 2014, Defense + Security Symposium.

[13]  K. Knox,et al.  Recovery of Images from Atmospherically Degraded Short-Exposure Photographs , 1974 .

[14]  Eric J. Kelmelis,et al.  Real-time technology for enhancing long-range imagery , 2015, Defense + Security Symposium.