Restoration of non-uniformly warped noisy images based on coarse-to-fine optical flow estimation

This paper proposes a high accuracy and fast image restoration approach to restore a sequence of atmospheric turbulence degraded frames of a remote object or scene. A coarse-to-fine optical flow technique is employed to estimate the dense motion fields of the frames against a reference frame. The First Register Then Average And Subtract (FRTAAS) method is used to correct the geometric distortions and restore a high quality sequence. Finally, a non-local means filter is applied to extract noise from each frame of the sequence. A performance comparison is presented between the proposed restoration method and an earlier method in terms of computational time and accuracy. The effectiveness of the proposed approach is demonstrated on both synthetic and real-life videos.

[1]  Andrew Lambert,et al.  Application of Optical Flow Techniques in the Restoration of Non-Uniformly Warped Images , 2002 .

[2]  Claudia S. Huebner,et al.  Blind deconvolution algorithms for the restoration of atmospherically degraded imagery: a comparative analysis , 2008, Remote Sensing.

[3]  D. Fraser,et al.  Restoration of Non-Uniformly Warped Images Using a Typical Frame as Prototype , 2005, TENCON 2005 - 2005 IEEE Region 10 Conference.

[4]  Xiang Zhu,et al.  Image reconstruction from videos distorted by atmospheric turbulence , 2010, Electronic Imaging.

[5]  Robert K. Tyson Introduction to Adaptive Optics , 2000 .

[6]  Thomas Brox,et al.  High Accuracy Optical Flow Estimation Based on a Theory for Warping , 2004, ECCV.

[7]  Andrew Lambert,et al.  Restoration of nonuniformly warped images using accurate frame by frame shiftmap accumulation , 2006, SPIE Optics + Photonics.

[8]  Jp Delport Scintillation mitigation for long-range surveillance video , 2010 .

[9]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Sreenatha G. Anavatti,et al.  A fast restoration method for atmospheric turbulence degraded images using non-rigid image registration , 2013, 2013 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[11]  Hai Liu,et al.  Atmospheric-Turbulence-Degraded Astronomical Image Restoration by Minimizing Second-Order Central Moment , 2012, IEEE Geoscience and Remote Sensing Letters.

[12]  John Immerkær,et al.  Fast Noise Variance Estimation , 1996, Comput. Vis. Image Underst..

[13]  Steven J. Simske,et al.  Atmospheric Turbulence-Degraded Image Restoration Using Principal Components Analysis , 2007, IEEE Geoscience and Remote Sensing Letters.

[14]  Ce Liu,et al.  Exploring new representations and applications for motion analysis , 2009 .

[15]  Yu Mao,et al.  Turbulence stabilization , 2012, Defense, Security, and Sensing.

[16]  A. Lambert,et al.  Atmospheric turbulence visualization with wide-area motion-blur restoration , 1999 .

[17]  Shixue Zhang,et al.  Astronomical image restoration through atmosphere turbulence by lucky imaging , 2011, International Conference on Digital Image Processing.

[18]  Fred Nicolls,et al.  A study of the sensitivity of long-range passive ranging techniques to atmospheric scintillation , 2012, Defense + Commercial Sensing.