Improved motion estimation for restoring turbulence-distorted video

Artificial displacement (the apparent motion of stationary objects) is one important component of atmospheric turbulence distortion, which has led many researchers to propose motion compensation as a solution. Defining a sufficiently dense set of motion estimates for successful restoration is challenging, particularly for time sensitive applications. We introduce a new, control grid implementation of optical flow that allows for rapid and analytical solutions to the motion estimation problem. Our results demonstrate the effectiveness of using the resulting motion field for removing articial displacements in turbulence distorted videos.

[1]  Bernd Girod,et al.  Motion Analysis and Image Sequence Processing , 1993 .

[2]  Mikhail S. Belen'kii.  Effect of the inner scale of turbulence on the atmospheric modulation transfer function , 1996 .

[3]  P. A. Sarginson.  MPEG-2: a tutorial introduction to the systems layer , 1995 .

[4]  Mark J. T. Smith,et al.  A new method for suppressing optical turbulence in video , 2005, 2005 13th European Signal Processing Conference.

[5]  Mark J. T. Smith,et al.  Suppression of atmospheric turbulence in video using an adaptive control grid interpolation approach , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[6]  R. Muller,et al.  Real-time correction of atmospherically degraded telescope images through image sharpening , 1974 .

[7]  A. Murat Tekalp,et al.  Digital Video Processing , 1995 .

[8]  Richard Barakat,et al.  Partial atmospheric correction with adaptive optics , 1987 .

[9]  Mark J. T. Smith,et al.  A New Method for Registration-Based Medical Image Interpolation , 2008, IEEE Transactions on Medical Imaging.

[10]  Norman S. Kopeika,et al.  Restoration of thermal images distorted by the atmosphere, based on measured and theoretical atmospheric modulation transfer function , 1994 .

[11]  Mark J. T. Smith,et al.  Low-bit-rate video coding using an adaptive partially connected motion model , 1997, Electronic Imaging.

[12]  Cheng-Kok Koh,et al.  Numerically Stable Algorithms for Inversion of Block Tridiagonal and Banded Matrices , 2007 .

[13]  Zhiying Wen,et al.  Bicoherence Used to Predict Lucky Regions in Turbulence Affected Surveillance , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[14]  Jérôme Gilles,et al.  Non rigid geometric distortions correction - Application to atmospheric turbulence stabilization , 2012 .

[15]  Norman S. Kopeika,et al.  Restoration of thermal images distorted by the atmosphere, using predicted atmospheric modulation transfer function , 1995 .

[16]  N S Kopeika,et al.  Aerosol and turbulence modulation transfer functions: comparison measurements in the open atmosphere. , 1992, Optics letters.

[17]  Mark J. T. Smith,et al.  Tracking ballistic missile warheads using a generalized motion model , 1997, Defense, Security, and Sensing.

[18]  Michael C. Roggemann,et al.  Image reconstruction by means of wave-front sensor measurements in closed-loop adaptive-optics systems , 1993 .