Video stabilization in atmosphere turbulent conditions based on the Laplacian-Riesz pyramid.

Video stabilization in atmosphere turbulent conditions is aimed at removing spatiotemporally varying distortions from video recordings. Conventional shaky video stabilization approaches do not perform effectively under turbulent circumstances due to the erratic motion common to those conditions. Using complex-valued image pyramids, we propose a method to mitigate this erratic motion in videos. First, each frame of a video is decomposed into different spatial frequencies using the Laplacian pyramid. Second, a Riesz transform is adopted to extract the local amplitude and the local phase of each sub-band. Next, low-pass filters are designed to attenuate the local amplitude and phase variations to remove turbulence-induced distortions. Experimental results show that the proposed approach is efficient and provides stabilizing video in atmosphere turbulent conditions.

[1]  I Ideses,et al.  Superresolution in turbulent videos: making profit from damage. , 2007, Optics letters.

[2]  Michael Felsberg,et al.  The monogenic signal , 2001, IEEE Trans. Signal Process..

[3]  Endre Repasi,et al.  Analysis of image distortions by atmospheric turbulence and computer simulation of turbulence effects , 2008, SPIE Defense + Commercial Sensing.

[4]  Frédo Durand,et al.  Phase-based video motion processing , 2013, ACM Trans. Graph..

[5]  Xu Zhou,et al.  Variational Bayesian Blind Image Deconvolution: A review , 2015, Digit. Signal Process..

[6]  Steven J. Simske,et al.  Atmospheric Turbulence-Degraded Image Restoration Using Principal Components Analysis , 2007, IEEE Geoscience and Remote Sensing Letters.

[7]  Xiang Zhu,et al.  Removing Atmospheric Turbulence via Space-Invariant Deconvolution , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  I. Dror,et al.  Experimental comparison of turbulence modulation transfer function and aerosol modulation transfer function through the open atmosphere , 1995 .

[9]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[10]  Nahum Kiryati,et al.  Progress in the restoration of image sequences degraded by atmospheric turbulence , 2014, Pattern Recognit. Lett..

[11]  James G. Nagy,et al.  High-resolution speckle imaging through strong atmospheric turbulence. , 2016, Optics express.

[12]  Xin Li,et al.  Simultaneous Video Stabilization and Moving Object Detection in Turbulence , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Robyn A. Owens,et al.  Feature detection from local energy , 1987, Pattern Recognit. Lett..

[14]  Gleb Vdovin,et al.  Speckle imaging through turbulent atmosphere based on adaptable pupil segmentation. , 2011, Optics letters.

[15]  Nick G. Kingsbury,et al.  Atmospheric Turbulence Mitigation Using Complex Wavelet-Based Fusion , 2013, IEEE Transactions on Image Processing.

[16]  Stefano Soatto,et al.  Video stabilization of atmospheric turbulence distortion , 2013 .

[17]  Endre Repasi,et al.  Computer simulation of image degradations by atmospheric turbulence for horizontal views , 2011, Defense + Commercial Sensing.