Correction of geometrically distorted underwater images using shift map analysis.

In underwater imaging, water waves cause severe geometric distortions and blurring of the acquired short-exposure images. Corrections for these distortions have been tackled reasonably well by previous efforts but still need improvement in the estimation of pixel shift maps to increase restoration accuracy. This paper presents a new algorithm that efficiently estimates the shift maps from geometrically distorted video sequences and uses those maps to restore the sequences. A nonrigid image registration method is employed to estimate the shift maps of the distorted frames against a reference frame. The sharpest frame of the sequence, determined using a sharpness metric, is chosen as the reference frame. A k-means clustering technique is employed to discard too-blurry frames that could result in inaccuracy in the shift maps' estimation. The estimated pixel shift maps are processed to generate the accurate shift map that is used to dewarp the input frames into their nondistorted forms. The proposed method is applied on several synthetic and real-world video sequences, and the obtained results exhibit significant improvements over the state-of-the-art methods.

[1]  Adrian Galdran,et al.  Automatic Red-Channel underwater image restoration , 2015, J. Vis. Commun. Image Represent..

[2]  Eraldo Ribeiro,et al.  Classification of Textures Distorted by WaterWaves , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[3]  Andrew Lambert,et al.  Bispectral analysis and recovery of images distorted by a moving water surface. , 2010, Applied optics.

[4]  Alexei A. Efros,et al.  Seeing through water , 2004, NIPS.

[5]  Yuandong Tian,et al.  Seeing through water: Image restoration using model-based tracking , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[6]  D. M. Milder,et al.  Reconstruction of through-surface underwater imagery , 2006 .

[7]  Guoyu Wang,et al.  Estimation-based approach for underwater image restoration. , 2011, Optics letters.

[8]  Weilin Hou,et al.  A simple underwater imaging model. , 2009, Optics letters.

[9]  Frédéric Galland,et al.  Influence of polarization filtering on image registration precision in underwater conditions. , 2012, Optics letters.

[10]  C. Cox Slopes of the sea surface deduced from photographs of sun glitter , 1956 .

[11]  Mubarak Shah,et al.  A two-stage reconstruction approach for seeing through water , 2011, CVPR 2011.

[12]  A. N. Rajagopalan,et al.  Deskewing of Underwater Images , 2015, IEEE Transactions on Image Processing.

[13]  Yuandong Tian,et al.  Globally Optimal Estimation of Nonrigid Image Distortion , 2012, International Journal of Computer Vision.

[14]  Stanley Osher,et al.  Wavelet burst accumulation for turbulence mitigation , 2016, J. Electronic Imaging.

[15]  S. Gabarda,et al.  Blind image quality assessment through anisotropy. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[16]  Weilin Hou,et al.  Restoration of turbulence degraded underwater images , 2012 .

[17]  Eric Brassart,et al.  Colour Image Segmentation Using Homogeneity Method and Data Fusion Techniques , 2010, EURASIP J. Adv. Signal Process..

[18]  Sreenatha G. Anavatti,et al.  Simple algorithm for correction of geometrically warped underwater images , 2014 .

[19]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[20]  D. Fraser,et al.  Restoration of Non-Uniformly Warped Images Using a Typical Frame as Prototype , 2005, TENCON 2005 - 2005 IEEE Region 10 Conference.

[21]  Johan A. K. Suykens,et al.  Optimized Data Fusion for Kernel k-Means Clustering , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Xin Li,et al.  Simultaneous Video Stabilization and Moving Object Detection in Turbulence , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Andrew Lambert,et al.  Restoring atmospheric-turbulence-degraded images. , 2016, Applied optics.

[24]  Andriy Myronenko,et al.  Intensity-Based Image Registration by Minimizing Residual Complexity , 2010, IEEE Transactions on Medical Imaging.

[25]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[26]  Stella Yu,et al.  Angular Embedding: A Robust Quadratic Criterion , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Eraldo Ribeiro,et al.  Improved reconstruction of images distorted by water waves , 2006, VISAPP.

[28]  Kalyan Kumar Halder,et al.  Geometric correction of atmospheric turbulence-degraded video containing moving objects. , 2015, Optics express.

[29]  Hiroshi Murase,et al.  Surface Shape Reconstruction of a Nonrigid Transport Object Using Refraction and Motion , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Raimondo Schettini,et al.  Underwater Image Processing: State of the Art of Restoration and Image Enhancement Methods , 2010, EURASIP J. Adv. Signal Process..

[31]  J. C. Dainty,et al.  Low-order adaptive optics: a possible use in underwater imaging? , 1997 .