Single-shot underwater image restoration: A visual quality-aware method based on light propagation model

Abstract In this paper, we present a novel method to restore the visual quality of images from scenes immersed in participating media, in particular water. Our method builds upon existing physics-based model and estimates the scene radiance by removing the medium interference on light propagation. Our approach requires a single image as input and, by combining a physics-based model for light propagation and a set of quality metrics, reduces the artifacts and degradation imposed by the attenuation, forward scattering, and backscattering effects. We show that the resulting images produced by our technique from underwater images are amenable to be directly used as input to algorithms which do not assume disturbances from the media. Our experiments demonstrate that, as far as visual image quality is concerned, our methodology outperforms both traditional image based restoration approaches and the state-of-the-art methods. Our approach brings advantages regarding descriptor distinctiveness which enables the use of underwater images in legacy non-participating media algorithms such as keypoint detection and description.

[1]  Jean-Philippe Tarel,et al.  Fast visibility restoration from a single color or gray level image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[2]  Chia-Chi Sung,et al.  Underwater image restoration by red-dark channel prior and point spread function deconvolution , 2015, 2015 IEEE International Conference on Signal and Image Processing Applications (ICSIPA).

[3]  Jules S. Jaffe,et al.  Computer modeling and the design of optimal underwater imaging systems , 1990 .

[4]  Jian Sun,et al.  Single image haze removal using dark channel prior , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Arcot Sowmya,et al.  An Underwater Color Image Quality Evaluation Metric , 2015, IEEE Transactions on Image Processing.

[6]  Christophe De Vleeschouwer,et al.  Multi-scale underwater descattering , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[7]  Adrian Galdran,et al.  Automatic Red-Channel underwater image restoration , 2015, J. Vis. Commun. Image Represent..

[8]  Codruta O. Ancuti,et al.  Enhancing underwater images and videos by fusion , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Paulo Drews,et al.  Automatic restoration of underwater monocular sequences of images , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[10]  F. W. Gembicki,et al.  Vector optimization for control with performance and parameter sensitivity indices , 1974 .

[11]  Robert D. Ballard,et al.  Design and implementation of advanced underwater imaging systems for deep sea marine archaeological surveys , 2000, OCEANS 2000 MTS/IEEE Conference and Exhibition. Conference Proceedings (Cat. No.00CH37158).

[12]  Gian Luca Foresti,et al.  Visual inspection of sea bottom structures by an autonomous underwater vehicle , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[13]  Donna M. Kocak,et al.  A Focus on Recent Developments and Trends in Underwater Imaging , 2008 .

[14]  Yung-fu Chen,et al.  Underwater Image Enhancement: Using Wavelength Compensation and Image Dehazing (WCID) , 2011, ACIVS.

[15]  Y.Y. Schechner,et al.  Recovery of underwater visibility and structure by polarization analysis , 2005, IEEE Journal of Oceanic Engineering.

[16]  Xin Wang,et al.  Blind Image Quality Assessment for Measuring Image Blur , 2008, 2008 Congress on Image and Signal Processing.

[17]  Raimondo Schettini,et al.  Underwater Image Processing: State of the Art of Restoration and Image Enhancement Methods , 2010, EURASIP J. Adv. Signal Process..

[18]  Bülent Sankur,et al.  Statistical evaluation of image quality measures , 2002, J. Electronic Imaging.

[19]  Mario Fernando Montenegro Campos,et al.  Underwater Depth Estimation and Image Restoration Based on Single Images , 2016, IEEE Computer Graphics and Applications.

[20]  Benayad Nsiri,et al.  Underwater image processing method for fish localization and detection in submarine environment , 2016, J. Vis. Commun. Image Represent..

[21]  Mario Fernando Montenegro Campos,et al.  Underwater stereo , 2004, Proceedings. 17th Brazilian Symposium on Computer Graphics and Image Processing.

[22]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[23]  E. Trucco,et al.  Self-Tuning Underwater Image Restoration , 2006, IEEE Journal of Oceanic Engineering.