Underwater Single Image Color Restoration Using Haze-Lines and a New Quantitative Dataset

Underwater images suffer from color distortion and low contrast, because light is attenuated while it propagates through water. Attenuation under water varies with wavelength, unlike terrestrial images where attenuation is assumed to be spectrally uniform. The attenuation depends both on the water body and the 3D structure of the scene, making color restoration difficult. Unlike existing single underwater image enhancement techniques, our method takes into account multiple spectral profiles of different water types. By estimating just two additional global parameters: the attenuation ratios of the blue-red and blue-green color channels, the problem is reduced to single image dehazing, where all color channels have the same attenuation coefficients. Since the water type is unknown, we evaluate different parameters out of an existing library of water types. Each type leads to a different restored image and the best result is automatically chosen based on color distribution. We also contribute a dataset of 57 images taken in different locations. To obtain ground truth, we placed multiple color charts in the scenes and calculated its 3D structure using stereo imaging. This dataset enables a rigorous quantitative evaluation of restoration algorithms on natural images for the first time.

[1]  Robby T. Tan,et al.  Visibility in bad weather from a single image , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Stefan B. Williams,et al.  A benchmarking study on single image dehazing techniques for underwater autonomous vehicles , 2017, OCEANS 2017 - Aberdeen.

[3]  Y.Y. Schechner,et al.  Recovery of underwater visibility and structure by polarization analysis , 2005, IEEE Journal of Oceanic Engineering.

[4]  Stefan B. Williams,et al.  True Color Correction of Autonomous Underwater Vehicle Imagery , 2016, J. Field Robotics.

[5]  S. Avidan,et al.  Diving into Haze-Lines: Color Restoration of Underwater Images , 2017 .

[6]  Imari Sato,et al.  Shape from Water: Bispectral Light Absorption for Depth Recovery , 2016, ECCV.

[7]  N Carlevaris-Bianco,et al.  Initial results in underwater single image dehazing , 2010, OCEANS 2010 MTS/IEEE SEATTLE.

[8]  G. Buchsbaum A spatial processor model for object colour perception , 1980 .

[9]  Codruta O. Ancuti,et al.  Color Balance and Fusion for Underwater Image Enhancement , 2018, IEEE Transactions on Image Processing.

[10]  Shai Avidan,et al.  Non-local Image Dehazing , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Y. Schechner,et al.  Clear underwater vision , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[12]  Katsushi Ikeuchi,et al.  Estimating optical properties of layered surfaces using the spider model , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Sabine Süsstrunk,et al.  What is the space of spectral sensitivity functions for digital color cameras? , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[14]  Pamela C. Cosman,et al.  Underwater Image Restoration Based on Image Blurriness and Light Absorption , 2017, IEEE Transactions on Image Processing.

[15]  Rob Sumner Processing RAW Images in MATLAB , 2014 .

[16]  Stefan B. Williams,et al.  Colour-Consistent Structure-from-Motion Models using Underwater Imagery , 2012, Robotics: Science and Systems.

[17]  Arcot Sowmya,et al.  An Underwater Color Image Quality Evaluation Metric , 2015, IEEE Transactions on Image Processing.

[18]  Cordelia Schmid,et al.  EpicFlow: Edge-preserving interpolation of correspondences for optical flow , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Trisha Lian,et al.  Underwater Image Systems Simulation , 2017 .

[20]  Derya Akkaynak,et al.  A Revised Underwater Image Formation Model , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[21]  Andrea Cavallaro,et al.  Hierarchical rank-based veiling light estimation for underwater dehazing , 2015, BMVC.

[22]  Codruta O. Ancuti,et al.  Enhancing underwater images and videos by fusion , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Huimin Lu,et al.  Underwater image enhancement using guided trigonometric bilateral filter and fast automatic color correction , 2013, 2013 IEEE International Conference on Image Processing.

[24]  Silvia Silva da Costa Botelho,et al.  Transmission Estimation in Underwater Single Images , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[25]  Adrian Galdran,et al.  Automatic Red-Channel underwater image restoration , 2015, J. Vis. Commun. Image Represent..

[26]  Yoav Y. Schechner,et al.  The Next Best Underwater View , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Chongyi Li,et al.  Diving Deeper into Underwater Image Enhancement: A Survey , 2019, Signal Process. Image Commun..

[28]  Chen Gao,et al.  Human-Visual-System-Inspired Underwater Image Quality Measures , 2016, IEEE Journal of Oceanic Engineering.

[29]  László Neumann,et al.  Color transfer for underwater dehazing and depth estimation , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[30]  Ying-Ching Chen,et al.  Underwater Image Enhancement by Wavelength Compensation and Dehazing , 2012, IEEE Transactions on Image Processing.

[31]  Graham D. Finlayson,et al.  Reproduction Angular Error: An Improved Performance Metric for Illuminant Estimation , 2014, BMVC.

[32]  Andrea Cavallaro,et al.  Underwater image and video dehazing with pure haze region segmentation , 2017, Comput. Vis. Image Underst..

[33]  Mohinder Malhotra Single Image Haze Removal Using Dark Channel Prior , 2016 .

[34]  Sertac Karaman,et al.  Sparse-to-Dense: Depth Prediction from Sparse Depth Samples and a Single Image , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[35]  Yoav Y. Schechner,et al.  Turbulence-induced 2D correlated image distortion , 2017, 2017 IEEE International Conference on Computational Photography (ICCP).

[36]  Shahriar Negahdaripour,et al.  Stereo from flickering caustics , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[37]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Younggun Cho,et al.  Estimation of ambient light and transmission map with common convolutional architecture , 2016, OCEANS 2016 MTS/IEEE Monterey.

[39]  Huimin Lu,et al.  Contrast enhancement for images in turbid water. , 2015, Journal of the Optical Society of America. A, Optics, image science, and vision.

[40]  Chunle Guo,et al.  Emerging From Water: Underwater Image Color Correction Based on Weakly Supervised Color Transfer , 2017, IEEE Signal Processing Letters.

[41]  Yoav Y Schechner,et al.  Resolution loss without imaging blur. , 2012, Journal of the Optical Society of America. A, Optics, image science, and vision.

[42]  Roger T Hanlon,et al.  Use of commercial off-the-shelf digital cameras for scientific data acquisition and scene-specific color calibration. , 2014, Journal of the Optical Society of America. A, Optics, image science, and vision.

[43]  Atsushi Yamashita,et al.  Color Registration of Underwater Images for Underwater Sensing with Consideration of Light Attenuation , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[44]  Jing Wang,et al.  Underwater image enhancement and restoration based on local fusion , 2019, J. Electronic Imaging.

[45]  C. Lawrence Zitnick,et al.  Structured Forests for Fast Edge Detection , 2013, 2013 IEEE International Conference on Computer Vision.

[46]  Amanda C. Duarte,et al.  A dataset to evaluate underwater image restoration methods , 2016, OCEANS 2016 - Shanghai.

[47]  R. W. Austin,et al.  Spectral dependence of the diffuse attenuation coefficient of light in ocean waters , 1986 .

[48]  David Iluz,et al.  What is the Space of Attenuation Coefficients in Underwater Computer Vision? , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[49]  Derya Akkaynak,et al.  Sea-Thru: A Method for Removing Water From Underwater Images , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[50]  Pamela C. Cosman,et al.  Single underwater image enhancement using depth estimation based on blurriness , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[51]  Christophe De Vleeschouwer,et al.  Multi-scale underwater descattering , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[52]  Xiaochun Cao,et al.  Single Image Dehazing via Multi-scale Convolutional Neural Networks , 2016, ECCV.

[53]  Jizheng Xu,et al.  AOD-Net: All-in-One Dehazing Network , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[54]  C. Mobley Light and Water: Radiative Transfer in Natural Waters , 1994 .