Fast Adaptive Self-Supervised Underwater Image Enhancement

Wavelength-dependent light absorption and scattering result in the color cast and contrast degradation, which degrades the visibility of underwater images. Deep-learning-based under-water image enhancement has made significant progress in recent years. However, existing algorithms rely heavily on massive data for training, and the difficulty of collecting massive data in real-world environments limits their applicability. To alleviate this problem, we propose a fast adaptive self-supervised underwater image enhancement method, which models the entire water domain in terms of color and contrast distribution with only a few images. Specifically, to learn the mapping of color correction and contrast enhancement, our framework contains two sub-networks: a Color Mapping Net (CLM-Net) and a Contrast Mapping Net (CTM-Net). The CLM-Net learns the color correction mapping under the constraint of gray world assumption in a self-supervised manner. Besides, the CTM-Net estimates the contrast enhancement mapping under the constraint of the dark channel prior. Thanks to adaptive self-supervised training, we can primarily alleviate the need for collecting massive data and achieve effective underwater image enhancement with only ten images. Experiments demonstrate that the proposed algorithm achieves state-of-the-art performance on four benchmark datasets.

[1]  Kai Hu,et al.  An Overview of Underwater Vision Enhancement: From Traditional Methods to Recent Deep Learning , 2022, Journal of Marine Science and Engineering.

[2]  Zhengjun Zha,et al.  Leveraging Deep Statistics for Underwater Image Enhancement , 2021, ACM Trans. Multim. Comput. Commun. Appl..

[3]  Junzhi Yu,et al.  HybrUR: A Hybrid Physical-Neural Solution for Unsupervised Underwater Image Restoration , 2021, ArXiv.

[4]  Zhiwei Xiong,et al.  Deep Degradation Prior for Low-Quality Image Classification , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Fatih Murat Porikli,et al.  Underwater scene prior inspired deep underwater image and video enhancement , 2020, Pattern Recognit..

[6]  Junaed Sattar,et al.  Fast Underwater Image Enhancement for Improved Visual Perception , 2019, IEEE Robotics and Automation Letters.

[7]  Ming Zhu,et al.  Real-World Underwater Enhancement: Challenges, Benchmarks, and Solutions Under Natural Light , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  S. Kwong,et al.  An Underwater Image Enhancement Benchmark Dataset and Beyond , 2019, IEEE Transactions on Image Processing.

[9]  Zhiwei Xiong,et al.  Progressive Retinex: Mutually Reinforced Illumination-Noise Perception Network for Low-Light Image Enhancement , 2019, ACM Multimedia.

[10]  Haitao Zhu,et al.  UWGAN: Underwater GAN for Real-world Underwater Color Restoration and Dehazing , 2019, ArXiv.

[11]  Wei Song,et al.  Shallow-Water Image Enhancement Using Relative Global Histogram Stretching Based on Adaptive Parameter Acquisition , 2018, MMM.

[12]  Chunle Guo,et al.  Emerging From Water: Underwater Image Color Correction Based on Weakly Supervised Color Transfer , 2017, IEEE Signal Processing Letters.

[13]  Yang Wang,et al.  A deep CNN method for underwater image enhancement , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[14]  Ting Wang,et al.  Underwater image enhancement via extended multi-scale Retinex , 2017, Neurocomputing.

[15]  Pamela C. Cosman,et al.  Underwater Image Restoration Based on Image Blurriness and Light Absorption , 2017, IEEE Transactions on Image Processing.

[16]  Chen Gao,et al.  Human-Visual-System-Inspired Underwater Image Quality Measures , 2016, IEEE Journal of Oceanic Engineering.

[17]  Mohinder Malhotra Single Image Haze Removal Using Dark Channel Prior , 2016 .

[18]  Arcot Sowmya,et al.  An Underwater Color Image Quality Evaluation Metric , 2015, IEEE Transactions on Image Processing.

[19]  Silvia Silva da Costa Botelho,et al.  Transmission Estimation in Underwater Single Images , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[20]  Wen Gao,et al.  Single underwater image enhancement with a new optical model , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[21]  Codruta O. Ancuti,et al.  Enhancing underwater images and videos by fusion , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  N. C. Flemming,et al.  Archaeology of the continental shelf: Marine resources, submerged landscapes and underwater archaeology , 2008 .

[23]  Thor I. Fossen,et al.  Underwater Robotics , 2008, Springer Handbook of Robotics.

[24]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[25]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[26]  Jiming Jiang,et al.  Mean squared error of empirical predictor , 2004, math/0406455.

[27]  Shree K. Nayar,et al.  Vision in bad weather , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[28]  Robert L. Thayer,et al.  Gray World, Green Heart: Technology, Nature, and the Sustainable Landscape , 1993 .