A Non-Reference Evaluation of Underwater Image Enhancement Methods Using a New Underwater Image Dataset

The rise of vision-based environmental, marine, and oceanic exploration research highlights the need for supporting underwater image enhancement techniques to help mitigate water effects on images such as blurriness, low color contrast, and poor quality. This paper presents an evaluation of common underwater image enhancement techniques using our new publicly-available Challenging Dataset for Underwater Image Enhancement (CDUIE). The collected dataset is comprised of 85 images of aquatic plants taken at a shallow depth of up to three meters from three different locations in the Great Lake Superior, USA, via a Remotely Operated Vehicle (ROV) equipped with a high-definition RGB camera. In particular, we use our dataset to benchmark nine state-of-the-art image enhancement models at three different depths using a set of common non-reference image quality evaluation metrics. Then we provide a comparative analysis of the performance of the selected models at different depths and highlight the most prevalent ones. The obtained results show that the selected image enhancement models are capable of producing considerably better-quality images with some models performing better than others at certain depths. The dataset is available at https://www.github.com/ashrafrepo/underwater-image-enhancement.

[1]  F. Porikli,et al.  Underwater Image Enhancement With Hyper-Laplacian Reflectance Priors , 2022, IEEE Transactions on Image Processing.

[2]  Chongyi Li,et al.  Underwater Image Enhancement by Attenuated Color Channel Correction and Detail Preserved Contrast Enhancement , 2022, IEEE Journal of Oceanic Engineering.

[3]  Zhenkuan Pan,et al.  Single underwater image enhancement using integrated variational model , 2022, Digit. Signal Process..

[4]  S. Kwong,et al.  Underwater Image Enhancement via Minimal Color Loss and Locally Adaptive Contrast Enhancement , 2022, IEEE Transactions on Image Processing.

[5]  Jingchun Zhou,et al.  Underwater vision enhancement technologies: a comprehensive review, challenges, and recent trends , 2022, Applied Intelligence.

[6]  R. Shuchman,et al.  Classification of Eurasian Watermilfoil (Myriophyllum spicatum) Using Drone-Enabled Multispectral Imagery Analysis , 2022, Remote. Sens..

[7]  Zhenkuan Pan,et al.  UID2021: An Underwater Image Dataset for Evaluation of No-Reference Quality Assessment Metrics , 2022, ACM Trans. Multim. Comput. Commun. Appl..

[8]  Haiyong Zheng,et al.  SGUIE-Net: Semantic Attention Guided Underwater Image Enhancement With Multi-Scale Perception , 2022, IEEE Transactions on Image Processing.

[9]  W. Zhang,et al.  Retinex-inspired color correction and detail preserved fusion for underwater image enhancement , 2022, Comput. Electron. Agric..

[10]  Manigandan Muniraj,et al.  Underwater image enhancement by combining color constancy and dehazing based on depth estimation , 2021, Neurocomputing.

[11]  Guojia Hou,et al.  A Variational Framework for Underwater Image Dehazing and Deblurring , 2021, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Zhengyong Wang,et al.  Single Underwater Image Enhancement Using an Analysis-Synthesis Network , 2021, ArXiv.

[13]  Junhui Hou,et al.  Underwater Image Enhancement via Medium Transmission-Guided Multi-Color Space Embedding , 2021, IEEE Transactions on Image Processing.

[14]  Peixian Zhuang,et al.  DewaterNet: A fusion adversarial real underwater image enhancement network , 2021, Signal Process. Image Commun..

[15]  Kunqian Li,et al.  Enhancing Underwater Image via Adaptive Color and Contrast Enhancement, and Denoising , 2021, Eng. Appl. Artif. Intell..

[16]  Junyu Dong,et al.  Detection perceptual underwater image enhancement with deep learning and physical priors , 2020, ArXiv.

[17]  Xiangyong Cao,et al.  Underwater image enhancement with global-local networks and compressed-histogram equalization , 2020, Signal Process. Image Commun..

[18]  Hanyu Li,et al.  Underwater Image Enhancement Using a Multiscale Dense Generative Adversarial Network , 2020, IEEE Journal of Oceanic Engineering.

[19]  Sadman Sakib Enan,et al.  Semantic Segmentation of Underwater Imagery: Dataset and Benchmark , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  A. Marcarelli,et al.  Effects of Invasive Watermilfoil on Primary Production in Littoral Zones of North-Temperate Lakes , 2020, Diversity.

[21]  Fatih Murat Porikli,et al.  Underwater scene prior inspired deep underwater image and video enhancement , 2020, Pattern Recognit..

[22]  Li Qin,et al.  A Survey of Restoration and Enhancement for Underwater Images , 2019, IEEE Access.

[23]  Zuwairie Ibrahim,et al.  Natural-based underwater image color enhancement through fusion of swarm-intelligence algorithm , 2019, Appl. Soft Comput..

[24]  Guojia Hou,et al.  An efficient nonlocal variational method with application to underwater image restoration , 2019, Neurocomputing.

[25]  Richard J. Dobson,et al.  Multiscale collection and analysis of submerged aquatic vegetation spectral profiles for Eurasian watermilfoil detection , 2019, Journal of Applied Remote Sensing.

[26]  Chongyi Li,et al.  Diving Deeper into Underwater Image Enhancement: A Survey , 2019, Signal Process. Image Commun..

[27]  Guoyu Wang,et al.  Underwater Image Enhancement With a Deep Residual Framework , 2019, IEEE Access.

[28]  Wei Song,et al.  An Experimental-Based Review of Image Enhancement and Image Restoration Methods for Underwater Imaging , 2019, IEEE Access.

[29]  Wei Song,et al.  Enhancement of Underwater Images With Statistical Model of Background Light and Optimization of Transmission Map , 2019, IEEE Transactions on Broadcasting.

[30]  Junaed Sattar,et al.  Fast Underwater Image Enhancement for Improved Visual Perception , 2019, IEEE Robotics and Automation Letters.

[31]  Ming Zhu,et al.  Real-World Underwater Enhancement: Challenges, Benchmarks, and Solutions Under Natural Light , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[32]  S. Kwong,et al.  An Underwater Image Enhancement Benchmark Dataset and Beyond , 2019, IEEE Transactions on Image Processing.

[33]  Chu He,et al.  No-reference color image quality assessment: from entropy to perceptual quality , 2018, EURASIP Journal on Image and Video Processing.

[34]  Shai Avidan,et al.  Underwater Single Image Color Restoration Using Haze-Lines and a New Quantitative Dataset , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Fatih Murat Porikli,et al.  Deep Underwater Image Enhancement , 2018, ArXiv.

[36]  Pamela C. Cosman,et al.  Generalization of the Dark Channel Prior for Single Image Restoration , 2018, IEEE Transactions on Image Processing.

[37]  Vijayan Asari,et al.  Adaptive Trigonometric Transformation Function With Image Contrast and Color Enhancement: Application to Unmanned Aerial System Imagery , 2018, IEEE Geoscience and Remote Sensing Letters.

[38]  Md Jahidul Islam,et al.  Enhancing Underwater Imagery Using Generative Adversarial Networks , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[39]  Yan Wang,et al.  An imaging-inspired no-reference underwater color image quality assessment metric , 2017, Comput. Electr. Eng..

[40]  Jiye Wang,et al.  Remote Sensing Image Enhancement Using Regularized-Histogram Equalization and DCT , 2015, IEEE Geoscience and Remote Sensing Letters.

[41]  Sumohana S. Channappayya,et al.  Blind image quality evaluation using perception based features , 2015, 2015 Twenty First National Conference on Communications (NCC).

[42]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[43]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[44]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[45]  Wang Gang,et al.  ROV based underwater blurred image restoration , 2003 .

[46]  Abhinav Dhall,et al.  UW-GAN: Single-Image Depth Estimation and Image Enhancement for Underwater Images , 2021, IEEE Transactions on Instrumentation and Measurement.

[47]  Herng-Hua Chang,et al.  Single Underwater Image Restoration Based on Adaptive Transmission Fusion , 2020, IEEE Access.

[48]  Peng Liu,et al.  Underwater Image Enhancement Based on a Spiral Generative Adversarial Framework , 2020, IEEE Access.

[49]  Xin Zhao,et al.  Benchmarking Underwater Image Enhancement and Restoration, and Beyond , 2020, IEEE Access.

[50]  Li Qin,et al.  Single Image Defogging Based on Multi-Channel Convolutional MSRCR , 2019, IEEE Access.

[51]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .