Underwater Image Enhancement Method Based on Improved GAN and Physical Model

Underwater vision technology is of great significance in marine investigation. However, the complex underwater environment leads to some problems, such as color deviation and high noise. Therefore, underwater image enhancement has been a focus of the research community. In this paper, a new underwater image enhancement method is proposed based on a generative adversarial network (GAN). We embedded the channel attention mechanism into U-Net to improve the feature utilization performance of the network and used the generator to estimate the parameters of the simplified underwater physical model. At the same time, the adversarial loss, the perceptual loss, and the global loss were fused to train the model. The effectiveness of the proposed method was verified by using four image evaluation metrics on two publicly available underwater image datasets. In addition, we compared the proposed method with some advanced underwater image enhancement algorithms under the same experimental conditions. The experimental results showed that the proposed method demonstrated superiority in terms of image color correction and image noise suppression. In addition, the proposed method was competitive in real-time processing speed.

[1]  S. Kwong,et al.  Underwater Image Enhancement via Minimal Color Loss and Locally Adaptive Contrast Enhancement , 2022, IEEE Transactions on Image Processing.

[2]  Karen Panetta,et al.  Comprehensive Underwater Object Tracking Benchmark Dataset and Underwater Image Enhancement With GAN , 2022, IEEE Journal of Oceanic Engineering.

[3]  Mei Yu,et al.  A Two-Stage Underwater Enhancement Network Based on Structure Decomposition and Characteristics of Underwater Imaging , 2021, IEEE Journal of Oceanic Engineering.

[4]  Wei Cao,et al.  An Underwater Image Vision Enhancement Algorithm Based on Contour Bougie Morphology , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Gajanan K. Birajdar,et al.  Underwater image enhancement: a comprehensive review, recent trends, challenges and applications , 2021, Artificial Intelligence Review.

[6]  Xiaodong Liu,et al.  IPMGAN: Integrating physical model and generative adversarial network for underwater image enhancement , 2020, Neurocomputing.

[7]  Tie Qiu,et al.  A Review on Intelligence Dehazing and Color Restoration for Underwater Images , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[8]  Ben M. Chen,et al.  MLFcGAN: Multilevel Feature Fusion-Based Conditional GAN for Underwater Image Color Correction , 2020, IEEE Geoscience and Remote Sensing Letters.

[9]  Julien Bonnel,et al.  Wind Speed Estimation Using Acoustic Underwater Glider in a Near-Shore Marine Environment , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Junaed Sattar,et al.  Fast Underwater Image Enhancement for Improved Visual Perception , 2019, IEEE Robotics and Automation Letters.

[11]  Ming Zhu,et al.  Real-World Underwater Enhancement: Challenges, Benchmarks, and Solutions Under Natural Light , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  S. Kwong,et al.  An Underwater Image Enhancement Benchmark Dataset and Beyond , 2019, IEEE Transactions on Image Processing.

[13]  Daniele Nardi,et al.  Enhancing Automatic Maritime Surveillance Systems With Visual Information , 2017, IEEE Transactions on Intelligent Transportation Systems.

[14]  Pamela C. Cosman,et al.  Underwater Image Restoration Based on Image Blurriness and Light Absorption , 2017, IEEE Transactions on Image Processing.

[15]  Jie Li,et al.  WaterGAN: Unsupervised Generative Network to Enable Real-Time Color Correction of Monocular Underwater Images , 2017, IEEE Robotics and Automation Letters.

[16]  Chen Gao,et al.  Human-Visual-System-Inspired Underwater Image Quality Measures , 2016, IEEE Journal of Oceanic Engineering.

[17]  Arcot Sowmya,et al.  An Underwater Color Image Quality Evaluation Metric , 2015, IEEE Transactions on Image Processing.

[18]  Aaron C. Courville,et al.  Generative Adversarial Nets , 2014, NIPS.

[19]  Jules S. Jaffe,et al.  Computer modeling and the design of optimal underwater imaging systems , 1990 .

[20]  John D. Austin,et al.  Adaptive histogram equalization and its variations , 1987 .

[21]  Abhinav Dhall,et al.  UW-GAN: Single-Image Depth Estimation and Image Enhancement for Underwater Images , 2021, IEEE Transactions on Instrumentation and Measurement.

[22]  John J. Leonard,et al.  Probabilistic cooperative mobile robot area coverage and its application to autonomous seabed mapping , 2018, Int. J. Robotics Res..

[23]  Mohinder Malhotra Single Image Haze Removal Using Dark Channel Prior , 2016 .

[24]  Borja Calvo,et al.  scmamp: Statistical Comparison of Multiple Algorithms in Multiple Problems , 2016, R J..