CMRD-Net: An Improved Method for Underwater Image Enhancement

Underwater image enhancement is a challenging task due to the degradation of image quality in underwater complicated lighting conditions and scenes. In recent years, most methods improve the visual quality of underwater images by using deep Convolutional Neural Networks and Generative Adversarial Networks. However, the majority of existing methods do not consider that the attenuation degrees of R, G, B channels of the underwater image are different, leading to a sub-optimal performance. Based on this observation, we propose a Channel-wise Multi-scale Residual Dense Network called CMRD-Net, which learns the weights of different color channels instead of treating all the channels equally. More specifically, the Channel-wise Multi-scale Fusion Residual Attention Block (CMFRAB) is involved in the CMRD-Net to obtain a better ability of feature extraction and representation. Notably, we evaluate the effectiveness of our model by comparing it with recent state-of-the-art methods. Extensive experimental results show that our method can achieve a satisfactory performance on a popular public dataset.

[1]  Mario Fernando Montenegro Campos,et al.  Underwater Depth Estimation and Image Restoration Based on Single Images , 2016, IEEE Computer Graphics and Applications.

[2]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Li Qin,et al.  A Survey of Restoration and Enhancement for Underwater Images , 2019, IEEE Access.

[4]  Heng Tao Shen,et al.  Faster Domain Adaptation Networks , 2021, IEEE Transactions on Knowledge and Data Engineering.

[5]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[6]  Jules S. Jaffe,et al.  Computer modeling and the design of optimal underwater imaging systems , 1990 .

[7]  Yuan Zhou,et al.  Domain Adaptive Adversarial Learning Based on Physics Model Feedback for Underwater Image Enhancement , 2020, ArXiv.

[8]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Santosha K. Dwivedy,et al.  Advancements in the field of autonomous underwater vehicle , 2019, Ocean Engineering.

[10]  Chongyi Li,et al.  Diving Deeper into Underwater Image Enhancement: A Survey , 2019, Signal Process. Image Commun..

[11]  Runmin Cong,et al.  Underwater Image Enhancement by Dehazing With Minimum Information Loss and Histogram Distribution Prior , 2016, IEEE Transactions on Image Processing.

[12]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[13]  Zhu Lei,et al.  Locality Preserving Joint Transfer for Domain Adaptation , 2019, IEEE Transactions on Image Processing.

[14]  Junyu Dong,et al.  Deep pixel-to-pixel network for underwater image enhancement and restoration , 2019, IET Image Process..

[15]  Ovidio Salvetti,et al.  The ARROWS Project: Robotic technologies for underwater archaeology , 2018 .

[16]  S. Afzulpurkar,et al.  The small Maya AUV – Initial field results , 2007 .

[17]  Siva Ram Krishna Vadali,et al.  Development of Modular Shallow Water AUV: Issues & Trial Results , 2012 .

[18]  Xiang Chen,et al.  Multi-scale Attentive Residual Dense Network for Single Image Rain Removal , 2020, ACCV.

[19]  Ankita Naik,et al.  Shallow-UWnet : Compressed Model for Underwater Image Enhancement , 2021, AAAI.

[20]  Md Jahidul Islam,et al.  Fast Underwater Image Enhancement for Improved Visual Perception , 2020, IEEE Robotics and Automation Letters.

[21]  Lu Ke,et al.  Maximum Density Divergence for Domain Adaptation , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Huaxiang Zhang,et al.  Deep Collaborative Multi-View Hashing for Large-Scale Image Search , 2020, IEEE Transactions on Image Processing.

[23]  Ke Lu,et al.  Heterogeneous Domain Adaptation Through Progressive Alignment , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[24]  Tie Qiu,et al.  A Review on Intelligence Dehazing and Color Restoration for Underwater Images , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[25]  Jingjing Li,et al.  Cross-Domain Gradient Discrepancy Minimization for Unsupervised Domain Adaptation , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Wei Song,et al.  An Experimental-Based Review of Image Enhancement and Image Restoration Methods for Underwater Imaging , 2019, IEEE Access.

[27]  Junaed Sattar,et al.  Simultaneous Enhancement and Super-Resolution of Underwater Imagery for Improved Visual Perception , 2020, Robotics: Science and Systems.

[28]  Guojia Hou,et al.  Underwater Color Image Enhancement Using Combining Schemes , 2014 .

[29]  Robert A. Hummel,et al.  Image Enhancement by Histogram transformation , 1975 .

[30]  M. S. Hitam,et al.  Mixture contrast limited adaptive histogram equalization for underwater image enhancement , 2013, 2013 International Conference on Computer Applications Technology (ICCAT).

[31]  Hanyu Li,et al.  Underwater Image Enhancement Using a Multiscale Dense Generative Adversarial Network , 2020, IEEE Journal of Oceanic Engineering.

[32]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[33]  Dacheng Tao,et al.  An Underwater Image Enhancement Benchmark Dataset and Beyond , 2019, IEEE Transactions on Image Processing.

[34]  Fatih Murat Porikli,et al.  Underwater scene prior inspired deep underwater image and video enhancement , 2020, Pattern Recognit..