Underwater Image Enhancement based on Deep Learning and Image Formation Model

Underwater robots play an important role in oceanic geological exploration, resource exploitation, ecological research and other fields. However, the visual perception of underwater robots is affected by various environmental factors. The main challenge now is that images captured by underwater robots are color-distorted. The hue of underwater images tends to be close to green and blue. In addition, the contrast is low and the details are fuzzy. In this paper, a new underwater image enhancement method based on deep learning and image formation model is proposed. Experimental results show that the method proposed in this paper can eliminate the influence of underwater environmental factors, and the processed image has richer color, clearer details, and higher scores in PSNR and SSIM metrics. Moreover, it can help feature key-point point matching, get better results.

[1]  M. S. Hitam,et al.  Mixture contrast limited adaptive histogram equalization for underwater image enhancement , 2013, 2013 International Conference on Computer Applications Technology (ICCAT).

[2]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[3]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[4]  Matthew Johnson-Roberson,et al.  UWStereoNet: Unsupervised Learning for Depth Estimation and Color Correction of Underwater Stereo Imagery , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[5]  Pamela C. Cosman,et al.  Underwater Image Restoration Based on Image Blurriness and Light Absorption , 2017, IEEE Transactions on Image Processing.

[6]  Chunle Guo,et al.  Emerging From Water: Underwater Image Color Correction Based on Weakly Supervised Color Transfer , 2017, IEEE Signal Processing Letters.

[7]  Xiangyong Cao,et al.  Underwater image enhancement with global-local networks and compressed-histogram equalization , 2020, Signal Process. Image Commun..

[8]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[9]  C CosmanPamela,et al.  Underwater Image Restoration Based on Image Blurriness and Light Absorption , 2017 .

[10]  Arcot Sowmya,et al.  An Underwater Color Image Quality Evaluation Metric , 2015, IEEE Transactions on Image Processing.

[11]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[12]  Dacheng Tao,et al.  An Underwater Image Enhancement Benchmark Dataset and Beyond , 2019, IEEE Transactions on Image Processing.

[13]  Shree K. Nayar,et al.  Vision and the Atmosphere , 2002, International Journal of Computer Vision.

[14]  Derya Akkaynak,et al.  A Revised Underwater Image Formation Model , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[15]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[16]  Silvia Silva da Costa Botelho,et al.  Transmission Estimation in Underwater Single Images , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[17]  Garrison W. Cottrell,et al.  Understanding Convolution for Semantic Segmentation , 2017, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[18]  Chen Gao,et al.  Human-Visual-System-Inspired Underwater Image Quality Measures , 2016, IEEE Journal of Oceanic Engineering.