A preliminary study on visibility improvement of turbid underwater images for dismantling of nuclear facilities

Abstract Video monitoring environment of underwater cutting objects is rapidly deteriorated due to the increasing water turbidity in proportion to cutting operation. Precise monitoring of the cutting area is one of keys to improve work efficiency. In this paper, we studied a visibility improvement technique based on an artificial neural network for monitoring objects in a turbid underwater cutting site. In order to improve visibility in turbid water, a deep learning neural network that learned two types of visibility enhancement process was adopted. The first type is to train to restore an ideal underwater image with the best visibility from a turbid underwater image, and the second type is to train to restore an image with improved visibility using the conventional visibility improvement technique. We adopted two types of training real images based on the GAN (generative adversarial networks) model for the corresponding turbid input images. The first training image is the histogram-equalized image of a clear underwater image. If the first training image does not exist, an image with improved visibility by using histogram equalization for the turbid input image itself was used as the second training image. Experiments demonstrated that the trained neural network provided significantly improved clarity in turbid images compared to that of the conventional improving technique.

[1]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Alexei A. Efros,et al.  Colorful Image Colorization , 2016, ECCV.

[3]  Fatih Murat Porikli,et al.  Deep Underwater Image Enhancement , 2018, ArXiv.

[4]  Di Wu,et al.  Back propagation neural network dehazing , 2014, 2014 IEEE International Conference on Robotics and Biomimetics (ROBIO 2014).

[5]  Lei Zhang,et al.  Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images , 2018, IEEE Transactions on Image Processing.

[6]  Wei Song,et al.  An Experimental-Based Review of Image Enhancement and Image Restoration Methods for Underwater Imaging , 2019, IEEE Access.

[7]  Codruta O. Ancuti,et al.  Color Balance and Fusion for Underwater Image Enhancement , 2018, IEEE Transactions on Image Processing.

[8]  Raimondo Schettini,et al.  Underwater Image Processing: State of the Art of Restoration and Image Enhancement Methods , 2010, EURASIP J. Adv. Signal Process..

[9]  Xiangyong Cao,et al.  Underwater image enhancement with global-local networks and compressed-histogram equalization , 2020, Signal Process. Image Commun..

[10]  Pedro J. Sanz,et al.  A Deep Learning Approach for Underwater Image Enhancement , 2017, IWINAC.

[11]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  M. Dixit,et al.  Histogram Equalization: A Strong Technique for Image Enhancement , 2015 .

[13]  Alexei A. Efros,et al.  Context Encoders: Feature Learning by Inpainting , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  R. Ishigami,et al.  Laser cutting of thick steel plates and simulated steel components using a 30 kW fiber laser , 2016 .

[15]  Md Jahidul Islam,et al.  Fast Underwater Image Enhancement for Improved Visual Perception , 2020, IEEE Robotics and Automation Letters.

[16]  B. L. McGlamery,et al.  A Computer Model For Underwater Camera Systems , 1980, Other Conferences.

[17]  Wei Song,et al.  Enhancement of Underwater Images With Statistical Model of Background Light and Optimization of Transmission Map , 2019, IEEE Transactions on Broadcasting.

[18]  Younggun Cho,et al.  Estimation of ambient light and transmission map with common convolutional architecture , 2016, OCEANS 2016 MTS/IEEE Monterey.

[19]  Jie Li,et al.  WaterGAN: Unsupervised Generative Network to Enable Real-Time Color Correction of Monocular Underwater Images , 2017, IEEE Robotics and Automation Letters.

[20]  S. Avidan,et al.  Diving into Haze-Lines: Color Restoration of Underwater Images , 2017 .

[21]  Chong-Yi Li,et al.  Underwater Image Enhancement by Dehazing With Minimum Information Loss and Histogram Distribution Prior. , 2016, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[22]  R. Garg,et al.  Histogram Equalization Techniques For Image Enhancement , 2011 .

[23]  Yang Wang,et al.  A deep CNN method for underwater image enhancement , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[24]  Codruta O. Ancuti,et al.  Enhancing underwater images and videos by fusion , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  S. Park,et al.  Underwater laser cutting of stainless steel up to 100 mm thick for dismantling application in nuclear power plants , 2020 .

[26]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[27]  Jules S. Jaffe,et al.  Computer modeling and the design of optimal underwater imaging systems , 1990 .

[28]  Hanyu Li,et al.  Underwater Image Enhancement Using a Multiscale Dense Generative Adversarial Network , 2020, IEEE Journal of Oceanic Engineering.

[29]  Md Jahidul Islam,et al.  Enhancing Underwater Imagery Using Generative Adversarial Networks , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).