Semantic Segmentation of Underwater Images Based on Improved Deeplab

Image semantic segmentation technology has been increasingly applied in many fields, for example, autonomous driving, indoor navigation, virtual reality and augmented reality. However, underwater scenes, where there is a huge amount of marine biological resources and irreplaceable biological gene banks that need to be researched and exploited, are limited. In this paper, image semantic segmentation technology is exploited to study underwater scenes. We extend the current state-of-the-art semantic segmentation network DeepLabv3 + and employ it as the basic framework. First, the unsupervised color correction method (UCM) module is introduced to the encoder structure of the framework to improve the quality of the image. Moreover, two up-sampling layers are added to the decoder structure to retain more target features and object boundary information. The model is trained by fine-tuning and optimizing relevant parameters. Experimental results indicate that the image obtained by our method demonstrates better performance in improving the appearance of the segmented target object and avoiding its pixels from mingling with other class’s pixels, enhancing the segmentation accuracy of the target boundaries and retaining more feature information. Compared with the original method, our method improves the segmentation accuracy by 3%.

[1]  Mark Campbell,et al.  Video-guided Camera Control for Target Tracking and Following , 2019, IFAC-PapersOnLine.

[2]  Bo Fu,et al.  Confidence level estimation in multi-target classification problems , 2018, Defense + Security.

[3]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Qi Wang,et al.  ECNet: Efficient Convolutional Networks for Side Scan Sonar Image Segmentation , 2019, Sensors.

[7]  Wei Song,et al.  Shallow-Water Image Enhancement Using Relative Global Histogram Stretching Based on Adaptive Parameter Acquisition , 2018, MMM.

[8]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[9]  Bo Fu,et al.  Deep learning feature extraction for target recognition and classification in underwater sonar images , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[10]  Hazim G. Daway,et al.  Underwater Image Enhancement using Colour Restoration based on YCbCr Colour Model , 2019, IOP Conference Series: Materials Science and Engineering.

[11]  Chang Liu,et al.  Vision-guided Planning and Control for Autonomous Taxiing via Convolutional Neural Networks , 2019, AIAA Scitech 2019 Forum.

[13]  Daniel Cagara,et al.  Improving Underwater Obstacle Detection using Semantic Image Segmentation , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[14]  Chris Roelfsema,et al.  Towards Automated Annotation of Benthic Survey Images: Variability of Human Experts and Operational Modes of Automation , 2015, PloS one.

[15]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Vivienne Sze,et al.  Efficient Processing of Deep Neural Networks: A Tutorial and Survey , 2017, Proceedings of the IEEE.

[17]  Tim W. Nattkemper,et al.  Tracking Sponge Size and Behaviour with Fixed Underwater Observatories , 2018, CVAUI/IWCF/MIPPSNA@ICPR.

[18]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[20]  Anne E. James,et al.  Enhancing the low quality images using Unsupervised Colour Correction Method , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[21]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[22]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Yu Liu,et al.  A review of semantic segmentation using deep neural networks , 2017, International Journal of Multimedia Information Retrieval.

[24]  A. Lendasse,et al.  Underwater image segmentation with co-saliency detection and local statistical active contour model , 2017, OCEANS 2017 - Aberdeen.

[25]  Wen-Hung Liao,et al.  Enhancing object detection in the dark using U-Net based restoration module , 2019, 2019 16th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[26]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Tim W Nattkemper,et al.  MAIA—A machine learning assisted image annotation method for environmental monitoring and exploration , 2018, PloS one.

[28]  Shun'ichi Kaneko,et al.  Efficient Computation of Optical Flow Using Complementary Voting , 2013 .