Autonomous Visual Perception for Unmanned Surface Vehicle Navigation in an Unknown Environment

Robust detection and recognition of water surfaces are critical for autonomous navigation of unmanned surface vehicles (USVs), since any none-water region is likely an obstacle posing a potential danger to the sailing vehicle. A novel water region visual detection method is proposed in this paper. First, the input image pixels are clustered into different regions and each pixel is assigned a label tag and a confidence value by adaptive multistage segmentation algorithm. Then the resulting label map and associated confidence map are fed into a convolutional neural network (CNN) as training samples to train the network online. Finally, the online trained CNN is used to segment the input image again but with greater precision and stronger robustness. Compared with other deep-learning image segmentation algorithms, the proposed method has two advantages. Firstly, it dispenses with the need of manual labeling training samples which is a costly and painful task. Secondly, it allows real-time online training for CNN, making the network adaptive to the navigational environment. Another contribution of this work relates to the training process of neuro network. An effective network training method is designed to learn from the imperfect training data. We present the experiments in the lake with a various scene and demonstrate that our proposed method could be applied to recognize the water region in the unknown navigation environment automatically.

[1]  Vladlen Koltun,et al.  Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials , 2011, NIPS.

[2]  T. Praczyk Artificial neural networks application in maritime, coastal, spare positioning system , 2006 .

[3]  Samuel Kosolapov,et al.  Horizon Line Detection in Marine Images: Which Method to Choose? , 2013 .

[4]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[5]  Yuanqiao Wen,et al.  Effective Waterline detection for unmanned surface vehicles in inland water , 2017, 2017 Seventh International Conference on Image Processing Theory, Tools and Applications (IPTA).

[6]  YAN YAN,et al.  EFFICIENT HORIZON DETECTION ON COMPLEX SEA FOR SEA SURVEILLANCE , 2015 .

[7]  Sanjay Sharma,et al.  A constrained A* approach towards optimal path planning for an unmanned surface vehicle in a maritime environment containing dynamic obstacles and ocean currents , 2018, Ocean Engineering.

[8]  Lawrence O. Hall,et al.  Horizon Detection Using Machine Learning Techniques , 2006, 2006 5th International Conference on Machine Learning and Applications (ICMLA'06).

[9]  Xuelong Li,et al.  Video Summarization With Attention-Based Encoder–Decoder Networks , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Tomasz Praczyk A quick algorithm for horizon line detection in marine images , 2018 .

[11]  Yuqing He,et al.  Manifold embedding for zero-shot recognition , 2019, Cognitive Systems Research.

[12]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[13]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Jun-Wei Lu,et al.  An Algorithm for Locating Sky-Sea Line , 2006, 2006 IEEE International Conference on Automation Science and Engineering.

[15]  Sanjay Sharma,et al.  Optimal Path Planning of Unmanned Surface Vehicles , 2018 .

[16]  Yuting Su,et al.  Robust Sea-Sky-Line Detection Based on Horizontal Projection and Hough Transformation , 2009, 2009 2nd International Congress on Image and Signal Processing.

[17]  Tomasz Praczyk Detection of Land in Marine Images , 2018, Int. J. Comput. Intell. Syst..

[18]  Ian D. Reid,et al.  RefineNet: Multi-path Refinement Networks for High-Resolution Semantic Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Xuelong Li,et al.  Hypergraph dominant set based multi-video summarization , 2018, Signal Process..

[20]  Seunghoon Hong,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[21]  智一 吉田,et al.  Efficient Graph-Based Image Segmentationを用いた圃場図自動作成手法の検討 , 2014 .

[22]  Chaim Baskin,et al.  Efficient Horizon Line Detection Using an Energy Function , 2017, RACS.

[23]  Jiang Li,et al.  A Hierarchical Horizon Detection Algorithm , 2013, IEEE Geoscience and Remote Sensing Letters.

[24]  Gaofeng Meng,et al.  SeNet: Structured Edge Network for Sea–Land Segmentation , 2017, IEEE Geoscience and Remote Sensing Letters.

[25]  Hugo Ferreira,et al.  Multiple robot operations for maritime search and rescue in euRathlon 2015 competition , 2016, OCEANS 2016 - Shanghai.

[26]  Tomasz Praczyk,et al.  Neural anti-collision system for Autonomous Surface Vehicle , 2015, Neurocomputing.

[27]  Iasonas Kokkinos,et al.  Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs , 2014, ICLR.

[28]  Shuo Pang,et al.  Development and missions of unmanned surface vehicle , 2010 .

[29]  Bahman Zafarifar,et al.  Horizon detection based on sky-color and edge features , 2008, Electronic Imaging.

[30]  Han Wang,et al.  A vision-based obstacle detection system for Unmanned Surface Vehicle , 2011, 2011 IEEE 5th International Conference on Robotics, Automation and Mechatronics (RAM).

[31]  Evgeny Gershikov,et al.  Is color important for horizon line detection? , 2014, 2014 International Conference on Advanced Technologies for Communications (ATC 2014).

[32]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.