A Novel Target Detection Method of the Unmanned Surface Vehicle under All-Weather Conditions with an Improved YOLOV3

The USV (unmanned surface vehicle) is playing an important role in many tasks such as marine environmental observation and maritime security, for the advantages of high autonomy and mobility. Detecting the targets on the surface of the water with high precision ensures the subsequent task implementation. However, the changes from the lights and the surface environment influence the performance of the target detecting method in a long-term task with USV. Therefore, this paper proposed a novel target detection method by fusing DenseNet in YOLOV3 to improve the stability of detection to decrease the feature loss, while the target feature is transmitted in the layers of a deep neural network. All the image data used to train and test the proposed method were obtained in the real ocean environment with a USV in the South China Sea during a one month sea trial in November 2019. The experiment results demonstrate the performance of the proposed method is more suitable for the changed weather conditions though comparing with the existing methods, and the real-time performance is available in practical ocean tasks for USV.

[1]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[2]  Matej Kristan,et al.  Fast Image-Based Obstacle Detection From Unmanned Surface Vehicles , 2015, IEEE Transactions on Cybernetics.

[3]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Yang Xiao,et al.  An object detection and tracking system for unmanned surface vehicles , 2017, Security + Defence.

[5]  Ryan Halterman,et al.  Velodyne HDL-64E lidar for unmanned surface vehicle obstacle detection , 2010, Defense + Commercial Sensing.

[6]  Andrzej Stateczny,et al.  Accuracy of Trajectory Tracking Based on Nonlinear Guidance Logic for Hydrographic Unmanned Surface Vessels , 2020, Sensors.

[7]  Zhixiang Liu,et al.  Unmanned surface vehicles: An overview of developments and challenges , 2016, Annu. Rev. Control..

[8]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Sebastian Scherer,et al.  River mapping from a flying robot: state estimation, river detection, and obstacle mapping , 2012, Auton. Robots.

[10]  Han Wang,et al.  Stereovision based obstacle detection system for unmanned surface vehicle , 2013, 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[11]  Lianru Gao,et al.  Deep CNN With Multi-Scale Rotation Invariance Features for Ship Classification , 2018, IEEE Access.

[12]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[13]  Matej Kristan,et al.  Obstacle Tracking for Unmanned Surface Vessels Using 3-D Point Cloud , 2020, IEEE Journal of Oceanic Engineering.

[14]  Jose Miguel Almeida,et al.  Radar based collision detection developments on USV ROAZ II , 2009, OCEANS 2009-EUROPE.

[15]  Jang-myung Lee,et al.  Detection of small-sized insect pest in greenhouses based on multifractal analysis , 2015 .

[16]  Yuanchang Liu,et al.  Path planning algorithm for unmanned surface vehicle formations in a practical maritime environment , 2015 .

[17]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Piotr Szymak,et al.  Assessment of the Accuracy of Determining the Angular Position of the Unmanned Bathymetric Surveying Vehicle Based on the Sea Horizon Image , 2019, Sensors.

[19]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Francesco Giordano,et al.  Integrating Sensors into a Marine Drone for Bathymetric 3D Surveys in Shallow Waters , 2015, Sensors.

[21]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  En Li,et al.  Apple detection during different growth stages in orchards using the improved YOLO-V3 model , 2019, Comput. Electron. Agric..

[23]  Cezary Specht,et al.  Assessment of the Steering Precision of a Hydrographic Unmanned Surface Vessel (USV) along Sounding Profiles Using a Low-Cost Multi-Global Navigation Satellite System (GNSS) Receiver Supported Autopilot , 2019, Sensors.

[24]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[25]  Larry Matthies,et al.  Daytime water detection based on color variation , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Dmitry B. Goldgof,et al.  Detection and tracking of marine vehicles in video , 2008, 2008 19th International Conference on Pattern Recognition.

[28]  Hang Li,et al.  Convolutional Neural Network Architectures for Matching Natural Language Sentences , 2014, NIPS.

[29]  Hee-Su Kim,et al.  Object detection algorithm for unmanned surface vehicle using faster R-CNN , 2018 .

[30]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Wilber Simmons,et al.  Integrating , 1978 .

[32]  Yongmei Ren,et al.  Surface Vehicle Detection and Tracking with Deep Learning and Appearance Feature , 2019, 2019 5th International Conference on Control, Automation and Robotics (ICCAR).

[33]  Han Wang,et al.  A vision-based obstacle detection system for Unmanned Surface Vehicle , 2011, 2011 IEEE 5th International Conference on Robotics, Automation and Mechatronics (RAM).