Ocean image data augmentation in the USV virtual training scene

ABSTRACT The rapid development of intelligent navigation drives the rapid accumulation of ocean data, and the ocean science has entered the era of big data. However, the complexity and variability of the ocean environments make some data unavailable. It makes ocean target detection and the unmanned surface vehicle (USV) intelligent control process in ocean scenarios face various challenges, such as the lack of training data and training environment. Traditional ocean image data collection method used to capture images of complex ocean environments is costly, and it leads to a serious shortage of ocean scene image data. In addition, the construction of an autonomous learning environment is crucial but time-consuming. In order to solve the above problems, we propose a data collection method using virtual ocean scenes and the USV intelligent training process. Based on virtual ocean scenes, we obtain rare images of ocean scenes under complex weather conditions and implement the USV intelligent control training process. Experimental results show that the accuracy of ocean target detection and the success rate of obstacle avoidance of the USV are improved based on the virtual ocean scenes.

[1]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[2]  Tristan Perez,et al.  Ship Collision Avoidance and COLREGS Compliance Using Simulation-Based Control Behavior Selection With Predictive Hazard Assessment , 2016, IEEE Transactions on Intelligent Transportation Systems.

[3]  Tao Liu,et al.  Trajectory tracking control of underactuated USV based on modified backstepping approach , 2015 .

[4]  Vijayan Sugumaran,et al.  A Capability Assessment Model for Emergency Management Organizations , 2018, Inf. Syst. Frontiers.

[5]  Huadong Guo,et al.  Big Earth data: A new frontier in Earth and information sciences , 2017 .

[6]  Wojciech Zaremba,et al.  OpenAI Gym , 2016, ArXiv.

[7]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  William Perrie,et al.  Target Detection on the Ocean With the Relative Phase of Compact Polarimetry SAR , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Quoc V. Le,et al.  AutoAugment: Learning Augmentation Strategies From Data , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Shinpei Kato,et al.  Autoware on Board: Enabling Autonomous Vehicles with Embedded Systems , 2018, 2018 ACM/IEEE 9th International Conference on Cyber-Physical Systems (ICCPS).

[11]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[12]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[13]  Michael J. Collins,et al.  On the Reconstruction of Quad-Pol SAR Data From Compact Polarimetry Data For Ocean Target Detection , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Huadong Guo,et al.  Big data drives the development of Earth science , 2017 .

[15]  Robert Sutton,et al.  Intelligent ship autopilots––A historical perspective , 2003 .

[16]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[17]  Luc Van Gool,et al.  The Pascal Visual Object Classes Challenge: A Retrospective , 2014, International Journal of Computer Vision.

[18]  Hui Zhang,et al.  Verbal Explanations for Deep Reinforcement Learning Neural Networks with Attention on Extracted Features , 2019, 2019 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN).

[19]  Xiangfeng Luo,et al.  Measuring the veracity of web event via uncertainty , 2015, J. Syst. Softw..

[20]  Kenneth R. Muske,et al.  ODE-based obstacle avoidance and trajectory planning for unmanned surface vessels , 2010, Robotica.

[21]  Hans Hagen,et al.  In Situ Eddy Analysis in a High-Resolution Ocean Climate Model , 2016, IEEE Transactions on Visualization and Computer Graphics.