Deep Convolutional Neural Network-Based Autonomous Marine Vehicle Maneuver

The automation level of autonomous marine vehicle is limited which is always semi-autonomy and reliant on operator interactions. In order to improve it, an autonomous collision avoidance method is proposed based on the visual technique as human’s visual system. A deep convolutional neural network (Alexnet), with strong visual processing capability, is adopted for encounter pattern recognition. European Ship Simulator is used to generate some encounter scenes and record the corresponding maneuver operation conforming to the COLREGs (International Regulations for Preventing Collisions at Sea) rules as samples. After the training phase, of Alexnet, it can successfully predict the collision avoidance operation according to the input scene image like crewman; moreover, this can provide operation guidance for the automatic navigation, guidance and control system. Some different encounter situations are simulated, and used to testify the validity of the proposed approach.

[1]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[2]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[3]  Yongmin Kim,et al.  Energy-efficient joint path-following for attitude-fixed space manipulators with bounds on completion time and motor voltage/current , 2017, Intell. Serv. Robotics.

[4]  Qin Zhang,et al.  On intelligent risk analysis and critical decision of underwater robotic vehicle , 2017 .

[5]  Caoyang Yu,et al.  Robust fuzzy 3D path following for autonomous underwater vehicle subject to uncertainties , 2017, Comput. Oper. Res..

[6]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[7]  Ming-Cheng Tsou,et al.  THE STUDY OF SHIP COLLISION AVOIDANCE ROUTE PLANNING BY ANT COLONY ALGORITHM , 2010 .

[8]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[9]  Zhongjiu Zheng,et al.  Global Asymptotic Model-Free Trajectory-Independent Tracking Control of an Uncertain Marine Vehicle: An Adaptive Universe-Based Fuzzy Control Approach , 2018, IEEE Transactions on Fuzzy Systems.

[10]  Richard Bucknall,et al.  Path-planning algorithm for ships in close-range encounters , 2010 .

[11]  Srikanth Saripalli,et al.  Obstacle Detection System for Small UAVs using ADS-B and Thermal Imaging , 2017, J. Intell. Robotic Syst..

[12]  Anastassios N. Perakis,et al.  A Real-Time Sequential Ship Roll Prediction Scheme Based on Adaptive Sliding Data Window , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[13]  Dacheng Tao,et al.  Robust Face Recognition via Multimodal Deep Face Representation , 2015, IEEE Transactions on Multimedia.

[14]  Defeng Wu,et al.  An active disturbance rejection controller for marine dynamic positioning system based on biogeography-based optimization , 2015, 2015 34th Chinese Control Conference (CCC).

[15]  Ning Wang,et al.  Adaptive Robust Finite-Time Trajectory Tracking Control of Fully Actuated Marine Surface Vehicles , 2016, IEEE Transactions on Control Systems Technology.

[16]  Gamini Dissanayake,et al.  Optimisation for job scheduling at automated container terminals using genetic algorithm , 2013, Comput. Ind. Eng..

[17]  Meng Joo Er,et al.  Direct Adaptive Fuzzy Tracking Control of Marine Vehicles With Fully Unknown Parametric Dynamics and Uncertainties , 2016, IEEE Transactions on Control Systems Technology.

[18]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[19]  Meng Joo Er,et al.  Tracking-Error-Based Universal Adaptive Fuzzy Control for Output Tracking of Nonlinear Systems with Completely Unknown Dynamics , 2018, IEEE Transactions on Fuzzy Systems.

[20]  Yeong-Dae Kim,et al.  Heuristics for determining a patrol path of an unmanned combat vehicle , 2012, Comput. Ind. Eng..

[21]  C. Tam,et al.  Review of Collision Avoidance and Path Planning Methods for Ships in Close Range Encounters , 2009, Journal of Navigation.

[22]  George W. Irwin,et al.  A review on improving the autonomy of unmanned surface vehicles through intelligent collision avoidance manoeuvres , 2012, Annu. Rev. Control..

[23]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[24]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[25]  Ning Wang,et al.  Global asymptotic output tracking of nonlinear second-order systems with power integrators , 2017, Autom..

[26]  Wen-June Wang,et al.  Implementation of an Object-Grasping Robot Arm Using Stereo Vision Measurement and Fuzzy Control , 2015, Int. J. Fuzzy Syst..

[27]  Meng Joo Er,et al.  Adaptive Robust Online Constructive Fuzzy Control of a Complex Surface Vehicle System , 2016, IEEE Transactions on Cybernetics.

[28]  Ching-Yi Chen,et al.  Real-Time Self-Localization of a Mobile Robot by Vision and Motion System , 2015, 2015 International Conference on Fuzzy Theory and Its Applications (iFUZZY).

[29]  Qingyang Xu,et al.  Collision avoidance strategy optimization based on danger immune algorithm , 2014, Comput. Ind. Eng..

[30]  Meng Joo Er,et al.  Fast and Accurate Trajectory Tracking Control of an Autonomous Surface Vehicle With Unmodeled Dynamics and Disturbances , 2016, IEEE Transactions on Intelligent Vehicles.

[31]  Weidong Zhang,et al.  An energy optimal thrust allocation method for the marine dynamic positioning system based on adaptive hybrid artificial bee colony algorithm , 2016 .

[32]  C. Guedes Soares,et al.  Intelligent Ocean Navigation and Fuzzy-Bayesian Decision/Action Formulation , 2012, IEEE Journal of Oceanic Engineering.

[33]  Zhongjiu Zheng,et al.  Adaptive Approximation-Based Regulation Control for a Class of Uncertain Nonlinear Systems Without Feedback Linearizability , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[34]  R. Szlapczynski Evolutionary Sets of Safe Ship Trajectories Within Traffic Separation Schemes , 2012, Journal of Navigation.

[35]  Chris J. Harris,et al.  An intelligent guidance and control system for ship obstacle avoidance , 1999 .

[36]  R. Szlapczynski Evolutionary Sets Of Safe Ship Trajectories: A New Approach To Collision Avoidance , 2010, Journal of Navigation.

[37]  Saad Mekhilef,et al.  Parameters' fine tuning of differential evolution algorithm , 2015, Comput. Syst. Sci. Eng..

[38]  M. Al-Dabbagh,et al.  A new modified differential evolution algorithm scheme-based linear frequency modulation radar signal de-noising , 2015 .

[39]  C. L. Philip Chen,et al.  Image Guided Fuzzy C-Means for Image Segmentation , 2016, 2016 International Conference on Fuzzy Theory and Its Applications (iFuzzy).

[40]  Miomir Vukobratovic,et al.  Connectionist approaches to the control of manipulation robots at the executive hierarchical level: An overview , 1994, J. Intell. Robotic Syst..

[41]  Qibing Jin,et al.  Improved Minmax Control for Industrial Networked Systems Over Imperfect Communication , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.