Towards a Convolutional Neural Network model for classifying regional ship collision risk levels for waterway risk analysis

Abstract Estimating the navigational risk of vessels operating in sea and waterway areas is important for waterway risk management and pollution preparedness and response planning. Existing methods relying on a model-informed expert judgment of ship-ship collision risk are of limited practical use because periodic risk monitoring is feasible only when this can be done without extensive use of organizational resources. To alleviate such limitations, this article presents a new approach based Convolutional Neural Networks (CNNs) and image recognition to interpret and classify ship-ship collision risks in encounter scenarios. The specific aim of the article is to investigate whether a CNN-based model can quickly and accurately interpret images constructed based on data from the Automatic Identification System (AIS) in terms of collision risk. To test this, estimates derived from training data are compared to validation data. It is also investigated whether adding additional navigational information based on AIS data improves the model's predictive accuracy. A case study with data from the Baltic Sea area is implemented, where various model design alternatives are tested as a proof-of-concept. The main finding of this work is that a CNN-based approach can indeed meet the specified design requirements, suggesting that this is a fruitful direction for future work. Several issues requiring further research and developed are discussed, with the validity of the risk ratings underlying the image classification seen as the most significant conceptual challenge before a CNN-model can be put to practical use.

[1]  Byung-Gil Lee,et al.  Study on the Analysis of Near-Miss Ship Collisions Using Logistic Regression , 2017, J. Adv. Comput. Intell. Intell. Informatics.

[2]  Floris Goerlandt,et al.  Vessel TRIAGE: A method for assessing and communicating the safety status of vessels in maritime distress situations , 2016 .

[3]  Eliopoulou Eleftheria,et al.  Statistical Analysis of Ship Accidents and Review of Safety Level , 2016 .

[4]  Maria Hänninen,et al.  Analysis of the marine traffic safety in the Gulf of Finland , 2009, Reliab. Eng. Syst. Saf..

[5]  P. Silveira,et al.  Use of AIS Data to Characterise Marine Traffic Patterns and Ship Collision Risk off the Coast of Portugal , 2013, Journal of Navigation.

[6]  Rolf J. Bye,et al.  Maritime navigation accidents and risk indicators: An exploratory statistical analysis using AIS data and accident reports , 2018, Reliab. Eng. Syst. Saf..

[7]  Ashim Kumar Debnath,et al.  Modeling perceived collision risk in port water navigation , 2009 .

[8]  Maria Hänninen,et al.  Bayesian network modeling of Port State Control inspection findings and ship accident involvement , 2014, Expert Syst. Appl..

[9]  Jakub Montewka,et al.  Maritime transportation risk analysis: Review and analysis in light of some foundational issues , 2015, Reliab. Eng. Syst. Saf..

[10]  Ketut Buda Artana,et al.  Fuzzy Inference System for Determining Collision Risk of Ship in Madura Strait Using Automatic Identification System , 2017 .

[11]  Xing Wu,et al.  Analysis of Waterway Transportation in Southeast Texas Waterway Based on AIS Data , 2016 .

[12]  A. Debnath,et al.  Modelling Port Water Collision Risk Using Traffic Conflicts , 2011, Journal of Navigation.

[13]  Floris Goerlandt,et al.  Big maritime data for the Baltic Sea with a focus on the winter navigation system , 2019, Marine Policy.

[14]  M Baldauf,et al.  Collision avoidance systems in air and maritime traffic , 2011 .

[15]  Yong Wang,et al.  Learning Traffic as Images: A Deep Convolutional Neural Network for Large-Scale Transportation Network Speed Prediction , 2017, Sensors.

[16]  Jakub Montewka,et al.  Probability modelling of vessel collisions , 2010, Reliab. Eng. Syst. Saf..

[17]  Tayfur Altiok,et al.  Risk Analysis of the Vessel Traffic in the Strait of Istanbul , 2009, Risk analysis : an official publication of the Society for Risk Analysis.

[18]  James S. Hodges,et al.  Six (Or So) Things You Can Do with a Bad Model , 1991, Oper. Res..

[19]  Michael Baldauf,et al.  Improving conflicts detection in maritime traffic: Case studies on the effect of traffic complexity on ship collisions , 2020, Proceedings of the Institution of Mechanical Engineers, Part M: Journal of Engineering for the Maritime Environment.

[20]  Alejandro Baldominos Gómez,et al.  Evolutionary convolutional neural networks: An application to handwriting recognition , 2017, Neurocomputing.

[21]  Maria Hänninen,et al.  A Bayesian network for assessing the collision induced risk of an oil accident in the Gulf of Finland. , 2015, Environmental science & technology.

[22]  Ioannis Hatzilygeroudis,et al.  Recognizing emotions in text using ensemble of classifiers , 2016, Eng. Appl. Artif. Intell..

[23]  Juan Antonio Álvarez,et al.  Evaluation of deep neural networks for traffic sign detection systems , 2018, Neurocomputing.

[24]  H. Ligteringen,et al.  Study on collision avoidance in busy waterways by using AIS data , 2010 .

[25]  S. Kuikka,et al.  A Bayesian network for analyzing biological acute and long-term impacts of an oil spill in the Gulf of Finland. , 2011, Marine pollution bulletin.

[26]  R. Skjong,et al.  Expert Judgment and Risk Perception , 2001 .

[27]  F. Goerlandt,et al.  An online platform for rapid oil outflow assessment from grounded tankers for pollution response. , 2018, Marine pollution bulletin.

[28]  Vinh V. Thai,et al.  Expert elicitation and Bayesian Network modeling for shipping accidents: A literature review , 2016 .

[29]  Ronald Pelot,et al.  Past, present, and future of the satellite-based automatic identification system: areas of applications (2004–2016) , 2018, WMU Journal of Maritime Affairs.

[30]  Xiang Li,et al.  Remaining useful life estimation in prognostics using deep convolution neural networks , 2018, Reliab. Eng. Syst. Saf..

[31]  Jason R. W. Merrick,et al.  On a risk management analysis of oil spill risk using maritime transportation system simulation , 2011, Ann. Oper. Res..

[32]  Yang Wang,et al.  Selection of maritime safety control options for NUC ships using a hybrid group decision-making approach , 2016 .

[33]  Christine Chauvin,et al.  Decision making and strategies in an interaction situation: Collision avoidance at sea , 2008 .

[34]  Xinping Yan,et al.  A novel marine radar targets extraction approach based on sequential images and Bayesian Network , 2016 .

[35]  Efstathios Bakolas,et al.  Highlights from the literature on accident causation and system safety: Review of major ideas, recent contributions, and challenges , 2010, Reliab. Eng. Syst. Saf..

[36]  Yigit C. Altan,et al.  Spatial mapping of encounter probability in congested waterways using AIS , 2018, Ocean Engineering.

[37]  Genserik Reniers,et al.  Prediction in a risk analysis context: Implications for selecting a risk perspective in practical applications , 2018 .

[38]  Ahmad C. Bukhari,et al.  An intelligent real-time multi-vessel collision risk assessment system from VTS view point based on fuzzy inference system , 2013, Expert Syst. Appl..

[39]  Pengfei Chen,et al.  Ship collision candidate detection method: A velocity obstacle approach , 2018, Ocean Engineering.

[40]  Yan Zhang,et al.  Deep neural network for halftone image classification based on sparse auto-encoder , 2016, Eng. Appl. Artif. Intell..

[41]  Maria Riveiro,et al.  Maritime anomaly detection: A review , 2018, WIREs Data Mining Knowl. Discov..

[42]  T. Aven,et al.  On risk defined as an event where the outcome is uncertain , 2009 .

[43]  Jason R. W. Merrick,et al.  The Prince William Sound Risk Assessment , 2002, Interfaces.

[44]  Baoxin Li,et al.  Convolutional Neural Networks in Visual Computing: A Concise Guide , 2017 .

[45]  Floris Goerlandt,et al.  An analysis of wintertime navigational accidents in the Northern Baltic Sea , 2017 .

[46]  Pengfei Chen,et al.  Probabilistic risk analysis for ship-ship collision: State-of-the-art , 2019, Safety Science.

[47]  Thomas Mestl,et al.  Identifying and Analyzing Safety Critical Maneuvers from High Resolution AIS Data , 2016 .

[48]  Torkel Bjørnskau,et al.  Oil spill risk analysis of routeing heavy ship traffic in Norwegian waters , 2012 .

[49]  Pentti Kujala,et al.  Review and analysis of methods for assessing maritime waterway risk based on non-accident critical events detected from AIS data , 2020, Reliab. Eng. Syst. Saf..

[50]  Jakub Montewka,et al.  A method for detecting possible near miss ship collisions from AIS data , 2015 .

[51]  Ronald Pelot,et al.  The effect of extreme weather conditions on commercial fishing activities and vessel incidents in Atlantic Canada , 2016 .

[52]  Qiang Meng,et al.  An Overview of Maritime Waterway Quantitative Risk Assessment Models , 2012, Risk analysis : an official publication of the Society for Risk Analysis.

[53]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[54]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[55]  T. Fwa,et al.  Big AIS data based spatial-temporal analyses of ship traffic in Singapore port waters , 2017, Transportation Research Part E: Logistics and Transportation Review.

[56]  Pentti Kujala,et al.  A COLREG-compliant ship collision alert system for stand-on vessels , 2020, Ocean Engineering.

[57]  Krzysztof Wróbel,et al.  A bibliometric analysis and systematic review of shipboard Decision Support Systems for accident prevention , 2020, Safety Science.

[58]  Yang Wang,et al.  A flexible decision-support solution for intervention measures of grounded ships in the Yangtze River , 2017 .

[59]  Michael Baldauf,et al.  A perfect warning to avoid collisions at sea , 2017 .

[60]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[61]  Pengfei Chen,et al.  Ship collision avoidance methods: State-of-the-art , 2020 .

[62]  Floris Goerlandt,et al.  An Advanced Method For Detecting Possible Near Miss Ship Collisions From AIS Data , 2016 .

[63]  Nikolaos P. Ventikos,et al.  The Shipwrecks in Greece are Going Fuzzy: A Study for the Potential of Oil Pollution from Shipwrecks in Greek Waters , 2013 .

[64]  F. Goerlandt,et al.  Preventing shipping accidents: Past, present, and future of waterway risk management with Baltic Sea focus , 2020 .

[65]  X. Qu,et al.  Vessel Collision Frequency Estimation in the Singapore Strait , 2012 .

[66]  Joost Ellerbroek,et al.  The Effect of Traffic Complexity on the Development of Near Misses on the North Sea , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[67]  Yuanqiao Wen,et al.  Modelling of marine traffic flow complexity , 2015 .

[68]  M. Baldauf,et al.  A dynamic risk assessment method to address safety of navigation concerns around offshore renewable energy installations , 2020, Proceedings of the Institution of Mechanical Engineers, Part M: Journal of Engineering for the Maritime Environment.

[69]  Silja Renooij,et al.  Talking probabilities: communicating probabilistic information with words and numbers , 1999, Int. J. Approx. Reason..

[70]  Jaeyoung Cho,et al.  Models and computational algorithms for maritime risk analysis: a review , 2018, Ann. Oper. Res..

[71]  Tomislav Lipic,et al.  Fine-tuning Convolutional Neural Networks for fine art classification , 2018, Expert Syst. Appl..

[72]  Birnur Ozbas,et al.  Safety Risk Analysis of Maritime Transportation , 2013 .

[73]  Pentti Kujala,et al.  Improving stand-on ship's situational awareness by estimating the intention of the give-way ship , 2020, Ocean Engineering.

[74]  Floris Goerlandt,et al.  On the Reliability and Validity of Ship–Ship Collision Risk Analysis in Light of Different Perspectives on Risk , 2014 .

[75]  Alejandro Coucheiro-Limeres,et al.  Resource2Vec: Linked Data distributed representations for term discovery in automatic speech recognition , 2018, Expert Syst. Appl..

[76]  Zu-wen Wang,et al.  A Unified Analytical Framework for Ship Domains , 2009, Journal of Navigation.

[77]  Qiang Meng,et al.  A novel ship trajectory reconstruction approach using AIS data , 2018, Ocean Engineering.

[78]  Nikolaos P Ventikos,et al.  Disutility analysis of oil spills: graphs and trends. , 2014, Marine pollution bulletin.