Leveraging Graph and Deep Learning Uncertainties to Detect Anomalous Maritime Trajectories

Understanding and representing traffic patterns are key to detecting anomalous trajectories in the transportation domain. However, some trajectories can exhibit heterogeneous maneuvering characteristics despite confining to normal patterns. Thus, we propose a novel graph-based trajectory representation and association scheme for extraction and confederation of traffic movement patterns, such that data patterns and uncertainty can be learned by deep learning (DL) models. This paper proposes the usage of a recurrent neural network (RNN)-based evidential regression model, which can predict trajectory at future timesteps as well as estimate the data and model uncertainties associated, to detect anomalous maritime trajectories, such as unusual vessel maneuvering, using automatic identification system (AIS) data. Furthermore, we utilize evidential deep learning classifiers to detect unusual turns of vessels and the loss of transmitted signal using predicted class probabilities with associated uncertainties. Our experimental results suggest that the graphical representation of traffic patterns improves the ability of the DL models, such as evidential and Monte Carlo dropout, to learn the temporal-spatial correlation of data and associated uncertainties. Using different datasets and experiments, we demonstrate that the estimated prediction uncertainty yields fundamental information for the detection of traffic anomalies in the maritime and, possibly in other domains.

[1]  Jinjun Tang,et al.  Multimodal Traffic Speed Monitoring: A Real-Time System Based on Passive Wi-Fi and Bluetooth Sensing Technology , 2022, IEEE Internet of Things Journal.

[2]  Zhao Liu,et al.  Big Data Driven Vessel Trajectory and Navigating State Prediction With Adaptive Learning, Motion Modeling and Particle Filtering Techniques , 2022, IEEE Transactions on Intelligent Transportation Systems.

[3]  Xingliang Yuan,et al.  Semi-Supervised Federated Learning for Travel Mode Identification From GPS Trajectories , 2021, IEEE Transactions on Intelligent Transportation Systems.

[4]  Hongyu Hu,et al.  Cost-sensitive semi-supervised deep learning to assess driving risk by application of naturalistic vehicle trajectories , 2021, Expert Syst. Appl..

[5]  Philip S. Yu,et al.  Streaming Social Event Detection and Evolution Discovery in Heterogeneous Information Networks , 2021, ACM Trans. Knowl. Discov. Data.

[6]  Nicola Forti,et al.  Deep Learning Methods for Vessel Trajectory Prediction Based on Recurrent Neural Networks , 2021, IEEE Transactions on Aerospace and Electronic Systems.

[7]  Simo Särkkä,et al.  Sensors and AI Techniques for Situational Awareness in Autonomous Ships: A Review , 2020, IEEE Transactions on Intelligent Transportation Systems.

[8]  Frank Heymann,et al.  On the Effectiveness of AI-Assisted Anomaly Detection Methods in Maritime Navigation , 2020, 2020 IEEE 23rd International Conference on Information Fusion (FUSION).

[9]  Liye Zhang,et al.  Traffic Pattern Mining and Forecasting Technologies in Maritime Traffic Service Networks: A Comprehensive Survey , 2020, IEEE Transactions on Intelligent Transportation Systems.

[10]  Paolo Braca,et al.  Prediction oof Vessel Trajectories From AIS Data Via Sequence-To-Sequence Recurrent Neural Networks , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[11]  Frank Heymann,et al.  Machine Learning-Assisted Anomaly Detection in Maritime Navigation using AIS Data , 2020, 2020 IEEE/ION Position, Location and Navigation Symposium (PLANS).

[12]  Gaowei Xu,et al.  Anomalous Trajectory Detection and Classification Based on Difference and Intersection Set Distance , 2020, IEEE Transactions on Vehicular Technology.

[13]  Duong Nguyen,et al.  GeoTrackNet—A Maritime Anomaly Detector Using Probabilistic Neural Network Representation of AIS Tracks and A Contrario Detection , 2019, IEEE Transactions on Intelligent Transportation Systems.

[14]  D. Rus,et al.  Deep Evidential Regression , 2019, NeurIPS.

[15]  Zhi Yuan,et al.  A Novel Approach for Vessel Trajectory Reconstruction Using AIS Data , 2019 .

[16]  Pau Closas,et al.  On GNSS Jamming Threat from the Maritime Navigation Perspective , 2019, 2019 22th International Conference on Information Fusion (FUSION).

[17]  Ryan Wen Liu,et al.  Neural Network-Based Automatic Reconstruction of Missing Vessel Trajectory Data , 2019, 2019 IEEE 4th International Conference on Big Data Analytics (ICBDA).

[18]  Admela Jukan,et al.  On Detecting and Preventing Jamming Attacks with Machine Learning in Optical Networks , 2019, 2019 IEEE Global Communications Conference (GLOBECOM).

[19]  Paolo Braca,et al.  Detecting Anomalous Deviations From Standard Maritime Routes Using the Ornstein–Uhlenbeck Process , 2018, IEEE Transactions on Signal Processing.

[20]  Paolo Braca,et al.  Multiple Ornstein–Uhlenbeck Processes for Maritime Traffic Graph Representation , 2018, IEEE Transactions on Aerospace and Electronic Systems.

[21]  Maria Riveiro,et al.  Maritime anomaly detection: A review , 2018, WIREs Data Mining Knowl. Discov..

[22]  Murat Sensoy,et al.  Evidential Deep Learning to Quantify Classification Uncertainty , 2018, NeurIPS.

[23]  Dario Tarchi,et al.  A novel anomaly detection approach to identify intentional AIS on-off switching , 2017, Expert Syst. Appl..

[24]  Zhe Xiao,et al.  Maritime Traffic Probabilistic Forecasting Based on Vessels’ Waterway Patterns and Motion Behaviors , 2017, IEEE Transactions on Intelligent Transportation Systems.

[25]  Alex Kendall,et al.  What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision? , 2017, NIPS.

[26]  Deepu Rajan,et al.  Video Processing From Electro-Optical Sensors for Object Detection and Tracking in a Maritime Environment: A Survey , 2016, IEEE Transactions on Intelligent Transportation Systems.

[27]  Lily Rachmawati,et al.  Exploiting AIS Data for Intelligent Maritime Navigation: A Comprehensive Survey From Data to Methodology , 2016, IEEE Transactions on Intelligent Transportation Systems.

[28]  Fabio Mazzarella,et al.  Knowledge-based vessel position prediction using historical AIS data , 2015, 2015 Sensor Data Fusion: Trends, Solutions, Applications (SDF).

[29]  Zoubin Ghahramani,et al.  Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning , 2015, ICML.

[30]  Zoubin Ghahramani,et al.  Bayesian Convolutional Neural Networks with Bernoulli Approximate Variational Inference , 2015, ArXiv.

[31]  Fabio Mazzarella,et al.  Spatio-temporal data mining for maritime situational awareness , 2015, OCEANS 2015 - Genova.

[32]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[33]  Ronnie Johansson,et al.  Choosing DBSCAN Parameters Automatically using Differential Evolution , 2014 .

[34]  Niklas Lavesson,et al.  Open data for anomaly detection in maritime surveillance , 2013, Expert Syst. Appl..

[35]  Michele Vespe,et al.  Vessel Pattern Knowledge Discovery from AIS Data: A Framework for Anomaly Detection and Route Prediction , 2013, Entropy.

[36]  Lokukaluge P. Perera,et al.  Maritime Traffic Monitoring Based on Vessel Detection, Tracking, State Estimation, and Trajectory Prediction , 2012, IEEE Transactions on Intelligent Transportation Systems.

[37]  Leto Peel,et al.  Maritime anomaly detection using Gaussian Process active learning , 2012, 2012 15th International Conference on Information Fusion.

[38]  Gian Luca Foresti,et al.  Trajectory-Based Anomalous Event Detection , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[39]  Estevam R. Hruschka,et al.  Bayesian networks for imputation in classification problems , 2007, Journal of Intelligent Information Systems.

[40]  Tieniu Tan,et al.  A system for learning statistical motion patterns , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[42]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[43]  S. Hochreiter,et al.  Long Short-Term Memory , 1997, Neural Computation.

[44]  Daniel S. Hirschberg,et al.  A linear space algorithm for computing maximal common subsequences , 1975, Commun. ACM.

[45]  P. Senkul,et al.  Trajectory pattern extraction and anomaly detection for maritime vessels , 2021, Internet Things.

[46]  Augusto Aubry,et al.  Optimal Opponent Stealth Trajectory Planning Based on an Efficient Optimization Technique , 2021, IEEE Transactions on Signal Processing.

[47]  Peter Willett,et al.  Analysis of AIS Intermittency and Vessel Characterization using a Hidden Markov Model , 2010, GI Jahrestagung.