Online detection of anomaly behaviors based on multidimensional trajectories

Abstract In the surveillance domain, timely detection of anomaly behaviors is very important and is a great challenge to human operators due to information overload, fatigue and inattention. Many anomaly detection algorithms based on trajectories have been proposed for this problem. However, these algorithms generally have problems such as complex parameter setting, unfaithful statistical model, not well-calibrated false alarm rate, poor ability of online learning and sequential anomaly detection, etc. The theory of conformal prediction was introduced to solve these problems by constructing the sequential Hausdorff nearest neighbor conformal anomaly detector. Yet, it only considers position information of the targets and is not sensitive to velocity and course anomaly behaviors. And the run times are increasing as the increase of the data size, which is not appropriate for early warning surveillance application. In order to solve these problems, sequential multi-factor Hausdorff nearest neighbor conformal anomaly detector (SMFHNN CAD) and sequential multi-factor Hausdorff nearest neighbor inductive conformal anomaly detector (SMFHNN ICAD) based on multidimensional trajectories are proposed in this paper. Experiments in both simulated military scenario and realistic civilian scenario show the presented algorithm has a good performance to online detect anomaly behaviors and would have a wide prospect in early warning surveillance systems.

[1]  Bradley J. Rhodes,et al.  Probabilistic associative learning of vessel motion patterns at multiple spatial scales for maritime situation awareness , 2007, 2007 10th International Conference on Information Fusion.

[2]  Harris Papadopoulos,et al.  Inductive Conformal Prediction: Theory and Application to Neural Networks , 2008 .

[3]  Helmut Alt,et al.  The Computational Geometry of Comparing Shapes , 2009, Efficient Algorithms.

[4]  Vladimir Vovk,et al.  A tutorial on conformal prediction , 2007, J. Mach. Learn. Res..

[5]  Michal Pechoucek,et al.  Probabilistic Modeling of Mobile Agents' Trajectories , 2010, ADMI.

[6]  Göran Falkman,et al.  Online Learning and Sequential Anomaly Detection in Trajectories , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Douglas M. Hawkins Identification of Outliers , 1980, Monographs on Applied Probability and Statistics.

[8]  Haipeng Wang,et al.  Online classification of frequent behaviours based on multidimensional trajectories , 2017 .

[9]  Alexander Gammerman,et al.  Hedging Predictions in Machine Learning: The Second Computer Journal Lecture , 2006, Comput. J..

[10]  Jiulun Fan,et al.  Efficient discriminative clustering via QR decomposition-based Linear Discriminant Analysis , 2018, Knowl. Based Syst..

[11]  Michael T. Goodrich,et al.  Education forum: Web Enhanced Textbooks , 1998, SIGA.

[12]  Yu Zheng,et al.  Trajectory Data Mining , 2015, ACM Trans. Intell. Syst. Technol..

[13]  F. Johansson,et al.  Detection of vessel anomalies - a Bayesian network approach , 2007, 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information.

[14]  Marco Grangetto,et al.  Evaluating virtual image quality using the side-views information fusion and depth maps , 2018, Inf. Fusion.

[15]  Allen M. Waxman,et al.  Associative Learning of Vessel Motion Patterns for Maritime Situation Awareness , 2006, 2006 9th International Conference on Information Fusion.

[16]  Lars Niklasson,et al.  Trajectory clustering for coastal surveillance , 2007, 2007 10th International Conference on Information Fusion.

[17]  Tieniu Tan,et al.  A system for learning statistical motion patterns , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Gian Luca Foresti,et al.  On-line trajectory clustering for anomalous events detection , 2006, Pattern Recognit. Lett..

[19]  Mete Ozay,et al.  Hierarchical distance learning by stacking nearest neighbor classifiers , 2016, Inf. Fusion.

[20]  Mark R. Morelande,et al.  Statistical analysis of motion patterns in AIS Data: Anomaly detection and motion prediction , 2008, 2008 11th International Conference on Information Fusion.

[21]  Bradley J. Rhodes,et al.  Adaptive Mixture-Based Neural Network Approach for Higher-Level Fusion and Automated Behavior Monitoring , 2009, 2009 IEEE International Conference on Communications.

[22]  Rikard Laxhammar,et al.  Conformal prediction for distribution-independent anomaly detection in streaming vessel data , 2010, StreamKDD '10.

[23]  James B. Kraiman,et al.  Automated anomaly detection processor , 2002, SPIE Defense + Commercial Sensing.

[24]  Eric Feron,et al.  Trajectory Clustering and an Application to Airspace Monitoring , 2011, IEEE Trans. Intell. Transp. Syst..

[25]  Aníbal R. Figueiras-Vidal,et al.  A new boosting design of Support Vector Machine classifiers , 2015, Inf. Fusion.

[26]  Longbing Cao,et al.  SVM-based multi-state-mapping approach for multi-class classification , 2017, Knowl. Based Syst..

[27]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[28]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[29]  Richa Singh,et al.  Adaptive latent fingerprint segmentation using feature selection and random decision forest classification , 2017, Inf. Fusion.

[30]  B.J. Rhodes,et al.  Maritime situation monitoring and awareness using learning mechanisms , 2005, MILCOM 2005 - 2005 IEEE Military Communications Conference.

[31]  Lars Niklasson,et al.  Evaluating precise and imprecise State-Based Anomaly detectors for maritime surveillance , 2010, 2010 13th International Conference on Information Fusion.

[32]  Zhengming Ma,et al.  Adaptive density peak clustering based on K-nearest neighbors with aggregating strategy , 2017, Knowl. Based Syst..

[33]  Göran Falkman,et al.  Sequential Conformal Anomaly Detection in trajectories based on Hausdorff distance , 2011, 14th International Conference on Information Fusion.

[34]  Fan Yang,et al.  Two approaches for novelty detection using random forest , 2015, Expert Syst. Appl..

[35]  Nikolaos Papanikolopoulos,et al.  Clustering of Vehicle Trajectories , 2010, IEEE Transactions on Intelligent Transportation Systems.

[36]  Shehzad Khalid,et al.  Motion-based behaviour learning, profiling and classification in the presence of anomalies , 2010, Pattern Recognit..

[37]  Mohan M. Trivedi,et al.  A Survey of Vision-Based Trajectory Learning and Analysis for Surveillance , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[38]  G. Shafer,et al.  Algorithmic Learning in a Random World , 2005 .

[39]  Christian S. Jensen,et al.  Trajectory Pattern Mining , 2011, Computing with Spatial Trajectories.

[40]  Gian Luca Foresti,et al.  Trajectory-Based Anomalous Event Detection , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[41]  Wei Xiong,et al.  Mining regular behaviors based on multidimensional trajectories , 2016, Expert Syst. Appl..

[42]  Huchuan Lu,et al.  Combining motion and appearance cues for anomaly detection , 2016, Pattern Recognit..