Anomaly Detection Based on Trajectory Analysis Using Kernel Density Estimation and Information Bottleneck Techniques

In this paper, we propose a new technique to enhance the trajectory shape analysis by explicitly considering the speed attribute of trajectory data, as an effective and efficient way for anomaly detection. An object motion trajectory is mathematically represented by the Kernel Density Estimation, taking into account both the shape of the trajectory and the speed of the moving object. An unsupervised clustering algorithm, using the Information Bottleneck method, is employed for the trajectory learning to achieve an optimal number of trajectory clusters through maximizing the Mutual Information between the clusters and a feature space of the trajectory data. The trajectories are determined as either abnormal (infrequently observed) or normal by a measure based on Shannon entropy. Extensive tests on simulated and real data show that the proposed technique behaves very well and outperforms the state-of-the-art methods. To the best of our knowledge, this is the first technique to use the Information Bottleneck method on the trajectory data.

[1]  G. Pflug Kernel Smoothing. Monographs on Statistics and Applied Probability - M. P. Wand; M. C. Jones. , 1996 .

[2]  Mateu Sbert,et al.  A novel approach for enhancing very dark image sequences , 2014, Signal Process..

[3]  Simone Calderara,et al.  Learning People Trajectories Using Semi-directional Statistics , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[4]  Mohan M. Trivedi,et al.  A Survey of Vision-Based Trajectory Learning and Analysis for Surveillance , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Robert T. Collins,et al.  Vision-Based Analysis of Small Groups in Pedestrian Crowds , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[7]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[8]  Nikolaos Papanikolopoulos,et al.  Clustering of Vehicle Trajectories , 2010, IEEE Transactions on Intelligent Transportation Systems.

[9]  P. J. Green,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[10]  David J. Brown,et al.  A Two-Phase Method of Detecting Abnormalities in Aircraft Flight Data and Ranking Their Impact on Individual Flights , 2012, IEEE Transactions on Intelligent Transportation Systems.

[11]  Sergio A. Velastin,et al.  How close are we to solving the problem of automated visual surveillance? , 2008, Machine Vision and Applications.

[12]  David R. Anderson,et al.  Understanding AIC and BIC in Model Selection , 2004 .

[13]  Andrea Cavallaro,et al.  Multifeature Object Trajectory Clustering for Video Analysis , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Naftali Tishby,et al.  The information bottleneck method , 2000, ArXiv.

[15]  Shehzad Khalid,et al.  Frameworks for multivariate m-mediods based modeling and classification in Euclidean and general feature spaces , 2012, Pattern Recognit..

[16]  Zhongfei Zhang,et al.  An Incremental DPMM-Based Method for Trajectory Clustering, Modeling, and Retrieval , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Simone Calderara,et al.  Mixtures of von Mises Distributions for People Trajectory Shape Analysis , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Dimitrios Gunopulos,et al.  Rotation invariant distance measures for trajectories , 2004, KDD.

[19]  Nikos Pelekis,et al.  Similarity Search in Trajectory Databases , 2007, 14th International Symposium on Temporal Representation and Reasoning (TIME'07).

[20]  Tieniu Tan,et al.  Learning activity patterns using fuzzy self-organizing neural network , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[21]  Shih-Fu Chang,et al.  Motion trajectory matching of video objects , 1999, Electronic Imaging.

[22]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[23]  Ben Shneiderman,et al.  The state of visual analytics: Views on what visual analytics is and where it is going , 2010, IEEE VAST.

[24]  Jean-Philippe Thiran,et al.  Counting Pedestrians in Video Sequences Using Trajectory Clustering , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  M. Trivedi,et al.  Learning trajectory patterns by clustering: Experimental studies and comparative evaluation , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Andrew Hunter,et al.  Application of the self-organising map to trajectory classification , 2000, Proceedings Third IEEE International Workshop on Visual Surveillance.

[27]  Eric Feron,et al.  Trajectory Clustering and an Application to Airspace Monitoring , 2010, IEEE Transactions on Intelligent Transportation Systems.

[28]  Sunilkumar S. Manvi,et al.  Information management in vehicular ad hoc networks: A review , 2014, J. Netw. Comput. Appl..

[29]  Göran Falkman,et al.  Online Learning and Sequential Anomaly Detection in Trajectories , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Gian Luca Foresti,et al.  Trajectory-Based Anomalous Event Detection , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  D. W. Scott,et al.  Multivariate Density Estimation, Theory, Practice and Visualization , 1992 .

[32]  Mubarak Shah,et al.  Multi feature path modeling for video surveillance , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[33]  Simone Calderara,et al.  Using circular statistics for trajectory shape analysis , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Lei Chen,et al.  Robust and fast similarity search for moving object trajectories , 2005, SIGMOD '05.

[35]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[36]  Mubarak Shah,et al.  Learning object motion patterns for anomaly detection and improved object detection , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Sergios Theodoridis,et al.  Pattern Recognition, Third Edition , 2006 .

[38]  Mateu Sbert,et al.  Information Theory Tools for Image Processing , 2014, Information Theory Tools for Image Processing.

[39]  Rodney W. Johnson,et al.  Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy , 1980, IEEE Trans. Inf. Theory.

[40]  Robert B. Fisher,et al.  Semi-supervised Learning for Anomalous Trajectory Detection , 2008, BMVC.

[41]  Mateu Sbert,et al.  Browsing and exploration of video sequences: A new scheme for key frame extraction and 3D visualization using entropy based Jensen divergence , 2014, Inf. Sci..

[42]  Dan Schonfeld,et al.  Object Trajectory-Based Activity Classification and Recognition Using Hidden Markov Models , 2007, IEEE Transactions on Image Processing.

[43]  Mohan M. Trivedi,et al.  Understanding vehicular traffic behavior from video: a survey of unsupervised approaches , 2013, J. Electronic Imaging.

[44]  F. Porikli Trajectory Distance Metric Using Hidden Markov Model Based Representation , 2004 .

[45]  Eamonn J. Keogh,et al.  Three Myths about Dynamic Time Warping Data Mining , 2005, SDM.

[46]  Vladimir Pavlovic,et al.  Discovering clusters in motion time-series data , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[47]  Tieniu Tan,et al.  A system for learning statistical motion patterns , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Hui Ding,et al.  Querying and mining of time series data: experimental comparison of representations and distance measures , 2008, Proc. VLDB Endow..

[49]  Noam Slonim,et al.  The Information Bottleneck : Theory and Applications , 2006 .