Dynamic Scene Understanding for Behavior Analysis Based on String Kernels

This paper aims at dynamically understanding the properties of a scene from the analysis of moving object trajectories. Two different applications are proposed: the former is devoted to identify abnormal behaviors, while the latter allows to extract the k, most of the similar trajectories to the one hand-drawn by an human operator. A set of normal trajectories' models is extracted using a novel unsupervised learning technique: the scene is adaptively partitioned into zones using the distribution of the training set and each trajectory is represented as a sequence of symbols by considering positional information (the zones crossed in the scene), speed, and shape. The main novelty is the use of a kernel-based approach for evaluating the similarity between the trajectories. Furthermore, we define a novel and efficient kernel-based clustering algorithm, aimed at obtaining groups of normal trajectories. Experimentations, conducted over three standard data sets, confirm the effectiveness of the proposed approach.

[1]  Mohan M. Trivedi,et al.  Learning trajectory patterns by clustering: Experimental studies and comparative evaluation , 2009, CVPR.

[2]  Alessia Saggese,et al.  A Clustering Algorithm of Trajectories for Behaviour Understanding Based on String Kernels , 2012, 2012 Eighth International Conference on Signal Image Technology and Internet Based Systems.

[3]  W. Eric L. Grimson,et al.  Trajectory Analysis and Semantic Region Modeling Using Nonparametric Hierarchical Bayesian Models , 2011, International Journal of Computer Vision.

[4]  Antonio d'Acierno,et al.  A system for storing and retrieving huge amount of trajectory data, allowing spatio-temporal dynamic queries , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[5]  Barbara Majecka,et al.  Statistical models of pedestrian behaviour in the Forum , 2009 .

[6]  Amit K. Roy-Chowdhury,et al.  Query-based retrieval of complex activities using “strings of motion-words” , 2009, 2009 Workshop on Motion and Video Computing (WMVC).

[7]  Xiaogang Wang,et al.  Understanding collective crowd behaviors: Learning a Mixture model of Dynamic pedestrian-Agents , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Przemyslaw Prusinkiewicz,et al.  An algorithm for multidimensional data clustering , 1988, TOMS.

[9]  Jenq-Neng Hwang,et al.  Integrated video object tracking with applications in trajectory-based event detection , 2011, J. Vis. Commun. Image Represent..

[10]  Nikolaos Papanikolopoulos,et al.  Clustering of Vehicle Trajectories , 2010, IEEE Transactions on Intelligent Transportation Systems.

[11]  Alessia Saggese,et al.  A real time algorithm for people tracking using contextual reasoning , 2013, Comput. Vis. Image Underst..

[12]  Mario Vento,et al.  Counting Moving People in Videos by Salient Points Detection , 2010, 2010 20th International Conference on Pattern Recognition.

[13]  Tarek Sayed,et al.  Clustering Vehicle Trajectories with Hidden Markov Models Application to Automated Traffic Safety Analysis , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[14]  Alessia Saggese,et al.  Combining Neural Networks and Fuzzy Systems for Human Behavior Understanding , 2012, 2012 IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance.

[15]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2004 .

[16]  Hans-Peter Kriegel,et al.  Clustering high-dimensional data: A survey on subspace clustering, pattern-based clustering, and correlation clustering , 2009, TKDD.

[17]  Tieniu Tan,et al.  A system for learning statistical motion patterns , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Wen Gao,et al.  Trajectory based event tactics analysis in broadcast sports video , 2007, ACM Multimedia.

[19]  Peter H. N. de With,et al.  High-Level Traffic-Violation Detection for Embedded Traffic Analysis , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[20]  Alessia Saggese,et al.  Learning and Classification of Car Trajectories in Road Video by String Kernels , 2013, VISAPP.

[21]  Mario Vento,et al.  Learning structural shape descriptions from examples , 2002, Pattern Recognit. Lett..

[22]  Jun-Wei Hsieh,et al.  Motion-based video retrieval by trajectory matching , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  James Demmel,et al.  Fast linear algebra is stable , 2006, Numerische Mathematik.

[24]  Tieniu Tan,et al.  Traffic accident prediction using vehicle tracking and trajectory analysis , 2003, Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems.

[25]  Marco Cuturi,et al.  Fast Global Alignment Kernels , 2011, ICML.

[26]  Aristidis Likas,et al.  The Global Kernel $k$-Means Algorithm for Clustering in Feature Space , 2009, IEEE Transactions on Neural Networks.

[27]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[28]  W. Eric L. Grimson,et al.  Trajectory analysis and semantic region modeling using a nonparametric Bayesian model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Luc Brun,et al.  Comparison and optimization of methods of color image quantization , 1997, IEEE Trans. Image Process..

[30]  Mubarak Shah,et al.  Human tracking in multiple cameras , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[31]  Tomoko Matsui,et al.  A Kernel for Time Series Based on Global Alignments , 2006, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[32]  J.K. Aggarwal,et al.  Human activity analysis , 2011, ACM Comput. Surv..

[33]  Maarten van Someren,et al.  Machine learning for vessel trajectories using compression, alignments and domain knowledge , 2012, Expert Syst. Appl..

[34]  Mohan M. Trivedi,et al.  A Survey of Vision-Based Trajectory Learning and Analysis for Surveillance , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[35]  Chris H. Q. Ding,et al.  K-means clustering via principal component analysis , 2004, ICML.

[36]  W. Eric L. Grimson,et al.  Learning Semantic Scene Models by Trajectory Analysis , 2006, ECCV.

[37]  L. Hubert,et al.  Quadratic assignment as a general data analysis strategy. , 1976 .

[38]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.