Multi-agent detection and labelling of activity patterns

We address the problem of automatic detection and labelling of far-field activity patterns from target trajectories using vector field abstractions that are estimated by multiple communicating agents in a Kalman filter (KF) framework. We propose a novel 2D application of the diffusion KF. The proposed approach yields multiple vector field abstractions at the same spatial regions by allowing the estimator agents to create a library of states. We compute internal consistency measures to assess the estimated vector fields, and establish thresholds that signal low performance estimates. Experimental results on synthetic and real data sets show that the proposed approach correctly detects activity patterns from training trajectories and, using new test trajectories one at a time, either matches them to previously detected activity patterns or detects new activity patterns that are added to the agents library. Moreover, the internal consistency measures correctly flag the low-performer vector field abstractions.

[1]  Cláudio T. Silva,et al.  Vector Field k‐Means: Clustering Trajectories by Fitting Multiple Vector Fields , 2012, Comput. Graph. Forum.

[2]  Jianxin Wu,et al.  Finding Coherent Motions and Semantic Regions in Crowd Scenes: A Diffusion and Clustering Approach , 2014, ECCV.

[3]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Mário A. T. Figueiredo,et al.  Activity Recognition Using a Mixture of Vector Fields , 2013, IEEE Transactions on Image Processing.

[5]  Zhongfei Zhang,et al.  An Incremental DPMM-Based Method for Trajectory Clustering, Modeling, and Retrieval , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Camille Roth,et al.  Natural Scales in Geographical Patterns , 2017, Scientific Reports.

[7]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Miguel Á. Carreira-Perpiñán,et al.  Manifold blurring mean shift algorithms for manifold denoising , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Andrea Cavallaro,et al.  Detector-less ball localization using context and motion flow analysis , 2010, 2010 IEEE International Conference on Image Processing.

[10]  Sitanshu Sekhar Sahu,et al.  Detecting anomalous crowd behavior using correlation analysis of optical flow , 2019, Signal Image Video Process..

[11]  Shubhrata Gupta,et al.  Dense traffic flow patterns mining in bi-directional road networks using density based trajectory clustering , 2017, Adv. Data Anal. Classif..

[12]  Edward Jones,et al.  Improved image processing-based crop detection using Kalman filtering and the Hungarian algorithm , 2018, Comput. Electron. Agric..

[13]  Tieniu Tan,et al.  Similarity based vehicle trajectory clustering and anomaly detection , 2005, IEEE International Conference on Image Processing 2005.

[14]  Andrea Cavallaro,et al.  Multifeature Object Trajectory Clustering for Video Analysis , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  William M. Rand,et al.  Objective Criteria for the Evaluation of Clustering Methods , 1971 .

[16]  Silvio Savarese,et al.  Learning Social Etiquette: Human Trajectory Understanding In Crowded Scenes , 2016, ECCV.

[17]  Andrea Cavallaro,et al.  Description and Recognition of Activity Patterns Using Sparse Vector Fields , 2019, IbPRIA.

[18]  Imran N. Junejo,et al.  Multi feature path modeling for video surveillance , 2004, ICPR 2004.

[19]  Klamer Schutte,et al.  Instantaneous threat detection based on a semantic representation of activities, zones and trajectories , 2014, Signal, Image and Video Processing.

[20]  Hongyuan Zha,et al.  Unsupervised Trajectory Clustering via Adaptive Multi-kernel-Based Shrinkage , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[21]  Mohan M. Trivedi,et al.  Trajectory Learning for Activity Understanding: Unsupervised, Multilevel, and Long-Term Adaptive Approach , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Ali H. Sayed,et al.  Diffusion Strategies for Distributed Kalman Filtering and Smoothing , 2010, IEEE Transactions on Automatic Control.

[23]  Jae-Gil Lee,et al.  Trajectory clustering: a partition-and-group framework , 2007, SIGMOD '07.

[24]  Mohan M. Trivedi,et al.  A Survey of Vision-Based Trajectory Learning and Analysis for Surveillance , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Mário A. T. Figueiredo,et al.  Fast estimation of multiple vector fields: Application to video surveillance , 2011, 2011 7th International Symposium on Image and Signal Processing and Analysis (ISPA).