Discovering Emergent Behaviors from Tracks Using Hierarchical Non-parametric Bayesian Methods

In video-surveillance, non-parametric Bayesian approaches based on a Hierarchical Dirichlet Process (HDP) have recently shown their efficiency for modeling crowed scene activities. This paper follows this track by proposing a method for detecting and clustering emergent behaviors across different captures made of numerous unconstrained trajectories. Most HDP applications for crowed scenes (e.g. traffic, pedestrians) are based on flow motion features. In contrast, we propose to tackle the problem by using full individual trajectories. Furthermore, our proposed approach relies on a three-level clustering hierarchical Dirichlet process able with a minimum a priori to hierarchically retrieve behaviors at increasing semantical levels: activity atoms, activities and behaviors. We chose to validate our approach on ant trajectories simulated by a Multi-Agent System (MAS) using an ant colony foraging model. The experimentation results have shown the ability of our approach to discover different emergent behaviors at different scales, which could be associated to observable events such as "forging" or "deploying" for instance.

[1]  Tucker R. Balch,et al.  Representing Honey Bee Behavior for Recognition Using Human Trainable Models , 2004, Adapt. Behav..

[2]  Robert B. Fisher,et al.  Detection of Abnormal Fish Trajectories Using a Clustering Based Hierarchical Classifier , 2013, BMVC.

[3]  Margrit Betke,et al.  Reconstruction and analysis of 3D trajectories of Brazilian free-tailed bats in flight , 2010 .

[4]  U. Netlogo Wilensky,et al.  Center for Connected Learning and Computer-Based Modeling , 1999 .

[5]  Rahul Sukthankar,et al.  Video Monitoring of Honey Bee Colonies at the Hive Entrance , 2008 .

[6]  Robert B. Fisher,et al.  Modelling Crowd Scenes for Event Detection , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[7]  Dan Schonfeld,et al.  View-invariant motion trajectory-based activity classification and recognition , 2006, Multimedia Systems.

[8]  Michael I. Jordan,et al.  Hierarchical Dirichlet Processes , 2006 .

[9]  Hidetoshi Ikeno,et al.  A new approach for the simultaneous tracking of multiple honeybees for analysis of hive behavior , 2011, Apidologie.

[10]  Michael H. Dickinson,et al.  Multi-camera real-time three-dimensional tracking of multiple flying animals , 2010, Journal of The Royal Society Interface.

[11]  Rama Chellappa,et al.  Shape-and-Behavior Encoded Tracking of Bee Dances , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  W. Eric L. Grimson,et al.  Unsupervised Activity Perception by Hierarchical Bayesian Models , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Mubarak Shah,et al.  Abnormal crowd behavior detection using social force model , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  O. Lambert,et al.  Bees, honey and pollen as sentinels for lead environmental contamination. , 2012, Environmental pollution.

[15]  Shiliang Sun,et al.  Trajectory-based human activity recognition with hierarchical dirichlet process hidden Markov models , 2013, 2013 IEEE China Summit and International Conference on Signal and Information Processing.

[16]  W. Eric L. Grimson,et al.  Unsupervised Activity Perception in Crowded and Complicated Scenes Using Hierarchical Bayesian Models , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Petra Gomez-Krämer,et al.  Detecting and tracking honeybees in 3D at the beehive entrance using stereo vision , 2013, EURASIP J. Image Video Process..

[18]  Brian Litt,et al.  A Hierarchical Dirichlet Process Model with Multiple Levels of Clustering for Human EEG Seizure Modeling , 2012, ICML.

[19]  W. Eric L. Grimson,et al.  Tractography Segmentation Using a Hierarchical Dirichlet Processes Mixture Model , 2009, IPMI.

[20]  L. Kratz,et al.  Anomaly detection in extremely crowded scenes using spatio-temporal motion pattern models , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.