Extracting descriptive motion information from crowd scenes

An important contribution that automated analysis tools can generate for management of pedestrians and crowd safety is the detection of conflicting large pedestrian flows: this kind of movement pattern, in fact, may lead to dangerous situations and potential threats to pedestrian's safety. For this reason, detecting dominant motion patterns and summarizing motion information from the scene are inevitable for crowd management. In this paper, we develop a framework that extracts motion information from the scene by generating point trajectories using particle advection approach. The trajectories obtained are then clustered by using unsupervised hierarchical clustering algorithm, where the similarity is measured by the Longest Common Sub-sequence (LCS) metric. The achieved motions patterns in the scene are summarized and represented by using color-coded arrows, where speeds of the different flows are encoded with colors, the width of an arrow represents the density (number of people belonging to a particular motion pattern) while the arrowhead represents the direction. This novel representation of crowded scene provides a clutter free visualization which helps the crowd managers in understanding the scene. Experimental results show that our method outperforms state-of-the-art methods.

[1]  Peter I. Frazier,et al.  Distance dependent Chinese restaurant processes , 2009, ICML.

[2]  Jintao Li,et al.  Hierarchical spatio-temporal context modeling for action recognition , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Mubarak Shah,et al.  A Lagrangian Particle Dynamics Approach for Crowd Flow Segmentation and Stability Analysis , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Xiaogang Wang,et al.  Understanding collective crowd behaviors: Learning a Mixture model of Dynamic pedestrian-Agents , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Yu-Chiang Frank Wang,et al.  Learning Dense Optical-Flow Trajectory Patterns for Video Object Extraction , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[6]  Liu Yuncai,et al.  Analyzing motion patterns in crowded scenes via automatic tracklets clustering , 2013, China Communications.

[7]  Walid Gomaa,et al.  Semantic Analysis for Crowded Scenes Based on Non-Parametric Tracklet Clustering , 2016, IJCAI.

[8]  Pierre-Marc Jodoin,et al.  Meta-tracking for video scene understanding , 2013, 2013 10th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[9]  Takeo Kanade,et al.  Tracking in unstructured crowded scenes , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[10]  Stefania Bandini,et al.  Analyzing crowd behavior in naturalistic conditions: Identifying sources and sinks and characterizing main flows , 2016, Neurocomputing.

[11]  Zhe Wu,et al.  Motion pattern analysis in crowded scenes based on hybrid generative-discriminative feature maps , 2013, 2013 IEEE International Conference on Image Processing.

[12]  Loong Fah Cheong,et al.  Activity recognition using dense long-duration trajectories , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[13]  Muhammad Saqib,et al.  Detecting dominant motion patterns in crowds of pedestrians , 2017, International Conference on Graphic and Image Processing.

[14]  Jitendra Malik,et al.  Object Segmentation by Long Term Analysis of Point Trajectories , 2010, ECCV.

[15]  Stefania Bandini,et al.  Towards an Integrated Approach to Crowd Analysis and Crowd Synthesis: a Case Study and First Results , 2013, Pattern Recognit. Lett..

[16]  Bingbing Ni,et al.  Crowded Scene Analysis: A Survey , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Hongyuan Zha,et al.  Unsupervised Trajectory Clustering via Adaptive Multi-kernel-Based Shrinkage , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[18]  Xiaogang Wang,et al.  Random field topic model for semantic region analysis in crowded scenes from tracklets , 2011, CVPR 2011.

[19]  Anil M. Cheriyadat,et al.  Detecting Dominant Motions in Dense Crowds , 2008, IEEE Journal of Selected Topics in Signal Processing.

[20]  Bernhard Rinner,et al.  Trajectory clustering for motion pattern extraction in aerial videos , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[21]  Mubarak Shah,et al.  Identifying Behaviors in Crowd Scenes Using Stability Analysis for Dynamical Systems , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Zhongfei Zhang,et al.  An Incremental DPMM-Based Method for Trajectory Clustering, Modeling, and Retrieval , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  James W. Davis,et al.  Learning Scene Entries and Exits Using Coherent Motion Regions , 2010, ISVC.