Detection of Global and Local Motion Changes in Human Crowds

Crowds arise in a variety of situations, such as public concerts and sporting matches. In typical conditions, the crowd moves in an orderly manner, but panic situations may lead to catastrophic results. We propose a computer vision method to identify motion pattern changes in human crowds that can be related to an unusual event. The proposed approach can identify global changes, by evaluating 2D motion histograms in time, and also local effects, by identifying clusters that present similar spatial locations and velocity vectors. The method is tested both on publicly available data sets involving crowded scenarios and on synthetic data produced by a crowd simulation algorithm, which allows the creation of controlled environments with known motion patterns that are particularly suitable for multicamera scenarios.

[1]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Andrew W. Moore,et al.  X-means: Extending K-means with Efficient Estimation of the Number of Clusters , 2000, ICML.

[4]  Norman I. Badler,et al.  ACUMEN: amplifying control and understanding of multiple entities , 2002, AAMAS '02.

[5]  Cláudio Rosito Jung,et al.  Efficient Background Subtraction and Shadow Removal for Monochromatic Video Sequences , 2009, IEEE Transactions on Multimedia.

[6]  M. Shah,et al.  Abnormal crowd behavior detection using social force model , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Alice Caplier,et al.  Crowd behaviour analysis using histograms of motion direction , 2010, 2010 IEEE International Conference on Image Processing.

[8]  Harold W. Kuhn,et al.  The Hungarian method for the assignment problem , 1955, 50 Years of Integer Programming.

[9]  Mubarak Shah,et al.  Chaotic invariants of Lagrangian particle trajectories for anomaly detection in crowded scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  M. Manzur Murshed,et al.  Panic-driven event detection from surveillance video stream without track and motion features , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[11]  Yiannis Kompatsiaris,et al.  Spatiotemporally localized new event detection in crowds , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[12]  Duan-Yu Chen,et al.  Motion-based unusual event detection in human crowds , 2011, J. Vis. Commun. Image Represent..

[13]  Junsong Yuan,et al.  Sparse reconstruction cost for abnormal event detection , 2011, CVPR 2011.

[14]  Jitendra Malik,et al.  Large Displacement Optical Flow: Descriptor Matching in Variational Motion Estimation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Mubarak Shah,et al.  Identifying Behaviors in Crowd Scenes Using Stability Analysis for Dynamical Systems , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Xiaogang Wang,et al.  Understanding collective crowd behaviors: Learning a Mixture model of Dynamic pedestrian-Agents , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Hua Yang,et al.  The Large-Scale Crowd Behavior Perception Based on Spatio-Temporal Viscous Fluid Field , 2013, IEEE Transactions on Information Forensics and Security.

[18]  Cláudio Rosito Jung,et al.  Change Detection in Human Crowds , 2013, 2013 XXVI Conference on Graphics, Patterns and Images.

[19]  Tieniu Tan,et al.  Practical Camera Calibration From Moving Objects for Traffic Scene Surveillance , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Weibin Liu,et al.  Learning motion patterns in unstructured scene based on latent structural information , 2014, J. Vis. Lang. Comput..

[21]  Zhiwen Yu,et al.  A Bayesian Model for Crowd Escape Behavior Detection , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Xiaogang Wang,et al.  Learning Collective Crowd Behaviors with Dynamic Pedestrian-Agents , 2014, International Journal of Computer Vision.

[23]  Weibin Liu,et al.  Hierarchical crowd analysis and anomaly detection , 2014, J. Vis. Lang. Comput..

[24]  Nuno Vasconcelos,et al.  Anomaly Detection and Localization in Crowded Scenes , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Thierry Bouwmans,et al.  Background Modeling and Foreground Detection for Video Surveillance , 2014 .

[26]  Michael G. Strintzis,et al.  Swarm Intelligence for Detecting Interesting Events in Crowded Environments , 2015, IEEE Transactions on Image Processing.

[27]  Patrick Bouthemy,et al.  Optical flow modeling and computation: A survey , 2015, Comput. Vis. Image Underst..

[28]  Bingbing Ni,et al.  Crowded Scene Analysis: A Survey , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  Dong-Gyu Lee,et al.  Motion Influence Map for Unusual Human Activity Detection and Localization in Crowded Scenes , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[30]  Vinícius Jurinic Cassol,et al.  An Experience-Based Approach to Simulate Virtual Crowd Behaviors Under the Influence of Alcohol , 2015, IVA.

[31]  Francesco Solera,et al.  Socially Constrained Structural Learning for Groups Detection in Crowd , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.