Crowd Segmentation Method Based on Trajectory Tracking and Prior Knowledge Learning

Ensuring public safety and preventing accidents, such as stampedes, caused by crowd congestion, have become urgent problems to be solved. Conflicting, divergent movements in crowds are a main cause of crowd-related safety incidents and accidents. An approach based on trajectory tracking and prior knowledge learning is proposed to handle the problem of crowd motion pattern segmentation. The method uses an orientation–density-function-based cumulative probability model to construct the particle flow field and obtain coherent crowd motion trajectories. Prior knowledge acquisition by trajectory clustering with the help of the improved affinity matrix in the spectral clustering algorithm follows. It then obtains the referential number of clusters automatically and gets the motion pattern segmentation. Experimental results demonstrate that the method presented is effective in identifying the homogeneous crowd motion components under different scenarios. This capability can enable an early warning to be given when a crowd viewed on a video surveillance system is in a congested state.

[1]  Mubarak Shah,et al.  A Lagrangian Particle Dynamics Approach for Crowd Flow Segmentation and Stability Analysis , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Xiangyang Wang,et al.  Crowded abnormal detection based on mixture of kernel dynamic texture , 2014, 2014 International Conference on Audio, Language and Image Processing.

[3]  Qi Wang,et al.  Online Anomaly Detection in Crowd Scenes via Structure Analysis , 2015, IEEE Transactions on Cybernetics.

[4]  Rachid Deriche,et al.  Deterministic and Probabilistic Tractography Based on Complex Fibre Orientation Distributions , 2009, IEEE Transactions on Medical Imaging.

[5]  Nuno Vasconcelos,et al.  Modeling, Clustering, and Segmenting Video with Mixtures of Dynamic Textures , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Mubarak Shah,et al.  Learning motion patterns in crowded scenes using motion flow field , 2008, 2008 19th International Conference on Pattern Recognition.

[7]  Pierre-Marc Jodoin,et al.  Meta-tracking for video scene understanding , 2013, 2013 10th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[8]  Mubarak Shah,et al.  A Streakline Representation of Flow in Crowded Scenes , 2010, ECCV.

[9]  Zhiwen Yu,et al.  Crowd Flow Segmentation Using a Novel Region Growing Scheme , 2009, PCM.

[10]  Michel Barlaud,et al.  Segmentation of a Vector Field: Dominant Parameter and Shape Optimization , 2006, Journal of Mathematical Imaging and Vision.

[11]  Marimuthu Palaniswami,et al.  Estimation of crowd density by clustering motion cues , 2014, The Visual Computer.

[12]  Alan Fern,et al.  Person count localization in videos from noisy foreground and detections , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Adrian E. Raftery,et al.  Finding Curvilinear Features in Spatial Point Patterns: Principal Curve Clustering with Noise , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Xiaogang Wang,et al.  Coherent Filtering: Detecting Coherent Motions from Crowd Clutters , 2012, ECCV.

[15]  Stefano Soatto,et al.  Dynamic Textures , 2003, International Journal of Computer Vision.

[16]  Hua Yang,et al.  The Large-Scale Crowd Behavior Perception Based on Spatio-Temporal Viscous Fluid Field , 2013, IEEE Transactions on Information Forensics and Security.

[17]  Xiaogang Wang,et al.  Cross-scene crowd counting via deep convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Xiaofei Wang,et al.  A high accuracy flow segmentation method in crowded scenes based on streakline , 2014 .

[19]  Thomas Brox,et al.  High Accuracy Optical Flow Estimation Based on a Theory for Warping , 2004, ECCV.

[20]  Rachid Deriche,et al.  Universität Des Saarlandes Fachrichtung 6.1 – Mathematik Colour, Texture, and Motion in Level Set Based Segmentation and Tracking Colour, Texture, and Motion in Level Set Based Segmentation and Tracking , 2022 .

[21]  Marimuthu Palaniswami,et al.  Crowd Event Detection on Optical Flow Manifolds , 2016, IEEE Transactions on Cybernetics.

[22]  Christoph Schnörr,et al.  Spectral clustering of linear subspaces for motion segmentation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[23]  Xiaofei Wang,et al.  An Abnormal Crowd Behavior Detection Algorithm Based on Fluid Mechanics , 2014, J. Comput..

[24]  Debdipta Goswami,et al.  A Lagrangian Approach to Modeling and Analysis of a Crowd Dynamics , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[25]  Yunqian Ma,et al.  Motion segmentation and activity representation in crowds , 2009 .

[26]  Michael G. Strintzis,et al.  Swarm Intelligence for Detecting Interesting Events in Crowded Environments , 2015, IEEE Transactions on Image Processing.

[27]  Daniel Cremers,et al.  Motion Competition: A Variational Approach to Piecewise Parametric Motion Segmentation , 2005, International Journal of Computer Vision.

[28]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[29]  H. Chebi,et al.  Dynamic detection of anomalies in crowd's behavior analysis , 2015, 2015 4th International Conference on Electrical Engineering (ICEE).

[30]  Bingbing Ni,et al.  Crowded Scene Analysis: A Survey , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  Zhiwen Yu,et al.  A Bayesian Model for Crowd Escape Behavior Detection , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[32]  Robert T. Collins,et al.  Vision-Based Analysis of Small Groups in Pedestrian Crowds , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Nasser M. Nasrabadi,et al.  Graph-Based Sensor Fusion for Classification of Transient Acoustic Signals , 2015, IEEE Transactions on Cybernetics.