Spatiotemporally localized new event detection in crowds

The behavior of crowds is of interest in many applications, but difficult to analyze due to the complexity of the activities taking place, the number of people moving in the scene and occlusions occurring between them. This work focuses on the problem of detecting new events in crowds using an original approach that is based on properties of the data in the Fourier domain, which leads to computationally effective and fast solutions that lead to accurate results without requiring data modeling or extensive training. The PETS2009 dataset has been used for benchmarking algorithms developed for analyzing crowd behavior, such as recognizing events in them. Experiments on the PETS 2009 dataset show that the proposed approach achieves the same or better results than existing techniques in detecting new events, while requiring almost no training samples. Extensions for accurate recognition and dealing with more complex events are also proposed as areas of future research.

[1]  Robert B. Fisher,et al.  Modelling Crowd Scenes for Event Detection , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[2]  David C. Hogg,et al.  Detecting inexplicable behaviour , 2004, BMVC.

[3]  Yiannis Kompatsiaris,et al.  Robust Temporal Activity Templates Using Higher Order Statistics , 2009, IEEE Transactions on Image Processing.

[4]  David C. Hogg,et al.  Is it interesting? Comparing human and machine judgements on the PETS dataset , 2004, eccv 2004.

[5]  Robert B. Fisher,et al.  Hidden Markov Models for Optical Flow Analysis in Crowds , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[6]  E. S. Page.  CONTINUOUS INSPECTION SCHEMES , 1954 .

[7]  Helbing,et al.  Social force model for pedestrian dynamics. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[8]  Ayoub Al-Hamadi,et al.  Crowd behavior detection by statistical modeling of motion patterns , 2010, 2010 International Conference of Soft Computing and Pattern Recognition.

[9]  Nikolaos Doulamis,et al.  Evacuation Planning through Cognitive Crowd Tracking , 2009, 2009 16th International Conference on Systems, Signals and Image Processing.

[10]  Nuno Vasconcelos,et al.  Modeling, Clustering, and Segmenting Video with Mixtures of Dynamic Textures , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Shaogang Gong,et al.  Video behaviour profiling and abnormality detection without manual labelling , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[12]  Shaogang Gong,et al.  Beyond Tracking: Modelling Activity and Understanding Behaviour , 2006, International Journal of Computer Vision.

[13]  Ehud Rivlin,et al.  Robust Real-Time Unusual Event Detection using Multiple Fixed-Location Monitors , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Rama Chellappa,et al.  Activity recognition using the dynamics of the configuration of interacting objects , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[15]  Louis Kratz,et al.  Anomaly detection in extremely crowded scenes using spatio-temporal motion pattern models , 2009, CVPR.

[16]  Massimo Piccardi,et al.  Background subtraction techniques: a review , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[17]  Jianbo Shi,et al.  Detecting unusual activity in video , 2004, CVPR 2004.

[18]  Andrew B. Watson,et al.  A look at motion in the frequency domain , 1983 .

[19]  Mubarak Shah,et al.  A Lagrangian Particle Dynamics Approach for Crowd Flow Segmentation and Stability Analysis , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Roberto Cipolla,et al.  Unsupervised Bayesian Detection of Independent Motion in Crowds , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[21]  Narendra Ahuja,et al.  Phase Based Modelling of Dynamic Textures , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[22]  Alan M. McIvor,et al.  Background Subtraction Techniques , 2000 .

[23]  Ramin Mehran,et al.  Abnormal crowd behavior detection using social force model , 2009, CVPR.

[24]  Nuno Vasconcelos,et al.  Analysis of Crowded Scenes using Holistic Properties , 2009 .