Anomaly detection in crowds using a space MRF with incremental updates

In this paper, we propose a space Markov Random Field (MRF) model to detect abnormal activities in crowded scenes. The nodes of MRF graph consist of monitors evenly spread on the image, and neighboring nodes in space are associated with links. The normal patterns of activity at each node are learnt by constructing a Gaussian Mixture Model (GMM) upon optical flow locally, while correlation between adjacent nodes is represented by building a single Gaussian model upon inner product of histogram vectors of optical flow observed from a region centered at each node respectively. For any optical flow patterns detected in test video clips, we use the learnt model and MRF graph to calculate an energy value for each local node, and determine whether the behavior pattern of the node is normal or abnormal by comparing the value with a threshold. Further, we apply a method similar to updating of GMM for background subtraction to incrementally update the current model to adapt for visual context changes over a long period of time. Experiments on the published UCSD anomaly datasets Ped1 and Ped2 show the effectiveness of our method.

[1]  Shaogang Gong,et al.  Incremental and adaptive abnormal behaviour detection , 2008, Comput. Vis. Image Underst..

[2]  Ehud Rivlin,et al.  Robust Real-Time Unusual Event Detection using Multiple Fixed-Location Monitors , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  K. Grauman,et al.  Observe locally, infer globally: A space-time MRF for detecting abnormal activities with incremental updates , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Mubarak Shah,et al.  Abnormal crowd behavior detection using social force model , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Tianzhu Zhang,et al.  Learning semantic scene models by object classification and trajectory clustering , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Christophe Rosenberger,et al.  Abnormal events detection based on spatio-temporal co-occurences , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Stephen J. Maybank,et al.  Fusion of Multiple Tracking Algorithms for Robust People Tracking , 2002, ECCV.

[8]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[9]  Nuno Vasconcelos,et al.  Anomaly detection in crowded scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Mubarak Shah,et al.  Learning object motion patterns for anomaly detection and improved object detection , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  L. Kratz,et al.  Anomaly detection in extremely crowded scenes using spatio-temporal motion pattern models , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Christophe Rosenberger,et al.  Abnormal events detection based on spatio-temporal co-occurences , 2009, CVPR.