A novel statistical learning-based framework for automatic anomaly detection and localization in crowds

We propose a novel framework for fast and robust video anomaly detection and localization in complicated crowd scenes. Images of each video are split into cells for extracting local motion features represented by optical flow. In the train videos, most background cells are subtracted by ViBe model. Feature vectors are extracted from each cell by integrating the value of optical flow in 8 different direction intervals. Then we apply Principal Component Analysis (PCA) to transform the feature vectors. The normal activity patterns in the train videos are learnt by constructing a Gaussian Mixture Model (GMM) upon the feature vectors. For any new feature vector extracted from the test video clips, we use the learnt model to calculate a probability value to represent normal level of each cell. Considering the continuity of the motion, we also use abnormal information obtained from previous frames as a supplementary for anomaly prediction in the current frame. At last, we determine whether an activity pattern of a cell is normal or abnormal by using mean shift to cluster the probability values of the frame. Qualitative experiments on real-life surveillance videos, the recently published UCSD anomaly detection datasets, validate the effectiveness of the proposed approach.

[1]  Jean-Marc Odobez,et al.  Topic models for scene analysis and abnormality detection , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[2]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[3]  Marc Van Droogenbroeck,et al.  ViBe: A Universal Background Subtraction Algorithm for Video Sequences , 2011, IEEE Transactions on Image Processing.

[4]  David C. Hogg,et al.  Detecting inexplicable behaviour , 2004, BMVC.

[5]  Takeo Kanade,et al.  Tracking in unstructured crowded scenes , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[6]  Mubarak Shah,et al.  Abnormal crowd behavior detection using social force model , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Peter H. Tu,et al.  Simultaneous estimation of segmentation and shape , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[8]  Ehud Rivlin,et al.  Robust Real-Time Unusual Event Detection using Multiple Fixed-Location Monitors , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Mubarak Shah,et al.  Floor Fields for Tracking in High Density Crowd Scenes , 2008, ECCV.

[10]  T. Moon The expectation-maximization algorithm , 1996, IEEE Signal Process. Mag..

[11]  Takeo Kanade,et al.  Introduction to the Special Section on Video Surveillance , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Brian C. Lovell,et al.  Improved anomaly detection in crowded scenes via cell-based analysis of foreground speed, size and texture , 2011, CVPR 2011 WORKSHOPS.

[13]  Nannan Li,et al.  Anomaly detection in crowds using a space MRF with incremental updates , 2013, Other Conferences.

[14]  Nuno Vasconcelos,et al.  Anomaly detection in crowded scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Gian Luca Foresti,et al.  Trajectory-Based Anomalous Event Detection , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Ce Liu,et al.  Exploring new representations and applications for motion analysis , 2009 .

[17]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Kristen Grauman,et al.  Observe locally, infer globally: A space-time MRF for detecting abnormal activities with incremental updates , 2009, CVPR.

[19]  K. Grauman,et al.  Observe locally, infer globally: A space-time MRF for detecting abnormal activities with incremental updates , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.