Abnormal behavior detection using Conditional Random Fields

This paper proposes a real-time abnormal behavior detection using Conditional Random Fields(CRFs). A normal behavior can be characterized by the spatial and temporal features obtained from the video of human activities. The difficult of abnormal behavior detection is that human behavior varies in both motion and appearance. It is a continuous action stream, interspersed with transitional activities between abnormal and normal events. Here, we propose Bag of Words (BoWs) to describe the motion information as the observations. Then, we apply the CRFs and adaptive thresholding to identify the abnormal behaviors. Different from previous methods, our method can identify the undefined and unknown abnormal activities.

[1]  Mubarak Shah,et al.  Learning object motion patterns for anomaly detection and improved object detection , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Martin D. Levine,et al.  Online Dominant and Anomalous Behavior Detection in Videos , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Cordelia Schmid,et al.  Action recognition by dense trajectories , 2011, CVPR 2011.

[4]  Jie Chen,et al.  Online Least Squares One-Class Support Vector Machines-Based Abnormal Visual Event Detection , 2013, Sensors.

[5]  Sridha Sridharan,et al.  An Evaluation of Different Features and Learning Models for Anomalous Event Detection , 2013, 2013 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[6]  Nuno Vasconcelos,et al.  Anomaly detection in crowded scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Sridha Sridharan,et al.  Textures of optical flow for real-time anomaly detection in crowds , 2011, 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[8]  K. Grauman,et al.  Observe locally, infer globally: A space-time MRF for detecting abnormal activities with incremental updates , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Ramakant Nevatia,et al.  Hierarchical abnormal event detection by real time and semi-real time multi-tasking video surveillance system , 2013, Machine Vision and Applications.

[10]  Stan Sclaroff,et al.  Sign Language Spotting with a Threshold Model Based on Conditional Random Fields , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  David Nistér,et al.  Scalable Recognition with a Vocabulary Tree , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[12]  Robert B. Fisher,et al.  Modelling Crowd Scenes for Event Detection , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[13]  Yangsheng Xu,et al.  Human action learning via hidden Markov model , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[14]  Ehud Rivlin,et al.  Robust Real-Time Unusual Event Detection using Multiple Fixed-Location Monitors , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  J. M. Hammersley,et al.  Markov fields on finite graphs and lattices , 1971 .

[16]  Brian C. Lovell,et al.  Improved anomaly detection in crowded scenes via cell-based analysis of foreground speed, size and texture , 2011, CVPR 2011 WORKSHOPS.

[17]  Sridha Sridharan,et al.  An MRF based abnormal event detection approach using motion and appearance features , 2014, 2014 11th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[18]  G. Clark,et al.  Reference , 2008 .

[19]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[20]  Tao Mei,et al.  Contextual Bag-of-Words for Visual Categorization , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  L. Kratz,et al.  Anomaly detection in extremely crowded scenes using spatio-temporal motion pattern models , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Hichem Snoussi,et al.  Detection of Abnormal Visual Events via Global Optical Flow Orientation Histogram , 2014, IEEE Transactions on Information Forensics and Security.

[23]  Sridha Sridharan,et al.  Anomalous Event Detection Using a Semi-Two Dimensional Hidden Markov Model , 2012, 2012 International Conference on Digital Image Computing Techniques and Applications (DICTA).

[24]  Mubarak Shah,et al.  Abnormal crowd behavior detection using social force model , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Cristian Sminchisescu,et al.  Conditional models for contextual human motion recognition , 2006, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[26]  Shaogang Gong,et al.  Incremental and adaptive abnormal behaviour detection , 2008, Comput. Vis. Image Underst..

[27]  Luc Van Gool,et al.  Tracker trees for unusual event detection , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[28]  H. Bischof,et al.  Fast human detection in crowded scenes by contour integration and local shape estimation , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Alex Pentland,et al.  A Bayesian Computer Vision System for Modeling Human Interactions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Kejun Wang,et al.  Video-Based Abnormal Human Behavior Recognition—A Review , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[31]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.