Abnormal behavior detection using hybrid agents in crowded scenes

We categorize the behaviors of people into individual and group interactive behavior.We propose a hybrid agent system that includes static and dynamic agents in a scene.We represent the behavior of a crowd as a bag of words to detect abnormal behavior. In this paper, we propose a hybrid agent method to detect abnormal behaviors in a crowded scene. In real-life situations, abnormal behavior occurs by violent movement which is apparent as sudden speeding up, or chaotic movement in a restricted area, or movement contrasting with that of one's neighbors such as in a panic situation. In our model, we categorize the behaviors of people into individual behavior and group interactive behavior. Individual behavior is defined only by native motion information such as speed and direction. By contrast, group interactive behavior is defined by information concerning interactive motion between neighbors. We propose a hybrid agent system that includes static and dynamic agents to observe efficiently the corresponding individual and interactive behaviors in a crowded scene. The static agent is assigned to a specific spot and analyzes motion information near that spot. Unlike the static agent, the dynamic agent is assigned to a moving object and analyzes motion information of neighbors as well as oneself by following the object's movement. We represent the behavior of a crowd as a bag of words through the integration of static and dynamic agent information to determine abnormalities in the crowd behavior. The experimental results show that our proposed method efficiently detects abnormal behaviors in crowded scenes.

[1]  Mohan M. Trivedi,et al.  A Survey of Vision-Based Trajectory Learning and Analysis for Surveillance , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Nuno Vasconcelos,et al.  Anomaly detection in crowded scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Mubarak Shah,et al.  Abnormal crowd behavior detection using social force model , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Teddy Ko,et al.  A survey on behavior analysis in video surveillance for homeland security applications , 2008, 2008 37th IEEE Applied Imagery Pattern Recognition Workshop.

[5]  Mubarak Shah,et al.  Learning object motion patterns for anomaly detection and improved object detection , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Ehud Rivlin,et al.  Robust Real-Time Unusual Event Detection using Multiple Fixed-Location Monitors , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Qingshan Liu,et al.  Abnormal detection using interaction energy potentials , 2011, CVPR 2011.

[8]  Sergio A. Velastin,et al.  Crowd analysis: a survey , 2008, Machine Vision and Applications.

[9]  Chao Lan,et al.  Anomaly Detection , 2018, Encyclopedia of GIS.

[10]  Gunnar Farnebäck,et al.  Two-Frame Motion Estimation Based on Polynomial Expansion , 2003, SCIA.

[11]  Kristen Grauman,et al.  Observe locally, infer globally: A space-time MRF for detecting abnormal activities with incremental updates , 2009, CVPR.

[12]  Soraia Raupp Musse,et al.  Crowd Analysis Using Computer Vision Techniques [ A survey ] , 2010 .

[13]  Michael G. Strintzis,et al.  Accumulated motion energy fields estimation and representation for semantic event detection , 2008, CIVR '08.

[14]  David C. Hogg,et al.  Learning the Distribution of Object Trajectories for Event Recognition , 1995, BMVC.

[15]  Soraia Raupp Musse,et al.  Crowd Analysis Using Computer Vision Techniques , 2010, IEEE Signal Processing Magazine.

[16]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[17]  Kejun Wang,et al.  Video-Based Abnormal Human Behavior Recognition—A Review , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[18]  David C. Hogg,et al.  Learning the distribution of object trajectories for event recognition , 1996, Image Vis. Comput..

[19]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[20]  K. Grauman,et al.  Observe locally, infer globally: A space-time MRF for detecting abnormal activities with incremental updates , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  V. Vapnik Pattern recognition using generalized portrait method , 1963 .

[22]  Tal Hassner,et al.  Violent flows: Real-time detection of violent crowd behavior , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.