Real-Time Semantics-Based Detection of Suspicious Activities in Public Spaces

Behaviour recognition and video understanding are core components of video surveillance and its real life applications. Recently there has been much effort to devise automated real-time high accuracy video surveillance systems. In this paper, we introduce an approach that detects semantic behaviours based on object and inter-object motion features. A number of interesting types of behaviour have been selected to demonstrate the capabilities of this approach. These types of behaviour are relevant to and most commonly encountered in public transportation systems such as abandoned and stolen luggage, fighting, fainting, and loitering. Using standard public datasets, the experimental results here demonstrate the effectiveness and low computational complexity of this approach, and its superiority to approaches described in some other work.

[1]  Ehud Rivlin,et al.  Robust Real-Time Unusual Event Detection using Multiple Fixed-Location Monitors , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  M. Thonnat,et al.  Video understanding for metro surveillance , 2004, IEEE International Conference on Networking, Sensing and Control, 2004.

[3]  Shaogang Gong,et al.  Autonomous Visual Events Detection and Classification without Explicit Object-Centred Segmentation and Tracking , 2002, BMVC.

[4]  Yaser Sheikh,et al.  CASEE: A Hierarchical Event Representation for the Analysis of Videos , 2004, AAAI.

[5]  Hironobu Fujiyoshi,et al.  Moving target classification and tracking from real-time video , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[6]  James F. Allen Maintaining knowledge about temporal intervals , 1983, CACM.

[7]  Fatih Murat Porikli,et al.  Detection of temporarily static regions by processing video at different frame rates , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[8]  Rémi Ronfard,et al.  A survey of vision-based methods for action representation, segmentation and recognition , 2011, Comput. Vis. Image Underst..

[9]  Bernd Neumann,et al.  Division of Work During Behaviour Recognition - The SCENIC Approach , 2007, BMI.

[10]  V. Vaidehi,et al.  Video based automatic fall detection in indoor environment , 2011, 2011 International Conference on Recent Trends in Information Technology (ICRTIT).

[11]  Xia Zhang,et al.  Generative model for abandoned object detection , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[12]  Jian Zhang,et al.  A Knowledge-Based Approach for Detecting Unattended Packages in Surveillance Video , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[13]  Sergio A. Velastin,et al.  Tracking-based event detection for CCTV systems , 2004, Pattern Analysis and Applications.

[14]  Peter H. N. de With,et al.  Automatic video-based human motion analyzer for consumer surveillance system , 2009, IEEE Transactions on Consumer Electronics.

[15]  Ronen Basri,et al.  Actions as Space-Time Shapes , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Mubarak Shah,et al.  Learning, detection and representation of multi-agent events in videos , 2007, Artif. Intell..

[17]  Dmitry B. Goldgof,et al.  Understanding Transit Scenes: A Survey on Human Behavior-Recognition Algorithms , 2010, IEEE Transactions on Intelligent Transportation Systems.

[18]  Osama Masoud,et al.  Real time, online detection of abandoned objects in public areas , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[19]  Brian C. Lovell,et al.  An Abandoned Object Detection System Based on Dual Background Segmentation , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[20]  José María Martínez Sanchez,et al.  Comparative Evaluation of Stationary Foreground Object Detection Algorithms Based on Background Subtraction Techniques , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[21]  Kunio Fukunaga,et al.  Natural Language Description of Human Activities from Video Images Based on Concept Hierarchy of Actions , 2002, International Journal of Computer Vision.

[22]  Osama Masoud,et al.  Human activities monitoring at bus stops , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[23]  Muhammad Shoaib,et al.  View-invariant Fall Detection for Elderly in Real Home Environment , 2010, 2010 Fourth Pacific-Rim Symposium on Image and Video Technology.

[24]  Robert B. Fisher,et al.  The BEHAVE video dataset: ground truthed video for multi-person behavior classification , 2010 .

[25]  David Demirdjian,et al.  Recognizing events with temporal random forests , 2009, ICMI-MLMI '09.

[26]  Teddy Ko,et al.  A survey on behavior analysis in video surveillance for homeland security applications , 2008, 2008 37th IEEE Applied Imagery Pattern Recognition Workshop.

[27]  Hanqing Lu,et al.  Human activity recognition based on the blob features , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[28]  G.L. Foresti,et al.  Active video-based surveillance system: the low-level image and video processing techniques needed for implementation , 2005, IEEE Signal Processing Magazine.

[29]  Charles J. Fillmore,et al.  THE CASE FOR CASE. , 1967 .

[30]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[31]  Robert B. Fisher,et al.  Non Parametric Classification of Human Interaction , 2007, IbPRIA.