Detecting abnormal activities in video sequences

Automatically detecting suspicious human activities in restricted environments such as airports, parking lots and banks represents an open issue for the last generation surveillance systems. In this paper, we present an approach that allows to detect anomalies in a video sequence without any need of describing a priori "abnormal" activities. In particular, we first introduce a normal activities model based on the concept of elementary actions observable by means of image understanding procedures. We then provide an algorithm based on the use of decision trees that can quickly detect an abnormal situation as variation of currently processed activity with respect to normal patterns contained in the system knowledge base. Our preliminary experimental results on a dataset consisting of staged bank robbery videos show that our algorithm provides very encouraging results when compared to human reviewers.

[1]  Malik Ghallab,et al.  Situation Recognition: Representation and Algorithms , 1993, IJCAI.

[2]  Milind R. Naphade,et al.  A probabilistic framework for semantic indexing and retrieval in video , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[3]  Monique Thonnat,et al.  A video interpretation platform applied to bank agency monitoring , 2004 .

[4]  Ramakant Nevatia,et al.  An Ontology for Video Event Representation , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[5]  Jake K. Aggarwal,et al.  Tracking human motion using multiple cameras , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[6]  Graham Coleman,et al.  Detection and explanation of anomalous activities: representing activities as bags of event n-grams , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  V. S. Subrahmanian,et al.  Detecting Stochastically Scheduled Activities in Video , 2007, IJCAI.

[8]  Mohan M. Trivedi,et al.  Detecting Moving Shadows : Formulation , Algorithms and Evaluation , 2001 .

[9]  Mohan M. Trivedi,et al.  Detecting Moving Shadows: Algorithms and Evaluation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Aaron F. Bobick,et al.  Recognition of Visual Activities and Interactions by Stochastic Parsing , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Hans-Hellmut Nagel,et al.  From image sequences towards conceptual descriptions , 1988, Image Vis. Comput..

[12]  François Brémond,et al.  Automatic Video Interpretation: A Novel Algorithm for Temporal Scenario Recognition , 2003, IJCAI.

[13]  Larry S. Davis,et al.  VidMAP: video monitoring of activity with Prolog , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[14]  Shaogang Gong,et al.  Visual Surveillance in a Dynamic and Uncertain World , 1995, Artif. Intell..