Use of feedback strategies in the detection of events for video surveillance

The authors present a feedback-based approach for event detection in video surveillance that improves the detection accuracy and dynamically adapts the computational effort depending on the complexity of the analysed data. A core feedback structure is proposed based on defining different levels of detail for the analysis performed and estimating the complexity of the data being analysed. Then, three feedback-based analysis strategies are defined (based on this core structure) and introduced in the processing stages of a typical video surveillance system. A rule-based system is designed to manage the interaction between these feedback-strategies. Experimental results show that the proposed approach slightly increases the detection reliability, whereas highly reduces the computational effort as compared to the initially developed surveillance system (without feedback strategies) across a variety of multiple video surveillance scenarios operating at real time.

[1]  José Mira Mira,et al.  On the effect of feedback in multilevel representation spaces for visual surveillance tasks , 2009, Neurocomputing.

[2]  Álvaro García-Martín,et al.  Video Object Segmentation Based on Feedback Schemes Guided by a Low-Level Scene Ontology , 2008, ACIVS.

[3]  A. Murat Tekalp,et al.  Video object tracking with feedback of performance measures , 2003, IEEE Trans. Circuits Syst. Video Technol..

[4]  José María Martínez Sanchez,et al.  Robust People Detection by Fusion of Evidence from Multiple Methods , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[5]  Rangachar Kasturi,et al.  Machine vision , 1995 .

[6]  Qiang Zhou,et al.  Adaptive object detection and recognition based on a feedback strategy , 2006, Image Vis. Comput..

[7]  Touradj Ebrahimi,et al.  Interaction between High-Level and Low-Level Image Analysis for Semantic Video Object Extraction , 2004, EURASIP J. Adv. Signal Process..

[8]  Touradj Ebrahimi,et al.  Semantic video analysis for adaptive content delivery and automatic description , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Juan Carlos SanMiguel,et al.  An Ontology for Event Detection and its Application in Surveillance Video , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[10]  Hans-Hellmut Nagel,et al.  Steps toward a Cognitive Vision System , 2004, AI Mag..

[11]  Gregory D. Hager,et al.  Incremental Focus of Attention for Robust Vision-Based Tracking , 1999, International Journal of Computer Vision.

[12]  David S. Doermann,et al.  Tools and techniques for video performance evaluation , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[13]  Michael G. Strintzis,et al.  Introduction to the Special Issue on Audio and Video Analysis for Multimedia Interactive Services , 2004, IEEE Trans. Circuits Syst. Video Technol..

[14]  Mohan M. Trivedi,et al.  Detecting Moving Shadows: Algorithms and Evaluation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Majid Mirmehdi,et al.  Feedback control strategies for object recognition , 1999, IEEE Trans. Image Process..

[16]  Gene F. Franklin,et al.  Feedback Control of Dynamic Systems , 1986 .

[17]  Álvaro García-Martín,et al.  DiVA: A Distributed Video Analysis Framework Applied to Video-Surveillance Systems , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[18]  Ramakant Nevatia,et al.  Video-based event recognition: activity representation and probabilistic recognition methods , 2004, Comput. Vis. Image Underst..

[19]  Trevor Darrell,et al.  Incorporating Object Tracking Feedback into Background Maintenance Framework , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.