Automatic Video Interpretation: A Recognition Algorithm for Temporal Scenarios Based on Pre-compiled Scenario Models

This paper presents a new scenario recognition algorithm for Video Interpretation. We represent a scenario model with the characters involved in the scenario, with its sub-scenarios and with the constraints combining the sub-scenarios. By pre-compiling the scenario models, the recognition algorithm processes temporal constraints by decomposing complex scenarios into intermediate sub-scenarios to reduce the algorithm complexity. We have tested the recognition algorithm on several videos of a bank agency to try to recognize a scenario of "Attack". We conclude by showing experimental results of the efficiency of this algorithm for real time temporal scenario recognition.

[1]  G. Medioni,et al.  Scenario Recognition in Airborne Video Imagery , 2003 .

[2]  Alex Pentland,et al.  On Reversing Jensen's Inequality , 2000, NIPS.

[3]  Hans-Hellmut Nagel,et al.  Deriving Textual Descriptions of Road Traffic Queues from Video Sequences , 2002, ECAI.

[4]  Francois Bremond,et al.  Temporal Constraints for Video Interpretation , 2002 .

[5]  Monique Thonnat,et al.  Realtime image sequence interpretation for video-surveillance applications , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[6]  Monique Thonnat,et al.  Activity Recognition from Video Sequences using Declarative Models , 2000, ECAI.

[7]  François Brémond Environnement de resolution de problemes pour l'interpretation de sequences d'images , 1997 .

[8]  Ramakant Nevatia,et al.  Representation and optimal recognition of human activities , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[9]  Malik Ghallab,et al.  On Chronicles: Representation, On-line Recognition and Learning , 1996, KR.

[10]  Claudio S. Pinhanez,et al.  Human action detection using PNF propagation of temporal constraints , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[11]  Thomas C. Henderson,et al.  Arc and Path Consistency Revisited , 1986, Artif. Intell..