Event-driven Video Awareness Providing Physical Security

The Video Event Awareness Workbench (VEAW) analyzes surveillance video from thousands of video cameras and automatically detects complex events in near-real-time-at pace with their input video streams. For events of interest to security personnel, VEAW generates and routes alerts and related video evidence to subscribing security personnel. Complex event processing in VEAW is driven by user-authored awareness specifications comprised of inter-connected spatio-temporal stream and statistical operators that consume and produce events described in VEAW’s surveillance ontology. In this paper we introduce VEAW’s event driven architecture and describe its solutions for automating video surveillance, including the orchestration of continuous and tasked video analysis algorithms (e.g., for entity tracking and identification), fusion of events from multiple sources in an installation-specific “world” model, and proactive information gathering to deal with missing or incomplete information (this is done by tasking video analysis algorithms and security personnel to provide it). We also discuss how VEAW deals with late arriving information (due to out-of-band video analysis tasks and overhead), as well as a related resource optimization aimed at minimizing computation costs. We illustrate the benefits of VEAW by illustrating its application on the automation of real-world security policies.

[1]  Andrzej Cichocki,et al.  Managing escalation of collaboration processes in crisis mitigation situations , 2000, Proceedings of 16th International Conference on Data Engineering (Cat. No.00CB37073).

[2]  Andrzej Cichocki,et al.  Providing customized process and situation awareness in the collaboration management infrastructure , 1999, Proceedings Fourth IFCIS International Conference on Cooperative Information Systems. CoopIS 99 (Cat. No.PR00384).

[3]  Qiang Chen,et al.  Aurora : a new model and architecture for data stream management ) , 2006 .

[4]  Jianping Fan,et al.  A distributed database server for continuous media , 2002, Proceedings 18th International Conference on Data Engineering.

[5]  Dimitrios Georgakopoulos,et al.  Providing Physical Security via Video Event Awareness , 2006, SIGMAP.

[6]  Jennifer Widom,et al.  Flexible time management in data stream systems , 2004, PODS.

[7]  Andrzej Cichocki,et al.  Awareness Provisioning in Collaboration Management , 2002, Int. J. Cooperative Inf. Syst..

[8]  Ramakant Nevatia,et al.  Video-based event recognition: activity representation and probabilistic recognition methods , 2004, Comput. Vis. Image Underst..

[9]  Sharma Chakravarthy,et al.  Snoop: An Expressive Event Specification Language for Active Databases , 1994, Data Knowl. Eng..

[10]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[11]  Jennifer Widom,et al.  Resource Sharing in Continuous Sliding-Window Aggregates , 2004, VLDB.

[12]  Wolfgang Klas,et al.  L/MRP: A Buffer Management Strategy for Interactive Continuous Data Flows in a Multimedia DBMS , 1995, VLDB.

[13]  Ying Xing,et al.  The Design of the Borealis Stream Processing Engine , 2005, CIDR.

[14]  Anthony R. Cassandra,et al.  CEDMOS: Complex Event Detection and Monitoring System , 1999 .

[15]  David Sankoff,et al.  Time Warps, String Edits, and Macromolecules: The Theory and Practice of Sequence Comparison , 1983 .