Smart resource-aware multimedia sensor network for automatic detection of complex events

This paper presents a smart resource-aware multimedia sensor network. We illustrate a surveillance system which supports human operators, by automatically detecting the complex events and giving the possibility to recall the detected events and searching them in an intelligent search engine. Four subsystems have been implemented, the tracking and detection system, the network configuration system, the reasoning system and an advanced archiving system in an annotated multimedia database.

[1]  Mieczyslaw M. Kokar,et al.  Using SWRL and OWL to Capture Domain Knowledge for a Situation Awareness Application Applied to a Supply Logistics Scenario , 2005, RuleML.

[2]  Björn Schuller,et al.  Multi-Camera Person Tracking and Left Luggage Detection Applying Homographic Transformation , 2007 .

[3]  Xu Ying,et al.  Research on Context Modeling Based on Ontology , 2006, 2006 International Conference on Computational Inteligence for Modelling Control and Automation and International Conference on Intelligent Agents Web Technologies and International Commerce (CIMCA'06).

[4]  Noel E. O'Connor,et al.  Event detection in field sports video using audio-visual features and a support vector Machine , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  James F. Allen,et al.  Actions and Events in Interval Temporal Logic , 1994 .

[6]  Gian Luca Foresti,et al.  Detecting moving people in video streams , 2005, Pattern Recognit. Lett..

[7]  Guiling Wang,et al.  A Context Model for Collaborative Environment , 2006, 2006 10th International Conference on Computer Supported Cooperative Work in Design.

[8]  Gian Luca Foresti,et al.  Trajectory-Based Anomalous Event Detection , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Thomas Eiter,et al.  Towards automated integration of guess and check programs in answer set programming: a meta-interpreter and applications , 2004, Theory and Practice of Logic Programming.

[10]  Alexander Artikis,et al.  Behaviour Recognition using the Event Calculus , 2009, AIAI.

[11]  Richard J. Howarth,et al.  Interpreting a Dynamic and Uncertain World: Task-Based Control , 1998, Artif. Intell..

[12]  Gian Luca Foresti,et al.  Representing and recognizing complex events in surveillance applications , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[13]  Larry S. Davis,et al.  Event Modeling and Recognition Using Markov Logic Networks , 2008, ECCV.

[14]  Mubarak Shah,et al.  Learning, detection and representation of multi-agent events in videos , 2007, Artif. Intell..

[15]  Kwang-Eun Ko,et al.  Development of context aware system based on Bayesian network driven context reasoning method and ontology context modeling , 2008, 2008 International Conference on Control, Automation and Systems.

[16]  Jesse Hoey,et al.  Automated Detection of Unusual Events on Stairs , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[17]  Tao Gu,et al.  Ontology based context modeling and reasoning using OWL , 2004, IEEE Annual Conference on Pervasive Computing and Communications Workshops, 2004. Proceedings of the Second.

[18]  Larry S. Davis,et al.  VidMAP: video monitoring of activity with Prolog , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[19]  Avigdor Gal,et al.  Complex event processing over uncertain data , 2008, DEBS.

[20]  Larry S. Davis,et al.  Multivalued Default Logic for Identity Maintenance in Visual Surveillance , 2006, ECCV.

[21]  Sim Heng Ong,et al.  Probability Hypothesis Density Approach for Multi-camera Multi-object Tracking , 2007, ACCV.

[22]  Gyula Simon,et al.  Shooter localization in urban terrain , 2004, Computer.

[23]  Monique Thonnat,et al.  Audio-Video Event Recognition System for Public Transport Security , 2006 .

[24]  Young-Koo Lee,et al.  Modeling and reasoning about uncertainty in context-aware systems , 2005, IEEE International Conference on e-Business Engineering (ICEBE'05).

[25]  Gerhard Brewka,et al.  Logic programming with ordered disjunction , 2002, NMR.

[26]  Björn W. Schuller,et al.  Video based online behavior detection using probabilistic multi stream fusion , 2005, ICIP.

[27]  Claudia Linnhoff-Popien,et al.  A Context Modeling Survey , 2004 .

[28]  Jacob Benesty,et al.  Robust time delay estimation exploiting redundancy among multiple microphones , 2003, IEEE Trans. Speech Audio Process..

[29]  Gregory F. Cooper,et al.  A Bayesian network model for spatial event surveillance , 2010, Int. J. Approx. Reason..

[30]  How a visual surveillance system hypothesizes how you behave , 2006, Behavior research methods.

[31]  Alexander Artikis,et al.  A logic programming approach to activity recognition , 2009, EiMM '10.

[32]  Yves Demazeau,et al.  Principles and techniques for sensor data fusion , 1993, Signal Process..

[33]  Yo-Ping Huang,et al.  An intelligent strategy for the automatic detection of highlights in tennis video recordings , 2009, Expert Syst. Appl..