A Framework for Multisensory Intelligent Monitoring and Interpretation of Behaviors through Information Fusion

Modern intelligent monitoring and interpretation systems manage several kinds of heterogeneous sensor networks and use outstanding segmentation and tracking algorithms. Monitoring has evolved from initial systems based on low resolution cameras, directly connected to a monitor, up to distributed systems where several sensors cooperate not only to track objects of interest but also to detect suspicious behaviors based on artificial intelligence techniques. In our opinion, frameworks are essential to provide design and implementation patterns for generating a widespread variety of monitoring and interpretation applications, allowing the interaction of different modules and the reuse of code. In this sense, this paper proposes the implementation of a multi sensory monitoring and interpretation framework based on the model-view-controller paradigm but extended to distributed intelligent systems.

[1]  Antonio Fernández-Caballero,et al.  Optical flow or image subtraction in human detection from infrared camera on mobile robot , 2010, Robotics Auton. Syst..

[2]  Dan Schonfeld,et al.  A new method for tracking performance evaluation based on a reflective model and perturbation analysis , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[3]  Takeo Kanade,et al.  A System for Video Surveillance and Monitoring , 2000 .

[4]  Juan Moreno García,et al.  Video sequence motion tracking by fuzzification techniques , 2010, Appl. Soft Comput..

[5]  Antonio Fernández-Caballero,et al.  On the use of agent technology in intelligent, multisensory and distributed surveillance , 2011, Knowl. Eng. Rev..

[6]  Jorge J. Gómez-Sanz,et al.  Development of intelligent multisensor surveillance systems with agents , 2007, Robotics Auton. Syst..

[7]  Hilary Buxton,et al.  Learning and understanding dynamic scene activity: a review , 2003, Image Vis. Comput..

[8]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Gian Luca Foresti,et al.  Ambient Intelligence: A New Multidisciplinary Paradigm , 2005 .

[10]  George Spanoudakis,et al.  A Pattern-Driven Framework for Monitoring Security and Dependability , 2007, TrustBus.

[11]  J. Krumm,et al.  Multi-camera multi-person tracking for EasyLiving , 2000, Proceedings Third IEEE International Workshop on Visual Surveillance.

[12]  Tim J. Ellis,et al.  Bridging the gaps between cameras , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[13]  Antonio Fernández-Caballero,et al.  Real-time human segmentation in infrared videos , 2011, Expert Syst. Appl..

[14]  Ming Xu,et al.  Architecture and algorithms for tracking football players with multiple cameras , 2005 .

[15]  Sergio A. Velastin,et al.  Fusing Visual and Audio Information in a Distributed Intelligent Surveillance System for Public Transport Systems , 2003 .

[16]  X. Koutsoukos,et al.  Target tracking in urban environments using audio-video signal processing in heterogeneous wireless sensor networks , 2008, 2008 42nd Asilomar Conference on Signals, Systems and Computers.

[17]  Antonio Fern Development of intelligent multisensor surveillance systems with agents , 2007 .

[18]  Antonio Fernández Caballero,et al.  On the use of agent technology in intelligent, multi-sensory and distributed surveillance , 2011 .

[19]  Antonio Fernández-Caballero,et al.  A Proposal for Local and Global Human Activities Identification , 2010, AMDO.

[20]  Gian Luca Foresti,et al.  Guest Editorial: Video Processing and Communications in Real-Time Surveillance Systems , 2001, Real Time Imaging.

[21]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..