A Multi-agent System for Infrared and Color Video Fusion

Nowadays, the use of heterogeneous cameras is preferred to develop robust monitoring systems. Under multi-camera setups, information fusion processes are required to improve the results independently obtained from each installed camera. In addition, multi-agent systems are designed to face up the development of complex systems such as advanced monitoring systems. This paper describes the use of INT 3 technologies to develop an agent-based robust people detection and tracking system completed by a scheme for infrared and color video fusion. The system development process covers from the modeling to the implementation of the system. The meaning of the levels selected by an analyst is detailed as well as the components required to fulfil the requirements for human detection and tracking. The proposed approach has the ability to make decisions about the convenience to fuse visible and infrared spectra information.

[1]  Jorge J. Gómez-Sanz,et al.  Development of intelligent multisensor surveillance systems with agents , 2007, Robotics Auton. Syst..

[2]  Cedric Nishan Canagarajah,et al.  Pixel- and region-based image fusion with complex wavelets , 2007, Inf. Fusion.

[3]  Antonio Fernández-Caballero,et al.  INT3-Horus framework for multispectrum activity interpretation in intelligent environments , 2013, Expert Syst. Appl..

[4]  Antonio Fernández-Caballero,et al.  A historical perspective of algorithmic lateral inhibition and accumulative computation in computer vision , 2011, Neurocomputing.

[5]  Riad I. Hammoud.  Augmented Vision Perception in Infrared , 2009 .

[6]  Riad I. Hammoud,et al.  Augmented Vision Perception in Infrared: Algorithms and Applied Systems , 2009 .

[7]  Antonio Fernández-Caballero,et al.  Agent-oriented modeling and development of a person-following mobile robot , 2011, Expert Syst. Appl..

[8]  Davide Carneiro,et al.  Multimodal behavioral analysis for non-invasive stress detection , 2012, Expert Syst. Appl..

[9]  Keyvan Nayyeri,et al.  Beginning ASP.NET MVC 1.0 , 2009 .

[10]  Antonio Fernández-Caballero,et al.  Engineering the development of systems for multisensory monitoring and activity interpretation , 2014, Int. J. Syst. Sci..

[11]  Michael Wooldridge,et al.  An Introduction to MultiAgent Systems John Wiley & Sons , 2002 .

[12]  Paulo Novais,et al.  Sensor-driven agenda for intelligent home care of the elderly , 2012, Expert Syst. Appl..

[13]  Antonio Fernández-Caballero,et al.  Robust Human Detection and Tracking in Intelligent Environments by Information Fusion of Color and Infrared Video , 2011, 2011 Seventh International Conference on Intelligent Environments.

[14]  Antonio Fernández-Caballero,et al.  Real-time human segmentation in infrared videos , 2011, Expert Syst. Appl..

[15]  Mongi A. Abidi,et al.  Data fusion in robotics and machine intelligence , 1992 .

[16]  Aladdin Ayesh,et al.  Multi-agent system for people detection and tracking using stereo vision in mobile robots , 2009, Robotica.

[17]  Danny Weyns.  Architecture-Based Design of Multi-Agent Systems , 2010 .

[18]  Miguel A. Patricio,et al.  A Multi-agent Architecture Based on the BDI Model for Data Fusion in Visual Sensor Networks , 2011, J. Intell. Robotic Syst..