Time Aware Task Delegation in Agent Interactions for Video-Surveillance

Cameras are everywhere and the interest towards distributed surveillance systems is growing both in academic research and commercial applications. Multi-Agent Systems (MASs) are ideal to design and develop such applications: distributed by nature, the capability of software agents to communicate using messages and interaction protocols can be exploited to coordinate and control distributed surveillance system. However, there is also the need to optimize the use of available resources as the bandwidth to achieve on-line performances for automatic analysis algorithms. In this regard, this paper presents a multi-agent distributed video surveillance system to perform face recognition. The main goal of the system is to reduce the need to transmit the frames to be analyzed over the network. Each node of the system checks the available elaboration time to decide whether the face recognition should be performed locally (in the node which detected the faces) or remotely (in other nodes of the system), delegating the task. To achieve the delegation, the agents interact via a market-based protocol, the Extended Contract Net Protocol (ECNP). The test results show a two order of magnitude decrease in the size of data transmitted over the network to perform the face recognition. In addition, the proposed agent architecture is a first step towards more general real-time compliant multi-agent systems, by using the elaboration time to regulate the agents’ behaviours. Future steps include a deeper analysis of the interactions among agents to meet strict time constraints.

[1]  Giorgio C. Buttazzo,et al.  Local Scheduling in Multi-Agent Systems: Getting Ready for Safety-Critical Scenarios , 2017, EUMAS/AT.

[2]  Andrea Omicini,et al.  Agent-based modeling for the self-management of chronic diseases: An exploratory study , 2017, Simul..

[3]  Giorgio C. Buttazzo,et al.  The challenge of real-time multi-agent systems for enabling IoT and CPS , 2017, WI.

[4]  Giorgio C. Buttazzo,et al.  Agent-Based Systems for Telerehabilitation: Strengths, Limitations and Future Challenges , 2017, A2HC@AAMAS/A-HEALTH@PAAMS.

[5]  Aldo Franco Dragoni,et al.  Event Calculus Agent Minds Applied to Diabetes Monitoring , 2017, AAMAS Workshops.

[6]  Paolo Sernani,et al.  Exploring the ambient assisted living domain: a systematic review , 2017, J. Ambient Intell. Humaniz. Comput..

[7]  Vitor Nazário Coelho,et al.  Multi-agent systems applied for energy systems integration: State-of-the-art applications and trends in microgrids , 2017 .

[8]  Mohan S. Kankanhalli,et al.  Multi-Camera Coordination and Control in Surveillance Systems , 2015, ACM Trans. Multim. Comput. Commun. Appl..

[9]  Zhuo Chen,et al.  Edge Analytics in the Internet of Things , 2015, IEEE Pervasive Computing.

[10]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Katia Obraczka,et al.  Wireless Smart Camera Networks for the Surveillance of Public Spaces , 2014, Computer.

[13]  José Barbosa,et al.  Bio-inspired multi-agent systems for reconfigurable manufacturing systems , 2012, Eng. Appl. Artif. Intell..

[14]  Léon J. M. Rothkrantz,et al.  Automated safety control by video cameras , 2012, CompSysTech '12.

[15]  Yongkang Wong,et al.  Patch-based probabilistic image quality assessment for face selection and improved video-based face recognition , 2011, CVPR 2011 WORKSHOPS.

[16]  Wu Chao,et al.  Multi-agent Based Distributed Video Surveillance System over IP , 2008, 2008 International Symposium on Computer Science and Computational Technology.

[17]  Álvaro García-Martín,et al.  DiVA: A Distributed Video Analysis Framework Applied to Video-Surveillance Systems , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[18]  Agostino Poggi,et al.  Developing Multi-agent Systems with JADE , 2007, ATAL.

[19]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Sergio A. Velastin,et al.  Intelligent distributed surveillance systems: a review , 2005 .

[21]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[22]  Nicholas R. Jennings,et al.  Intelligent agents: theory and practice , 1995, The Knowledge Engineering Review.

[23]  Ahmed M. Elmogy,et al.  Multi-robot Task Allocation: A Review of the State-of-the-Art , 2015, Advances in Social Media Analysis.

[24]  Alaa M. Khamis,et al.  A Comparative Study between Optimization and Market-Based Approaches to Multi-Robot Task Allocation , 2013, Adv. Artif. Intell..

[25]  P. Mohapatra,et al.  Distributed Video Surveillance Using Mobile Agents , 2011 .

[26]  Samir Aknine,et al.  An Extended Multi-Agent Negotiation Protocol , 2004, Autonomous Agents and Multi-Agent Systems.