Engineering the development of systems for multisensory monitoring and activity interpretation

Multisensory monitoring and activity interpretation systems are being increasingly used as a suitable means to detect situations and make decisions in an intelligent manner. However, there is a lack of formalised processes that guide the stakeholders in their development. Most of the current proposals focus on the implementation and evaluation of low-level algorithms. In order to overcome this lack, a process called INT3-SDP that guides stakeholders in the development of systems capable of carrying out multisensory monitoring and INTerpretation of behaviours and situations for an INTelligent INTervention in complex and dynamic environments is described in this paper. In this work, it is described how INT3-SDP provides the analysts with the guidelines and models necessary for the description of the environment to be monitored and the sensors to be installed, as well as in the implementation of the software components that perform the monitoring and activity interpretation tasks. Moreover, a case study is also presented in order to illustrate how INT3-SDP is put into practice.

[1]  WeiQi Yan,et al.  A Framework for an Event Driven Video Surveillance System , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[2]  Paulo Novais,et al.  Sensor-driven agenda for intelligent home care of the elderly , 2012, Expert Syst. Appl..

[3]  Iosif-Viorel Onut,et al.  Smart surveillance system applications , 2010, CASCON.

[4]  Jia You,et al.  Observer-based controller design for networked control systems with sensor quantisation and random communication delay , 2012, Int. J. Syst. Sci..

[5]  Antonio Fernández-Caballero,et al.  Optical flow or image subtraction in human detection from infrared camera on mobile robot , 2010, Robotics Auton. Syst..

[6]  Alex Zelinsky,et al.  Learning OpenCV---Computer Vision with the OpenCV Library (Bradski, G.R. et al.; 2008)[On the Shelf] , 2009, IEEE Robotics & Automation Magazine.

[7]  Rita Cucchiara,et al.  Using computer vision techniques for dangerous situation detection in domotic applications , 2004 .

[8]  Gregory D. Abowd,et al.  Towards a Better Understanding of Context and Context-Awareness , 1999, HUC.

[9]  Antonio Fern Development of intelligent multisensor surveillance systems with agents , 2007 .

[10]  Javier Cámara,et al.  Interactive Specification and Verification of Behavioural Adaptation Contracts , 2009, 2009 Ninth International Conference on Quality Software.

[11]  Yee-Ming Chen,et al.  Multisensor data fusion for manoeuvring target tracking , 2001, Int. J. Syst. Sci..

[12]  Davide Carneiro,et al.  Multimodal behavioral analysis for non-invasive stress detection , 2012, Expert Syst. Appl..

[13]  Antonio Fernández Caballero,et al.  On the use of agent technology in intelligent, multi-sensory and distributed surveillance , 2011 .

[14]  Bijan Davvaz,et al.  Fuzzy (m, n)-ary sub-hypermodules (with thresholds) , 2012, J. Intell. Fuzzy Syst..

[15]  GascueñaJosé m.,et al.  Review: on the use of agent technology in intelligent, multisensory and distributed surveillance , 2011 .

[16]  Javier Medina,et al.  Intelligent surveillance system with integration of heterogeneous information for intrusion detection , 2011, Expert Syst. Appl..

[17]  Zhi-Hong Guan,et al.  Finite-time consensus for leader-following second-order multi-agent system , 2013, Int. J. Syst. Sci..

[18]  Yee-Ming Chen,et al.  Multisensor data fusion for manoeuvring target tracking , 2001 .

[19]  Mathieu Acher,et al.  Tackling high variability in video surveillance systems through a model transformation approach , 2009, 2009 ICSE Workshop on Modeling in Software Engineering.

[20]  Felix Opitz,et al.  An object oriented development suite for data fusion: Design, generation, simulation and testing , 2007, 2007 10th International Conference on Information Fusion.

[21]  Davide Carneiro,et al.  Stress Monitoring in Conflict Resolution Situations , 2012, ISAmI.

[22]  James F. Whidborne,et al.  Optimised configuration of sensors for fault tolerant control of an electro-magnetic suspension system , 2012, Int. J. Syst. Sci..

[23]  Antonio Fernández-Caballero,et al.  Human activity monitoring by local and global finite state machines , 2012, Expert Syst. Appl..

[24]  Elena Navarro,et al.  Model-driven engineering techniques for the development of multi-agent systems , 2012, Eng. Appl. Artif. Intell..

[25]  Yukie Ikedaa,et al.  Knowledge Based and Intelligent Information and Engineering Systems An Evacuation Route Planning for Safety Route Guidance System after Natural Disaster Using Multi-Objective Genetic Algorithm , 2016 .

[26]  Antonio Fernández-Caballero,et al.  On the use of agent technology in intelligent, multisensory and distributed surveillance , 2011, Knowl. Eng. Rev..

[27]  Antonio Fernández-Caballero,et al.  Intelligent Monitoring and Activity Interpretation Framework - INT3-Horus General Description , 2012, KES.

[28]  Antonio Fernández-Caballero,et al.  Knowledge modeling through computational agents: application to surveillance systems , 2011, Expert Syst. J. Knowl. Eng..

[29]  Matjaz Gams,et al.  Context-aware MAS to support elderly people (demonstration) , 2012, AAMAS.

[30]  Wilbert E. Wilhelm,et al.  Branch-and-Price Decomposition to Design a Surveillance System for Port and Waterway Security , 2010, IEEE Transactions on Automation Science and Engineering.

[31]  Debasish Ghose,et al.  Performance of a class of multi-robot deploy and search strategies based on centroidal voronoi configurations , 2009, Int. J. Syst. Sci..

[32]  Jorge J. Gómez-Sanz,et al.  Development of intelligent multisensor surveillance systems with agents , 2007, Robotics Auton. Syst..

[33]  Antonio Fernández-Caballero,et al.  A fuzzy model for human fall detection in infrared video , 2013, J. Intell. Fuzzy Syst..

[34]  Yo-Ping Huang,et al.  Ubiquitous Information Transfer across Different Platforms by QR Codes , 2010, J. Mobile Multimedia.

[35]  Wouter Joosen,et al.  Context-driven dynamic organizations applied to coordinated monitoring of traffic jams , 2007 .

[36]  Hichem Snoussi,et al.  Collaborative multi-target tracking in wireless sensor networks , 2011, Int. J. Syst. Sci..

[37]  Luis Jiménez,et al.  A multi-agent architecture for supporting distributed normality-based intelligent surveillance , 2011, Eng. Appl. Artif. Intell..

[38]  Bernhard Bauer,et al.  UML 2.0 and agents: how to build agent-based systems with the new UML standard , 2005, Eng. Appl. Artif. Intell..

[39]  Frank Budinsky,et al.  Eclipse Modeling Framework , 2003 .

[40]  Tao Li,et al.  Finite-Time Consensus for Leader-Following Second-Order Multi-Agent Networks , 2012, IEEE Transactions on Circuits and Systems I: Regular Papers.

[41]  Gary R. Bradski,et al.  Learning OpenCV 3: Computer Vision in C++ with the OpenCV Library , 2016 .

[42]  Xin-Ping Guan,et al.  Decentralised control for formation reorganisation of multi-agent systems using a virtual leader , 2011, Int. J. Syst. Sci..

[43]  Miguel A. Patricio,et al.  A Multi-agent Architecture Based on the BDI Model for Data Fusion in Visual Sensor Networks , 2011, J. Intell. Robotic Syst..