A Dialog Action Manager for automatic crisis management

This paper presents the results of our research on the development of a Dialog Action Manager – DAM as part of a complex crisis management system. Imagine the utility of such an automatic system to detect the crisis and to provide support to people in contexts similar to what happened recently at the underground in London and Madrid. Preventing and handling the scenarios of terrorism and other crisis are nowadays maybe the most important issues for a modern and safe society. In order to automate the crisis support, DAM simulates the behavior of an employee at the crisis centre handling telephone calls from human observers. Firstly, the system has to mimic the natural support for the paradigm ‘do you hear me?’ and next for the paradigm ‘do you understand me?’. The people witnessing the crisis event as well as human experts provide reports and expertise according to their observations and knowledge on the crisis. The system knowledge and the data communication follow the XML format specifications. The system is centered on the results of our previous work on creating a user-centered multimodal reporting tool that works on mobile devices. In our paper we describe the mechanisms for creating an automatic DAM system that is able to analyze the user messages, to identify and track the crisis contexts, to support dialogs for crisis information disambiguation and to generate feedback in the form of advice to the users. The reasoning is done by using a data frame and rule based system architecture and an alternative Bayesian Network approach. In the paper we also present a series of experiments we have attempted in our endeavor to correctly identify natural solutions for the crisis situations.

[1]  Margo I. Seltzer,et al.  A Dynamic, Data-Driven, Decision Support System for Emergency Medical Services , 2005, International Conference on Computational Science.

[2]  Léon J. M. Rothkrantz,et al.  A System for Adaptive Multimodal Interaction in Crisis Environments , 2007, HCI.

[3]  Bogdan Tatomir Crisis Management using Mobile ad-hoc Wireless Networks , 2005 .

[4]  Nicholas Roy,et al.  Efficient model learning for dialog management , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[5]  Léon J. M. Rothkrantz,et al.  Dynamic Scripting in Crisis Environments , 2007, HCI.

[6]  Léon J. M. Rothkrantz,et al.  Multimodal Dialogue Management , 2004, TSD.

[7]  J. B. van Veelen,et al.  Effective and Efficient Coordination Strategies for Agile Crisis Response Organizations , 2006 .

[8]  L. J. M. Rothkrantz,et al.  Personal Mobile Support for Crisis Management Using Ad-Hoc Networks , 2005 .

[9]  Kok Wai Wong,et al.  A Crisis Communication Network Based on Embodied Conversational Agents System with Mobile Services , 2006 .

[10]  Léon J. M. Rothkrantz,et al.  Multimodal Dialog Management , 2005 .

[11]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.

[12]  Hui Ye,et al.  The Hidden Information State Approach to Dialog Management , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[13]  Hans Weigand Agent Community Support for Crisis-Response Organizations , 2006, OTM Workshops.

[14]  Zahir Tari,et al.  On the Move to Meaningful Internet Systems. OTM 2018 Conferences , 2018, Lecture Notes in Computer Science.

[15]  Nandan Parameswaran,et al.  Situation-Aware Multi-Agent System for Disaster Relief Operations Management , 2006 .

[16]  Alexander H. Waibel,et al.  Dialogue management for multimodal user registration , 2000, INTERSPEECH.

[17]  Joseph P. Macker,et al.  Mobile Ad hoc Networking (MANET): Routing Protocol Performance Issues and Evaluation Considerations , 1999, RFC.