Team communication processing and process analytics for supporting robot-assisted emergency response

Mobile robots can provide significant operational advantages in emergency response missions. With increasing autonomy robots need knowledge of the current mission in order to be able to properly contribute to it. We propose to acquire mission knowledge by interpreting the verbal communication among the human response-team members and to use process mining techniques to ground the interpretations in analyses of mission process data and corresponding reference models. We also present a novel concept of mission assistance that uses the acquired mission knowledge to support the first responders' work processes both during and after the mission. The assistance functions include process assistance for the coordination of human-robot team operations; automatic mission documentation generation; and process modeling for first responder training. We describe the architecture of our system and the design and current implementation state of its components: Speech Processing, Mission-Knowledge Management, Process Mining, and Process Assistance. We build on concepts that were evaluated and validated by first responders in a previous project; our extensions have been assessed qualitatively and will be further evaluated in the course of our current project.

[1]  Mathias Weske,et al.  Business Process Model Abstraction , 2015, Handbook on Business Process Management.

[2]  Georgios Paliouras,et al.  Ontology-Based Rescue Operation Management , 2008, Mobile Response.

[3]  Koen V. Hindriks,et al.  Persistent Robot-Assisted Disaster Response , 2018, HRI.

[4]  Tina Mioch,et al.  Improving Adaptive Human-Robot Cooperation through Work Agreements , 2018, 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[5]  Symeon Chatzinotas,et al.  SHARE-ODS: An Ontology Data Service for Search and Rescue Operations , 2006, SETN.

[6]  Stefan Sackmann,et al.  Gaining Flexibility and Compliance in Rescue Processes with BPM , 2011, 2011 Sixth International Conference on Availability, Reliability and Security.

[7]  Roland Siegwart,et al.  Designing, developing, and deploying systems to support human–robot teams in disaster response , 2014, Adv. Robotics.

[8]  Uwe Rueppel,et al.  Improving emergency management by formal dynamic process-modelling , 2007 .

[9]  Thomas Rose,et al.  The myth of business process modelling for emergency management planning , 2012, ISCRAM.

[10]  Hans-Ulrich Krieger,et al.  Extending OWL Ontologies by Cartesian Types to Represent N-ary Relations in Natural Language , 2015 .

[11]  Sander J. J. Leemans,et al.  Discovering Block-Structured Process Models from Event Logs Containing Infrequent Behaviour , 2013, Business Process Management Workshops.

[13]  Arne Köhn,et al.  Open Source Automatic Speech Recognition for German , 2018, ITG Symposium on Speech Communication.

[14]  Ivana Kruijff-Korbayová,et al.  Dialogue Act Classification in Team Communication for Robot Assisted Disaster Response , 2019, SIGdial.

[15]  Koen V. Hindriks,et al.  Ontology Design for Task Allocation and Management in Urban Search and Rescue Missions , 2018, ICAART.

[16]  Walter Kasper Team monitoring and reporting for robot-assisted USAR missions , 2016, 2016 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[17]  Fereshta Yazdani,et al.  Cognition-enabled Framework for Mixed Human-Robot Rescue Teams , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  Daniel Povey,et al.  The Kaldi Speech Recognition Toolkit , 2011 .

[19]  Peter Loos,et al.  A graph-theoretic method for the inductive development of reference process models , 2017, Software & Systems Modeling.

[20]  Tomas Mikolov,et al.  Advances in Pre-Training Distributed Word Representations , 2017, LREC.

[21]  Peter Loos,et al.  Identification of Business Process Models in a Digital World , 2015, BPM.

[22]  Peter Loos,et al.  Perspectives on Reference Modeling , 2007 .