Integrated Data Management for a Fleet of Search‐and‐rescue Robots

Search-and-rescue operations have recently been confronted with the introduction of robotic tools that assist the human search-and-rescue workers in their dangerous but life-saving job of searching for human survivors after major catastrophes. However, the world of search and rescue is highly reliant on strict procedures for the transfer of messages, alarms, data, and command and control over the deployed assets. The introduction of robotic tools into this world causes an important structural change in this procedural toolchain. Moreover, the introduction of search-and-rescue robots acting as data gatherers could potentially lead to an information overload toward the human search-and-rescue workers, if the data acquired by these robotic tools are not managed in an intelligent way. With that in mind, we present in this paper an integrated data combination and data management architecture that is able to accommodate real-time data gathered by a fleet of robotic vehicles on a crisis site, and we present and publish these data in a way that is easy to understand by end-users. In the scope of this paper, a fleet of unmanned ground and aerial search-and-rescue vehicles is considered, developed within the scope of the European ICARUS project. As a first step toward the integrated data-management methodology, the different robotic systems require an interoperable framework in order to pass data from one to another and toward the unified command and control station. As a second step, a data fusion methodology will be presented, combining the data acquired by the different heterogenic robotic systems. The computation needed for this process is done in a novel mobile data center and then (as a third step) published in a software as a service (SaaS) model. The SaaS model helps in providing access to robotic data over ubiquitous Ethernet connections. As a final step, we show how the presented data-management architecture allows for reusing recorded exercises with real robots and rescue teams for training purposes and teaching search-and-rescue personnel how to handle the different robotic tools. The system was validated in two experiments. First, in the controlled environment of a military testing base, a fleet of unmanned ground and aerial vehicles was deployed in an earthquake-response scenario. The data gathered by the different interoperable robotic systems were combined by a novel mobile data center and presented to the end-user public. Second, an unmanned aerial system was deployed on an actual mission with an international relief team to help with the relief operations after major flooding in Bosnia in the spring of 2014. Due to the nature of the event (floods), no ground vehicles were deployed here, but all data acquired by the aerial system (mainly three-dimensional maps) were stored in the ICARUS data center, where they were securely published for authorized personnel all over the world. This mission (which is, to our knowledge, the first recorded deployment of an unmanned aerial system by an official governmental international search-and-rescue team in another country) proved also the concept of the procedural integration of the ICARUS data management system into the existing procedural toolchain of the search and rescue workers, and this in an international context (deployment from Belgium to Bosnia). The feedback received from the search-and-rescue personnel on both validation exercises was highly positive, proving that the ICARUS data management system can efficiently increase the situational awareness of the search-and-rescue personnel.

[2]  Daniel Serrano,et al.  The EU-ICARUS project: Developing assistive robotic tools for search and rescue operations , 2013, 2013 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[3]  Roland Siegwart,et al.  Robust state estimation for small unmanned airplanes , 2014, 2014 IEEE Conference on Control Applications (CCA).

[4]  Daniela Doroftei,et al.  UAS deployment and data processing during the Balkans flooding , 2014, 2014 IEEE International Symposium on Safety, Security, and Rescue Robotics (2014).

[5]  Wolfram Burgard,et al.  An Efficient Extension to Elevation Maps for Outdoor Terrain Mapping and Loop Closing , 2007, Int. J. Robotics Res..

[6]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Joachim Hertzberg,et al.  3D Mapping with Semantic Knowledge , 2005, RoboCup.

[8]  Daniela Doroftei,et al.  Development of an autonomous rough-terrain robot , 2012 .

[9]  Lorenzo Marconi,et al.  Ground and aerial robots as an aid to alpine search and rescue: Initial SHERPA outcomes , 2013, 2013 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[10]  Joachim Hertzberg,et al.  Globally consistent 3D mapping with scan matching , 2008, Robotics Auton. Syst..

[11]  Thomas Bräunl,et al.  Cooperative multi-robot navigation, exploration, mapping and object detection with ROS , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[12]  Lino Marques,et al.  TIRAMISU : FP7-Project for an integrated toolbox in Humanitarian Demining, focus on UGV, UAV and te , 2013 .

[13]  Lyuba Alboul,et al.  Multi-robot team formation control in the GUARDIANS project , 2010, Ind. Robot.

[14]  Daniel Serrano,et al.  illustrated in Figure 1. Urban search-and-rescue in the context of ICARUS is synonymous with operations in human inhabited regions in the aftermath of natural or man-made disasters such as earthquakes and industrial accidents. MSAR , 2013 .

[15]  Robin R. Murphy,et al.  Trial by fire [rescue robots] , 2004, IEEE Robotics & Automation Magazine.

[16]  Piotr Kaczmarek,et al.  RECOGNITION OF 3D OBJECTS FOR WALKING ROBOT EQUIPPED WITH MULTISENSE-SL SENSOR HEAD * , 2013 .

[17]  Leif Heckes,et al.  Study of efficiency of USAR operations with assistive technologies , 2013, Adv. Robotics.

[18]  Ryosuke Shibasaki,et al.  UAV-Borne 3-D Mapping System by Multisensor Integration , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Roland Siegwart,et al.  Explicit model predictive control and L1-navigation strategies for fixed-wing UAV path tracking , 2014, 22nd Mediterranean Conference on Control and Automation.

[20]  A. Gasteratos,et al.  VIEW-FINDER : Robotics assistance to fire-fighting services and Crisis Management , 2009, 2009 IEEE International Workshop on Safety, Security & Rescue Robotics (SSRR 2009).

[21]  G. Nejat,et al.  3-D Active Sensing in Time-Critical Urban Search and Rescue Missions , 2012, IEEE/ASME Transactions on Mechatronics.

[22]  Roland Siegwart,et al.  Experience in system design for human-robot teaming in urban search & rescue , 2014 .

[23]  Roland Siegwart,et al.  A synchronized visual-inertial sensor system with FPGA pre-processing for accurate real-time SLAM , 2014, ICRA 2014.

[24]  Paolo Fiorini,et al.  Search and Rescue Robotics , 2008, Springer Handbook of Robotics.

[25]  Tomás Svoboda,et al.  Designing Intelligent Robots for Human-Robot Teaming in Urban Search and Rescue , 2012, AAAI Spring Symposium: Designing Intelligent Robots.

[26]  Stefano Carpin,et al.  USARSim: a robot simulator for research and education , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[27]  Matthew N. Dailey,et al.  Rapid 3D visualization of indoor scenes using 3D occupancy grid isosurfaces , 2009, 2009 6th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology.

[28]  Giorgio Guglieri,et al.  Ground Control Station Embedded Mission Planning for UAS , 2013, J. Intell. Robotic Syst..

[29]  Hong Guo,et al.  A novel 3D sensory system for robot-assisted mapping of cluttered urban search and rescue environments , 2011, Intell. Serv. Robotics.

[30]  Basilio Bona,et al.  Sliding Autonomy in Cloud Robotics Services for Smart City Applications , 2015, HRI.

[31]  Andreas Nüchter,et al.  General Purpose Computing on Graphics Processing Units for Robotic Applications , 2013 .

[32]  D. Erdos,et al.  An experimental UAV system for search and rescue challenge , 2013, IEEE Aerospace and Electronic Systems Magazine.

[33]  Chunming Liu,et al.  A Kinect-based 3D sensing and human action recognition solution for urban search and rescue environments , 2013, 2013 IEEE RO-MAN.

[34]  Hichem Sahli,et al.  Terrain Traversability Analysis for off-road robots using Time-Of-Flight 3D Sensing , 2013 .

[35]  Michael A. Goodrich,et al.  Ecological Interfaces for Improving Mobile Robot Teleoperation , 2007, IEEE Transactions on Robotics.

[36]  Alexander Ferworn,et al.  3D Disaster Scene Reconstruction Using a Canine-Mounted RGB-D Sensor , 2013, 2013 International Conference on Computer and Robot Vision.

[37]  Goldie Nejat,et al.  Robotic Urban Search and Rescue: A Survey from the Control Perspective , 2013, J. Intell. Robotic Syst..

[38]  Charalampos Stergiopoulos,et al.  DARIUS project: Deployable SAR integrated chain with unmanned systems , 2012, 2012 International Conference on Telecommunications and Multimedia (TEMU).

[39]  Darius Burschka,et al.  Toward a Fully Autonomous UAV: Research Platform for Indoor and Outdoor Urban Search and Rescue , 2012, IEEE Robotics & Automation Magazine.

[40]  Daniela Doroftei,et al.  Designing Search and Rescue Robots towards Realistic User Requirements , 2014 .

[41]  João Borges de Sousa,et al.  Mission planning and specification in the Neptus framework , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[42]  Myung Jin Chung,et al.  Geometric-featured voxel maps for 3D mapping in urban environments , 2011, 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics.

[43]  Alberto Broggi,et al.  A full-3D voxel-based dynamic obstacle detection for urban scenario using stereo vision , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[44]  Matteo Menna,et al.  An Augmented Reality approach for trajectory planning and control of tracked vehicles in rescue environments , 2013, 2013 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[45]  Stefan Kohlbrecher,et al.  A flexible and scalable SLAM system with full 3D motion estimation , 2011, 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics.

[46]  Janusz Bedkowski,et al.  Real time 3D localization and mapping for USAR robotic application , 2012, Ind. Robot.

[47]  Daniela Doroftei,et al.  Towards collaborative human and robotic rescue workers , 2012 .