A Visualization‐Based Analysis System for Urban Search & Rescue Mission Planning Support

We propose a visualization system for incident commanders (ICs) in urban search and rescue scenarios that supports path planning in post‐disaster structures. Utilizing point cloud data acquired from unmanned robots, we provide methods for the assessment of automatically generated paths. As data uncertainty and a priori unknown information make fully automated systems impractical, we present the IC with a set of viable access paths, based on varying risk factors, in a 3D environment combined with visual analysis tools enabling informed decision making and trade‐offs. Based on these decisions, a responder is guided along the path by the IC, who can interactively annotate and reevaluate the acquired point cloud and generated paths to react to the dynamics of the situation. We describe visualization design considerations for our system and decision support systems in general, technical realizations of the visualization components, and discuss the results of two qualitative expert evaluation; one online study with nine search and rescue experts and an eye‐tracking study in which four experts used the system on an application case.

[1]  Jonas Lundberg,et al.  Resilience in sensemaking and control of emergency response , 2012 .

[2]  Jing Li,et al.  Judging Correlation from Scatterplots and Parallel Coordinate Plots , 2010, Inf. Vis..

[3]  S. Wirth,et al.  Exploration Transform: A stable exploring algorithm for robots in rescue environments , 2007, 2007 IEEE International Workshop on Safety, Security and Rescue Robotics.

[4]  C. Everitt.  Projective texture mapping , 2001 .

[5]  Gennady L. Andrienko,et al.  Informed Spatial Decisions Through Coordinated Views , 2003, Inf. Vis..

[6]  David S. Ebert,et al.  Mobile analytics for emergency response and training , 2008 .

[7]  Wenyi Zhao,et al.  Alignment of Continuous Video onto 3D Point Clouds , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[9]  David S. Ebert,et al.  Mobile Analytics for Emergency Response and Training , 2008, Inf. Vis..

[10]  Hui Xu,et al.  Stylized rendering of 3D scanned real world environments , 2004, NPAR '04.

[11]  Erik Hollnagel,et al.  Joint Cognitive Systems: Foundations of Cognitive Systems Engineering , 2005 .

[12]  Stefan Kohlbrecher,et al.  A flexible and scalable SLAM system with full 3D motion estimation , 2011, 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics.

[13]  Federica Pascucci,et al.  An Indoor localization Framework for Hybrid Rescue Teams , 2011 .

[14]  Laura A. Whitlock,et al.  Ergonomics in Design : The Quarterly of Human Factors Applications , 2012 .

[15]  Mark Harris.  The way through the flames , 2013, IEEE Spectrum.

[16]  Andreas Birk,et al.  The Jacobs map analysis toolkit , 2008 .

[17]  Jürgen Döllner,et al.  Out-of-core real-time visualization of massive 3D point clouds , 2010, AFRIGRAPH '10.

[18]  Timo Ropinski,et al.  Supporting Urban Search & Rescue Mission Planning through Visualization-Based Analysis , 2014, VMV.

[19]  Ruggero Pintus,et al.  Real-time Rendering of Massive Unstructured Raw Point Clouds using Screen-space Operators , 2011, VAST.

[20]  Wenyi Zhao,et al.  Alignment of continuous video onto 3D point clouds , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Hans-Werner Gellersen,et al.  Location and Navigation Support for Emergency Responders: A Survey , 2010, IEEE Pervasive Computing.

[22]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..

[23]  Amitava Datta,et al.  A parallel coordinates style interface for exploratory volume visualization , 2005, IEEE Transactions on Visualization and Computer Graphics.

[24]  Alexander Kleiner,et al.  Operator-assistive mapping in harsh environments , 2009, 2009 IEEE International Workshop on Safety, Security & Rescue Robotics (SSRR 2009).

[25]  Dennis Proffitt,et al.  Quantifying immersion in virtual reality , 1997, SIGGRAPH.

[26]  Christopher D. Wickens,et al.  When Users Want What's not Best for Them , 1995 .

[27]  Timo Ropinski,et al.  An interactive visualization system for urban search & rescue mission planning , 2014, 2014 IEEE International Symposium on Safety, Security, and Rescue Robotics (2014).

[28]  Kazuya Yoshida,et al.  Emergency response to the nuclear accident at the Fukushima Daiichi Nuclear Power Plants using mobile rescue robots , 2013, J. Field Robotics.

[29]  Jianfei Liu,et al.  Mobile application for first response and emergency evacuation in Urban settings , 2010, COM.Geo '10.

[30]  Daniel Weiskopf,et al.  Visual Analytics for Dynamic Evacuation Planning , 2012, EuroVA@EuroVis.

[31]  Roberta Calderwood,et al.  Decision models: some lessons from the field , 1991, IEEE Trans. Syst. Man Cybern..