Disaster scene reconstruction: modeling and simulating urban building collapse rubble within a game engine

Various natural and human-made events can occur in urban settings resulting in buildings collapsing and trapping victims. The task of a structural engineer is to survey the resulting rubble to assess its safety and arrange for structural stabilization, where necessary. Urban Search and Rescue (USAR) operations can then begin to locate and rescue people. Our previous work reported the use of an Unmanned Aerial Vehicle (UAV) equipped with a RGB-Depth sensor to build 3D point cloud models of disaster scenes. In this paper we extend this work by converting the point clouds into 3D models and importing them into a state-of-the-art game engine. We present a method to use these models to allow first responders to interact with the simulated rubble environment in real-time, without risk to human life. Experiments are conducted measuring traversal time both in the real world environment and using the simulation. We argue that this work will improve the safety of workers and allow a better understanding of extremely dangerous environments without unnecessary exposure during disaster response planning.

[1]  John J. Leonard,et al.  Kintinuous: Spatially Extended KinectFusion , 2012, AAAI 2012.

[2]  Masahiko Onosato,et al.  Digital gareki archives: An approach to know more about collapsed houses for supporting search and rescue activities , 2012, 2012 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[3]  Jijun Wang,et al.  A game engine based simulation of the NIST urban search and rescue arenas , 2003, Proceedings of the 2003 Winter Simulation Conference, 2003..

[4]  Alexander Ferworn,et al.  Initial experiments on 3D modeling of complex disaster environments using unmanned aerial vehicles , 2011, 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics.

[5]  A. Boeing,et al.  Evaluation of real-time physics simulations systems , 2007 .

[6]  M. Semenov Simulation of extreme weather events by a stochastic weather generator , 2008 .

[7]  Andreas Birk,et al.  Incorporating large scale SSRR scenarios into the high fidelity simulator USARSim , 2009, 2009 IEEE International Workshop on Safety, Security & Rescue Robotics (SSRR 2009).

[8]  Robert L. Cook,et al.  Stochastic sampling in computer graphics , 1988, TOGS.

[9]  Stefano Carpin,et al.  USARSim: a robot simulator for research and education , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[10]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[11]  J.Zouhair,et al.  Real-Time Physics Simulation Packages: An Evaluation Study , 2011 .

[12]  Eduardo Salas,et al.  Flight Simulator Training Effectiveness: A Meta-Analysis , 1992 .

[13]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[14]  Albert S. Huang,et al.  Visual Odometry and Mapping for Autonomous Flight Using an RGB-D Camera , 2011, ISRR.

[15]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera , 2011, UIST.

[16]  Alexander Ferworn,et al.  Low-cost 3D scene reconstruction for response robots in real-time , 2011, 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics.

[17]  P. Lancaster,et al.  Surfaces generated by moving least squares methods , 1981 .

[18]  Thomas Bräunl,et al.  Evaluation of real-time physics simulation systems , 2007, GRAPHITE '07.