A Cloud Based Disaster Management System

The combination of wireless sensor networks (WSNs) and 3D virtual environments opens a new paradigm for their use in natural disaster management applications. It is important to have a realistic virtual environment based on datasets received from WSNs to prepare a backup rescue scenario with an acceptable response time. This paper describes a complete cloud-based system that collects data from wireless sensor nodes deployed in real environments and then builds a 3D environment in near real-time to reflect the incident detected by sensors (fire, gas leaking, etc.). The system’s purpose is to be used as a training environment for a rescue team to develop various rescue plans before they are applied in real emergency situations. The proposed cloud architecture combines 3D data streaming and sensor data collection to build an efficient network infrastructure that meets the strict network latency requirements for 3D mobile disaster applications. As compared to other existing systems, the proposed system is truly complete. First, it collects data from sensor nodes and then transfers it using an enhanced Routing Protocol for Low-Power and Lossy Networks (RLP). A 3D modular visualizer with a dynamic game engine was also developed in the cloud for near-real time 3D rendering. This is an advantage for highly-complex rendering algorithms and less powerful devices. An Extensible Markup Language (XML) atomic action concept was used to inject 3D scene modifications into the game engine without stopping or restarting the engine. Finally, a multi-objective multiple traveling salesman problem (AHP-MTSP) algorithm is proposed to generate an efficient rescue plan by assigning robots and multiple unmanned aerial vehicles to disaster target locations, while minimizing a set of predefined objectives that depend on the situation. The results demonstrate that immediate feedback obtained from the reconstructed 3D environment can help to investigate what–if scenarios, allowing for the preparation of effective rescue plans with an appropriate management effort.

[1]  Will McGugan,et al.  Beginning Game Development with Python and Pygame: From Novice to Professional , 2007 .

[2]  Azzedine Boukerche,et al.  A novel solution for the development of collaborative virtual environment simulations in large scale , 2005, Ninth IEEE International Symposium on Distributed Simulation and Real-Time Applications.

[3]  Tom Schaul,et al.  An Extensible Description Language for Video Games , 2014, IEEE Transactions on Computational Intelligence and AI in Games.

[4]  Leif Arne Ronningen,et al.  Geelix LiveGames: Remote Playing of Video Games , 2009, 2009 6th IEEE Consumer Communications and Networking Conference.

[5]  Algirdas Pakstas,et al.  MPEG-4 Facial Animation: The Standard,Implementation and Applications , 2002 .

[6]  Eduardo Tovar,et al.  IEEE 802.15.4e in a Nutshell: Survey and Performance Evaluation , 2018, IEEE Communications Surveys & Tutorials.

[7]  Anis Koubaa,et al.  DroneTrack: Cloud-Based Real-Time Object Tracking Using Unmanned Aerial Vehicles Over the Internet , 2018, IEEE Access.

[8]  Sahar Trigui,et al.  A Clustering Market-Based Approach for Multi-robot Emergency Response Applications , 2016, 2016 International Conference on Autonomous Robot Systems and Competitions (ICARSC).

[9]  Olof Hagsand,et al.  Interactive Multiuser VEs in the DIVE System , 1996, IEEE Multim..

[10]  Filip De Turck,et al.  A hybrid thin-client protocol for multimedia streaming and interactive gaming applications , 2006, NOSSDAV '06.

[11]  Giuseppe Maggiore,et al.  A formal specification for casanova, a language for computer games , 2012, EICS '12.

[12]  Azzedine Boukerche,et al.  A language for building and extending 3D virtual Web-based environments , 2004, WebMedia and LA-Web, 2004. Proceedings.

[13]  Anis Koubaa,et al.  RPL in a nutshell: A survey , 2012, Comput. Networks.

[14]  Eduardo Tovar,et al.  A service-oriented Cloud-based management system for the Internet-of-Drones , 2017, 2017 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC).

[15]  Theodore B. Zahariadis,et al.  Evaluation of a transmission count-efficient metric for energy-aware routing in WSNs , 2014, 2014 International Conference on Telecommunications and Multimedia (TEMU).

[16]  AbidMohamed,et al.  Quality-of-service aware routing for static and mobile IPv6-based low-power and lossy sensor networks using RPL , 2015, AdHocNets 2015.

[17]  Frédéric Maire,et al.  Evolutionary Game Design , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[18]  Kun Zhou,et al.  3D shape regression for real-time facial animation , 2013, ACM Trans. Graph..

[19]  GaddourOlfa,et al.  Survey RPL in a nutshell , 2012 .

[20]  Jacynthe Pouliot,et al.  3D Dynamic Simulation within GIS in Support of Disaster Management , 2007 .

[21]  Peter Eisert,et al.  Low delay streaming of computer graphics , 2008, 2008 15th IEEE International Conference on Image Processing.

[22]  P Ramesh,et al.  Role of Internet of Things in disaster management , 2017, 2017 International Conference on Innovations in Information, Embedded and Communication Systems (ICIIECS).

[23]  Perttu Hämäläinen,et al.  Immersive 3D modeling with Blender and off-the-shelf hardware , 2013, 2013 IEEE Symposium on 3D User Interfaces (3DUI).

[24]  Mohamed Abid,et al.  OF-FL: QoS-aware fuzzy logic objective function for the RPL routing protocol , 2014, 2014 12th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt).

[25]  Ken Perlin,et al.  Improv: a system for scripting interactive actors in virtual worlds , 1996, SIGGRAPH.

[26]  A. Zarrad,et al.  A novel approach to develop large-scale virtual environment applications using script-language , 2013, 2013 9th International Conference on Innovations in Information Technology (IIT).

[27]  Mohamed Abid,et al.  Quality-of-service aware routing for static and mobile IPv6-based low-power and lossy sensor networks using RPL , 2015, Ad Hoc Networks.

[28]  Savita Kulkarni,et al.  Design of disaster management system using IoT based interconnected network with smart city monitoring , 2016, 2016 International Conference on Internet of Things and Applications (IOTA).

[29]  Telmo Zarraonandia,et al.  A Virtual Environment for Learning Aiport Emergency Management Protocols , 2009, HCI.

[30]  Anis Koubaa,et al.  Move and improve: A distributed multi-robot coordination approach for multiple depots multiple travelling salesmen problem , 2014, 2014 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC).

[31]  Eduardo Tovar,et al.  Dronemap Planner: A service-oriented cloud-based management system for the Internet-of-Drones , 2019, Ad Hoc Networks.

[32]  Steven M. Seitz,et al.  View morphing , 1996, SIGGRAPH.

[33]  Alessio Botta,et al.  Cloud, Fog, and Dew Robotics: Architectures for Next Generation Applications , 2019, 2019 7th IEEE International Conference on Mobile Cloud Computing, Services, and Engineering (MobileCloud).

[34]  Long Quan,et al.  Image interpolation by joint view triangulation , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[35]  Mohamed Abid,et al.  RiSeG: a ring based secure group communication protocol for resource-constrained wireless sensor networks , 2011, Personal and Ubiquitous Computing.

[36]  Mike M. Chow.  Optimized geometry compression for real-time rendering , 1997 .

[37]  Dominique Barthel,et al.  Routing Metrics Used for Path Calculation in Low-Power and Lossy Networks , 2012, RFC.

[38]  Y. K. Malaiya,et al.  Evaluating disaster recovery plans using the cloud , 2013, 2013 Proceedings Annual Reliability and Maintainability Symposium (RAMS).

[39]  Daniel Thalmann,et al.  Avatar Markup Language , 2002, EGVE.

[40]  Long Wang,et al.  Disaster Recovery for Cloud-Hosted Enterprise Applications , 2016, 2016 IEEE 9th International Conference on Cloud Computing (CLOUD).

[41]  Edward H. Adelson,et al.  Computation Models of Visual Processing , 1991, IEEE Expert.

[42]  Anis Koubaa,et al.  LSAR: Multi-UAV Collaboration for Search and Rescue Missions , 2019, IEEE Access.

[43]  Mohamed Khalgui,et al.  Micro Air Vehicle Link (MAVlink) in a Nutshell: A Survey , 2019, IEEE Access.

[44]  Yu-Cheng Chen,et al.  Disaster and Emergency Management System , 2012, The 15th International Symposium on Wireless Personal Multimedia Communications.

[45]  Eduardo Tovar,et al.  DynaMO—Dynamic Multisuperframe Tuning for Adaptive IEEE 802.15.4e DSME Networks , 2019, IEEE Access.

[46]  Eduardo Tovar,et al.  Co-RPL: RPL routing for mobile low power wireless sensor networks using Corona mechanism , 2014, Proceedings of the 9th IEEE International Symposium on Industrial Embedded Systems (SIES 2014).

[47]  Arun Venkataramani,et al.  Disaster Recovery as a Cloud Service: Economic Benefits & Deployment Challenges , 2010, HotCloud.

[48]  Anis Koubaa,et al.  ROSLink: Bridging ROS with the Internet-of-Things for Cloud Robotics , 2017 .

[49]  Mohamed Khalgui,et al.  QCOF: New RPL Extension for QoS and Congestion-Aware in Low Power and Lossy Network , 2019, ICSOFT.

[50]  Anis Zarrad.  An Extensible Game Engine to Develop Animated Facial Avatars in 3D Virtual Environment , 2016, Int. J. Virtual Communities Soc. Netw..

[51]  Ilya Baran,et al.  Automatic rigging and animation of 3D characters , 2007, SIGGRAPH 2007.

[52]  M. Ohta,et al.  IETF and Internet standards , 1998, IEEE Commun. Mag..

[53]  Mohamed Abid,et al.  A lightweight user authentication scheme for Wireless Sensor Networks , 2010, ACS/IEEE International Conference on Computer Systems and Applications - AICCSA 2010.

[54]  Jun-yong Noh,et al.  A Survey of Facial Modeling and Animation Techniques , 2001 .

[55]  E. Adelson,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[56]  Hala Mokhtar,et al.  Disaster Management System Over Wifi Direct , 2019, 2019 2nd International Conference on Computer Applications & Information Security (ICCAIS).

[57]  Sahar Trigui,et al.  An analytical hierarchy process-based approach to solve the multi-objective multiple traveling salesman problem , 2018, Intell. Serv. Robotics.

[58]  Anis Zarrad.  A Dynamic Platform for Developing 3D Facial Avatars in a Networked Virtual Environment , 2016, Int. J. Comput. Games Technol..

[59]  Ryan Shea,et al.  Cloud gaming: architecture and performance , 2013, IEEE Network.

[60]  T. Pejsa,et al.  Architecture of an animation system for human characters , 2009, 2009 10th International Conference on Telecommunications.

[61]  Yuan Luo,et al.  Simulation of Emergency Evacuation in Virtual Reality , 2008 .

[62]  Bin Wang,et al.  BIM Based Virtual Environment for Fire Emergency Evacuation , 2014, TheScientificWorldJournal.

[63]  R. W. Saaty,et al.  The analytic hierarchy process—what it is and how it is used , 1987 .

[64]  Mel Slater,et al.  Component framework infrastructure for virtual environments , 2000, CVE '00.

[65]  Vincenzo Lippiello,et al.  Networking for Cloud Robotics : a case study based on the Sherpa Project , 2017 .

[66]  Nicolas Szilas,et al.  IDtension: a narrative engine for Interactive Drama , 2003 .

[67]  A. Patel,et al.  3D Modeling and Rendering of 2D Medical Image , 2012, 2012 International Conference on Communication Systems and Network Technologies.