The Use of UAVs in Humanitarian Relief: An Application of POMDP‐Based Methodology for Finding Victims

Researchers have proposed the use of unmanned aerial vehicles (UAVs) in humanitarian relief to search for victims in disaster‐affected areas. Once UAVs must search through the entire affected area to find victims, the path‐planning operation becomes equivalent to an area coverage problem. In this study, we propose an innovative method for solving such problem based on a Partially Observable Markov Decision Process (POMDP), which considers the observations made from UAVs. The formulation of the UAV path planning is based on the idea of assigning higher priorities to the areas that are more likely to have victims. We applied the method to three illustrative cases, considering different types of disasters: a tornado in Brazil, a refugee camp in South Sudan, and a nuclear accident in Fukushima, Japan. The results demonstrated that the POMDP solution achieves full coverage of disaster‐affected areas within a reasonable time span. We evaluate the traveled distance and the operation duration (which were quite stable), as well as the time required to find groups of victims by a detailed multivariate sensitivity analysis. The comparisons with a Greedy Algorithm showed that the POMDP finds victims more quickly, which is the priority in humanitarian relief, whereas the performance of the Greedy focuses on minimizing the traveled distance. We also discuss the ethical, legal, and social acceptance issues that can influence the application of the proposed methodology in practice.

[1]  Elise Miller-Hooks,et al.  Optimal team deployment in urban search and rescue , 2012 .

[2]  Peter Tatham,et al.  An investigation into the suitability of the use of unmanned aerial vehicle systems (UAVS) to support the initial needs assessment process in rapid onset humanitarian disasters , 2009 .

[3]  Lian Pin Koh,et al.  Small Drones for Community-Based Forest Monitoring: An Assessment of Their Feasibility and Potential in Tropical Areas , 2014 .

[4]  Haider A. F. Almurib,et al.  Control and path planning of quadrotor aerial vehicles for search and rescue , 2011, SICE Annual Conference 2011.

[5]  Luk N. Van Wassenhove,et al.  Humanitarian aid logistics: supply chain management in high gear , 2006, J. Oper. Res. Soc..

[6]  Irina S. Dolinskaya,et al.  Disaster relief routing: Integrating research and practice , 2012 .

[7]  Rajan Batta,et al.  Review of recent developments in OR/MS research in disaster operations management , 2013, Eur. J. Oper. Res..

[8]  Yu-Jun Zheng,et al.  A Hyper-Heuristic Method for UAV Search Planning , 2017, ICSI.

[9]  Sanjay Jha,et al.  Priority-based coverage path planning for Aerial Wireless Sensor Networks , 2013, 2013 IEEE Eighth International Conference on Intelligent Sensors, Sensor Networks and Information Processing.

[10]  Sandip Chakraborty,et al.  Smart navigation and dynamic path planning of a micro-jet in a post disaster scenario , 2016, EM-GIS.

[11]  Alfonso J. Pedraza-Martinez,et al.  Empirically grounded research in humanitarian operations management: The way forward , 2016 .

[12]  Gyöngyi Kovács,et al.  Humanitarian logistics: development of an improved disaster classification framework , 2013 .

[13]  Yan Wan,et al.  Mobile ad hoc networks in the sky: state of the art, opportunities, and challenges , 2013, ANC '13.

[14]  R. Thorpe,et al.  Using Knowledge within Small and Medium-Sized Firms: A Systematic Review of the Evidence , 2005 .

[15]  Yuan Yuan,et al.  Path selection model and algorithm for emergency logistics management , 2009, Comput. Ind. Eng..

[16]  Giorgio Guglieri,et al.  Search and Rescue: Surveillance support from RPAs radar , 2017, 2017 European Navigation Conference (ENC).

[17]  J. Altmann Arms control for armed uninhabited vehicles: an ethical issue , 2013, Ethics and Information Technology.

[18]  Reza Zanjirani Farahani,et al.  Disaster Management from a POM Perspective: Mapping a New Domain , 2016 .

[19]  Shaligram Pokharel,et al.  Optimization models in emergency logistics: A literature review , 2012 .

[20]  Sarvapali D. Ramchurn,et al.  Coordinating Human-UAV Teams in Disaster Response , 2016, IJCAI.

[21]  Ying Wu,et al.  Development of an UAS for post-earthquake disaster surveying and its application in Ms7.0 Lushan Earthquake, Sichuan, China , 2014, Comput. Geosci..

[22]  Antônio Márcio Tavares Thomé,et al.  Sustainable new product development: a longitudinal review , 2016, Clean Technologies and Environmental Policy.

[23]  Milos Hauskrecht,et al.  Planning and control in stochastic domains with imperfect information , 1997 .

[24]  Aníbal Ollero,et al.  Journal of Intelligent & Robotic Systems manuscript No. (will be inserted by the editor) An Unmanned Aircraft System for Automatic Forest Fire Monitoring and Measurement , 2022 .

[25]  Jose Barata,et al.  A cooperative multi-robot team for the surveillance of shipwreck survivors at sea , 2016, OCEANS 2016 MTS/IEEE Monterey.

[26]  Michael A. Goodrich,et al.  UAV intelligent path planning for Wilderness Search and Rescue , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Sarvapali D. Ramchurn,et al.  CrowdAR: A Live Video Annotation Tool for Rapid Mapping , 2016 .

[28]  Adèle Paul-Hus,et al.  The journal coverage of Web of Science and Scopus: a comparative analysis , 2015, Scientometrics.

[29]  P. Poupart Exploiting structure to efficiently solve large scale partially observable Markov decision processes , 2005 .

[30]  A. Cassandra,et al.  Exact and approximate algorithms for partially observable markov decision processes , 1998 .

[31]  Agathoniki Trigoni,et al.  Supporting Search and Rescue Operations with UAVs , 2010, 2010 International Conference on Emerging Security Technologies.

[32]  Gao Xiaoguang,et al.  Multi-UAVs cooperative control in communication relay , 2016, 2016 IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC).

[33]  Xiaoguang Gao,et al.  Multi-mission Path Re-planning for Multiple Unmanned Aerial Vehicles Based on Unexpected Events , 2009, 2009 International Conference on Intelligent Human-Machine Systems and Cybernetics.

[34]  Henry Leung,et al.  Cooperative path planner for UAVs using ACO algorithm with Gaussian distribution functions , 2009, 2009 IEEE International Symposium on Circuits and Systems.

[35]  Antônio Márcio Tavares Thomé,et al.  Conducting systematic literature review in operations management , 2016 .