UAV Framework for Autonomous Onboard Navigation and People/Object Detection in Cluttered Indoor Environments

Response efforts in emergency applications such as border protection, humanitarian relief and disaster monitoring have improved with the use of Unmanned Aerial Vehicles (UAVs), which provide a flexibly deployed eye in the sky. These efforts have been further improved with advances in autonomous behaviours such as obstacle avoidance, take-off, landing, hovering and waypoint flight modes. However, most UAVs lack autonomous decision making for navigating in complex environments. This limitation creates a reliance on ground control stations to UAVs and, therefore, on their communication systems. The challenge is even more complex in indoor flight operations, where the strength of the Global Navigation Satellite System (GNSS) signals is absent or weak and compromises aircraft behaviour. This paper proposes a UAV framework for autonomous navigation to address uncertainty and partial observability from imperfect sensor readings in cluttered indoor scenarios. The framework design allocates the computing processes onboard the flight controller and companion computer of the UAV, allowing it to explore dangerous indoor areas without the supervision and physical presence of the human operator. The system is illustrated under a Search and Rescue (SAR) scenario to detect and locate victims inside a simulated office building. The navigation problem is modelled as a Partially Observable Markov Decision Process (POMDP) and solved in real time through the Augmented Belief Trees (ABT) algorithm. Data is collected using Hardware in the Loop (HIL) simulations and real flight tests. Experimental results show the robustness of the proposed framework to detect victims at various levels of location uncertainty. The proposed system ensures personal safety by letting the UAV to explore dangerous environments without the intervention of the human operator.

[1]  Charles Lesire,et al.  AMPLE: an anytime planning and execution framework for dynamic and uncertain problems in robotics , 2019, Auton. Robots.

[2]  Luc Van Gool,et al.  The Pascal Visual Object Classes Challenge: A Retrospective , 2014, International Journal of Computer Vision.

[3]  Pascual Campoy Cervera,et al.  A Review of Deep Learning Methods and Applications for Unmanned Aerial Vehicles , 2017, J. Sensors.

[4]  Dongsuk Kum,et al.  Drone-Assisted Disaster Management: Finding Victims via Infrared Camera and Lidar Sensor Fusion , 2016, 2016 3rd Asia-Pacific World Congress on Computer Science and Engineering (APWC on CSE).

[5]  Fernando Luiz Cyrino Oliveira,et al.  The Use of UAVs in Humanitarian Relief: An Application of POMDP‐Based Methodology for Finding Victims , 2018, Production and Operations Management.

[6]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[7]  M. Rosenqvist,et al.  Drones may be used to save lives in out of hospital cardiac arrest due to drowning. , 2017, Resuscitation.

[8]  Mario Arturo Ruiz Estrada,et al.  The uses of unmanned aerial vehicles –UAV’s- (or drones) in social logistic: Natural disasters response and humanitarian relief aid , 2019, Procedia Computer Science.

[9]  David Hsu,et al.  POMDPs for robotic tasks with mixed observability , 2009, Robotics: Science and Systems.

[10]  John N. Tsitsiklis,et al.  The Complexity of Markov Decision Processes , 1987, Math. Oper. Res..

[11]  Roland Siegwart,et al.  The ETH‐MAV Team in the MBZ International Robotics Challenge , 2017, J. Field Robotics.

[12]  Rui Zhang,et al.  Automatic Detection of Earthquake-Damaged Buildings by Integrating UAV Oblique Photography and Infrared Thermal Imaging , 2020, Remote. Sens..

[13]  Mamdouh El Haj Assad,et al.  Medical kit: emergency drone , 2020, Defense + Commercial Sensing.

[14]  Mohamed Khalgui,et al.  Micro Air Vehicle Link (MAVlink) in a Nutshell: A Survey , 2019, IEEE Access.

[15]  Min Chen,et al.  POMDP-lite for robust robot planning under uncertainty , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[16]  A. Claesson,et al.  Time to Delivery of an Automated External Defibrillator Using a Drone for Simulated Out-of-Hospital Cardiac Arrests vs Emergency Medical Services , 2017, JAMA.

[17]  Atsuo Takanishi,et al.  Development of a Hybrid Locomotion Robot for Earthquake Search and Rescue in Partially Collapsed Building , 2019, 2019 IEEE International Conference on Mechatronics and Automation (ICMA).

[18]  Lincheng Shen,et al.  Decision-making of UAV for tracking moving target via information geometry , 2016, CCC 2016.

[19]  Vipul Mishra,et al.  Drone-surveillance for search and rescue in natural disaster , 2020, Comput. Commun..

[20]  Guoqing Shi,et al.  Path planning for unmanned aerial vehicle passive detection under the framework of partially observable markov decision process , 2018, 2018 Chinese Control And Decision Conference (CCDC).

[21]  Christoph Stiller,et al.  Automated Driving in Uncertain Environments: Planning With Interaction and Uncertain Maneuver Prediction , 2018, IEEE Transactions on Intelligent Vehicles.

[22]  P. Carydis,et al.  UAV and GIS based rapid earthquake-induced building damage assessment and methodology for EMS-98 isoseismal map drawing: The June 12, 2017 Mw 6.3 Lesvos (Northeastern Aegean, Greece) earthquake , 2019, International Journal of Disaster Risk Reduction.

[23]  Yunus Karaca,et al.  The potential use of unmanned aircraft systems (drones) in mountain search and rescue operations , 2017, The American journal of emergency medicine.

[24]  Stav Shapira,et al.  The impact of behavior on the risk of injury and death during an earthquake: a simulation-based study , 2018, Natural Hazards.

[25]  Toshiyuki Tanaka,et al.  Search and rescue with autonomous flying robots through behavior-based cooperative intelligence , 2018, Journal of International Humanitarian Action.

[26]  Marc Pollefeys,et al.  PX4: A node-based multithreaded open source robotics framework for deeply embedded platforms , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[27]  Enrico Natalizio,et al.  UAV-assisted disaster management: Applications and open issues , 2016, 2016 International Conference on Computing, Networking and Communications (ICNC).

[28]  Wolfram Burgard,et al.  OctoMap: an efficient probabilistic 3D mapping framework based on octrees , 2013, Autonomous Robots.

[29]  Latafat A. Gardashova,et al.  UAV Using Dec-POMDP Model for Increasing the Level of Security in the Company , 2016 .

[30]  Hanna Kurniawati,et al.  An Online POMDP Solver for Uncertainty Planning in Dynamic Environment , 2013, ISRR.

[31]  Gonzalo Pajares,et al.  Overview and Current Status of Remote Sensing Applications Based on Unmanned Aerial Vehicles (UAVs) , 2015 .

[32]  Ľuboš Chovanec,et al.  Mathematical Modelling and Parameter Identification of Quadrotor (a survey) , 2014 .

[33]  Frederic Maire,et al.  Autonomous UAV Navigation for Active Perception of Targets in Uncertain and Cluttered Environments , 2020, 2020 IEEE Aerospace Conference.

[34]  B. Scherrer,et al.  Partially Observable Markov Decision Processes , 2013 .

[35]  Francisco José Madrid-Cuevas,et al.  Automatic generation and detection of highly reliable fiducial markers under occlusion , 2014, Pattern Recognit..

[36]  Agathoniki Trigoni,et al.  Supporting Search and Rescue Operations with UAVs , 2010, 2010 International Conference on Emerging Security Technologies.

[37]  Edwin K. P. Chong,et al.  UAV Path Planning in a Dynamic Environment via Partially Observable Markov Decision Process , 2013, IEEE Transactions on Aerospace and Electronic Systems.

[38]  Mariette Awad,et al.  Decision Making in Multiagent Systems: A Survey , 2018, IEEE Transactions on Cognitive and Developmental Systems.

[39]  Margarita Mulero-Pázmány,et al.  Drones for Conservation in Protected Areas: Present and Future , 2019, Drones.

[40]  Luis Felipe Gonzalez,et al.  Enabling UAV Navigation with Sensor and Environmental Uncertainty in Cluttered and GPS-Denied Environments , 2016, Sensors.

[41]  Javaan Chahl,et al.  Life Signs Detector Using a Drone in Disaster Zones , 2019, Remote. Sens..