Audio-Processing-Based Human Detection at Disaster Sites With Unmanned Aerial Vehicle

This paper describes a human search system that uses an unmanned aerial vehicle (UAV). The use of robots to search for people is expected to become an auxiliary tool for saving lives during a disaster. In particular, because UAVs can collect information from the air, there has been much research into human search using UAVs equipped with cameras. However, the disadvantage of cameras is that they struggle to detect people who are hidden in shadows. To solve this problem, we mounted an array microphone on a UAV and to detect the human voice as a means of finding people that cameras cannot. Also a search method is proposed that combines voice and camera human detection to compensate for their respective shortcomings. The rate and accuracy of human detection by the proposed method are assessed experimentally.

[1]  Halpage Chinthaka Nuwandika Premachandra,et al.  A basic study of landing system for multicopters using Raspberry Pi , 2015, 2015 International Symposium on Consumer Electronics (ISCE).

[2]  Dongsuk Kum,et al.  Drone-Assisted Disaster Management: Finding Victims via Infrared Camera and Lidar Sensor Fusion , 2016, 2016 3rd Asia-Pacific World Congress on Computer Science and Engineering (APWC on CSE).

[3]  Hui Li,et al.  Natural Disaster Monitoring with Wireless Sensor Networks: A Case Study of Data-intensive Applications upon Low-Cost Scalable Systems , 2013, Mob. Networks Appl..

[4]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  K. Nakadai,et al.  Robot audition for dynamic environments , 2012, 2012 IEEE International Conference on Signal Processing, Communication and Computing (ICSPCC 2012).

[6]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[7]  Kiyotaka Kato,et al.  Position and attitude estimation using ultrasonic waves for autonomous flying robots and system construction , 2015, 2015 15th International Conference on Control, Automation and Systems (ICCAS).

[8]  Chinthaka Premachandra,et al.  Flying Control of Small-type Helicopter by Detecting Its In-air Natural Features , 2015 .

[9]  Shulin Yang,et al.  The application of unmanned aircraft systems to plant protection in China , 2018, Precision Agriculture.

[10]  Vijay Kumar,et al.  Minimum snap trajectory generation and control for quadrotors , 2011, 2011 IEEE International Conference on Robotics and Automation.

[11]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  B. H. Sudantha,et al.  Victim Detection Using UAV with On-board Voice Recognition System , 2019, 2019 Third IEEE International Conference on Robotic Computing (IRC).

[13]  Chinthaka Premachandra,et al.  Speed-Up Automatic Quadcopter Position Detection by Sensing Propeller Rotation , 2019, IEEE Sensors Journal.

[14]  Yuan Dong,et al.  A Hybrid PSO Algorithm Based Flight Path Optimization for Multiple Agricultural UAVs , 2016, 2016 IEEE 28th International Conference on Tools with Artificial Intelligence (ICTAI).

[15]  Mani Golparvar-Fard,et al.  Visual monitoring of civil infrastructure systems via camera-equipped Unmanned Aerial Vehicles (UAVs): a review of related works , 2016 .

[16]  Chinthaka Premachandra,et al.  3D environment mapping and self-position estimation by a small flying robot mounted with a movable ultrasonic range sensor , 2017 .

[17]  Chinthaka Premachandra,et al.  Absolute positioning control of indoor flying robot using ultrasonic waves and verification system , 2016, 2016 16th International Conference on Control, Automation and Systems (ICCAS).

[18]  Hiroshi G. Okuno,et al.  Development of microphone-array-embedded UAV for search and rescue task , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[19]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[20]  Halpage Chinthaka Nuwandika Premachandra,et al.  Improvement of multicopter detection using an infrastructure camera , 2016, 2016 IEEE 6th International Conference on Consumer Electronics - Berlin (ICCE-Berlin).

[21]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[22]  Toby P. Breckon,et al.  Real-time people and vehicle detection from UAV imagery , 2011, Electronic Imaging.

[23]  Enrico Natalizio,et al.  UAV-assisted disaster management: Applications and open issues , 2016, 2016 International Conference on Computing, Networking and Communications (ICNC).

[24]  Hiroshi G. Okuno,et al.  An open source software system for robot audition HARK and its evaluation , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[25]  Daijin Kim,et al.  Fast and accurate car detection in drone-view , 2016, 2016 IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia).

[26]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Halpage Chinthaka Nuwandika Premachandra,et al.  A study on development of a hybrid aerial / terrestrial robot system for avoiding ground obstacles by flight , 2019, IEEE/CAA Journal of Automatica Sinica.

[28]  Mario Gianni,et al.  Rescue robots at earthquake-hit Mirandola, Italy: A field report , 2012, 2012 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[29]  Yi Yang,et al.  A Comparative Study of Small Object Detection Algorithms , 2019, 2019 Chinese Control Conference (CCC).

[30]  Daniel Povey,et al.  The Kaldi Speech Recognition Toolkit , 2011 .