Life Signs Detector Using a Drone in Disaster Zones

In the aftermath of a disaster, such as earthquake, flood, or avalanche, ground search for survivors is usually hampered by unstable surfaces and difficult terrain. Drones now play an important role in these situations, allowing rescuers to locate survivors and allocate resources to saving those who can be helped. The aim of this study was to explore the utility of a drone equipped for human life detection with a novel computer vision system. The proposed system uses image sequences captured by a drone camera to remotely detect the cardiopulmonary motion caused by periodic chest movement of survivors. The results of eight human subjects and one mannequin in different poses shows that motion detection on the body surface of the survivors is likely to be useful to detect life signs without any physical contact. The results presented in this study may lead to a new approach to life detection and remote life sensing assessment of survivors.

[1]  Robert Bogue,et al.  Industrial Robot : An International Journal Search and rescue and disaster relief robots : has their time finally come ? , 2016 .

[2]  Celestino Ordóñez,et al.  Detection of human vital signs in hazardous environments by means of video magnification , 2018, PloS one.

[3]  Patrick Doherty,et al.  A UAV Search and Rescue Scenario with Human Body Detection and Geolocalization , 2007, Australian Conference on Artificial Intelligence.

[4]  Birzhan Nurimbetov,et al.  Vital sign monitoring utilizing Eulerian video magnification and thermography. , 2016, Conference proceedings : ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual Conference.

[5]  Javaan Chahl,et al.  Remote measurement of cardiopulmonary signal using an unmanned aerial vehicle , 2018, IOP Conference Series: Materials Science and Engineering.

[6]  Roland Siegwart,et al.  People detection and tracking from aerial thermal views , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[7]  A.J.A. Rivera,et al.  Post-disaster rescue facility: Human detection and geolocation using aerial drones , 2016, 2016 IEEE Region 10 Conference (TENCON).

[8]  Frédo Durand,et al.  Eulerian video magnification for revealing subtle changes in the world , 2012, ACM Trans. Graph..

[9]  Gérard G. Medioni,et al.  Detection and Tracking of Moving Objects from Overlapping EO and IR Sensors , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[10]  Yee Wei Law,et al.  Human motion analysis from UAV video , 2018 .

[11]  V. Sowmya,et al.  Analysis of Various Color Space Models on Effective Single Image Super Resolution , 2016 .

[12]  Bernt Schiele,et al.  Vision based victim detection from unmanned aerial vehicles , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Sven Mayer,et al.  Drones for Search and Rescue , 2019 .

[14]  Anhar Risnumawan,et al.  From concrete to abstract: Multilayer neural networks for disaster victims detection , 2016, 2016 International Electronics Symposium (IES).

[15]  Goldie Nejat,et al.  A Learning-Based Semi-Autonomous Controller for Robotic Exploration of Unknown Disaster Scenes While Searching for Victims , 2014, IEEE Transactions on Cybernetics.

[16]  Yee Wei Law,et al.  Human Detection and Motion Analysis from a Quadrotor UAV , 2018, IOP Conference Series: Materials Science and Engineering.

[17]  Sang-Heon Lee,et al.  Cardiopulmonary signal acquisition from different regions using video imaging analysis , 2019, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[18]  Amandeep Kaur,et al.  Face detection techniques: a review , 2018, Artificial Intelligence Review.

[19]  Arturo de la Escalera,et al.  An Appearance-Based Tracking Algorithm for Aerial Search and Rescue Purposes † , 2019, Sensors.

[20]  David Smith,et al.  A continuous wavelet transform algorithm for peak detection , 2008, Electrophoresis.

[21]  Gianluigi Ferrari,et al.  Respiratory Rate Monitoring by Video Processing Using Local Motion Magnification , 2018, 2018 26th European Signal Processing Conference (EUSIPCO).

[22]  Hanno Hildmann,et al.  Nature-Inspired Drone Swarming for Real-Time Aerial Data-Collection Under Dynamic Operational Constraints , 2019 .

[23]  Robin R. Murphy,et al.  Human-robot interactions during the robot-assisted urban search and rescue response at the World Trade Center , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[24]  Antonios Gasteratos,et al.  Unsupervised Human Detection with an Embedded Vision System on a Fully Autonomous UAV for Search and Rescue Operations , 2019, Sensors.

[25]  Asanka G. Perera,et al.  Remote monitoring of cardiorespiratory signals from a hovering unmanned aerial vehicle , 2017, BioMedical Engineering OnLine.

[26]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Yi-Zeng Liang,et al.  An intelligent background-correction algorithm for highly fluorescent samples in Raman spectroscopy , 2010 .

[28]  P. Rudol,et al.  Human Body Detection and Geolocalization for UAV Search and Rescue Missions Using Color and Thermal Imagery , 2008, 2008 IEEE Aerospace Conference.

[29]  Javaan S. Chahl,et al.  Contactless Cardiac Activity Detection Based on Head Motion Magnification , 2017, Int. J. Image Graph..

[30]  Daniel Camara,et al.  Cavalry to the rescue: Drones fleet to help rescuers operations over disasters scenarios , 2014, 2014 IEEE Conference on Antenna Measurements & Applications (CAMA).