Detection of bodies in maritime rescue operations using unmanned aerial vehicles with multispectral cameras

This study was performed in collaboration with BabcockMCS Spain and funded by the Galicia Region Government through the Civil UAVs Initiative program, the Spanish Government’s Ministry of Economy, Industry, and Competitiveness through the RTC‐2014‐1863‐8 and INAER4‐14Y (IDI‐20141234) projects, and the grant number 730897 under the HPC‐EUROPA3 project supported by Horizon 2020.

[1]  Lloyd L. Coulter,et al.  AUTOMATED DETECTION OF PEOPLE AND VEHICLES IN NATURAL ENVIRONMENTS USING HIGH TEMPORAL RESOLUTION AIRBORNE REMOTE SENSING , 2012 .

[2]  Gonzalo Pajares,et al.  Overview and Current Status of Remote Sensing Applications Based on Unmanned Aerial Vehicles (UAVs) , 2015 .

[3]  Jiann-Yeou Rau,et al.  Band-to-band registration and ortho-rectification of multilens/multispectral imagery: A case study of MiniMCA-12 acquired by a fixed-wing UAS , 2016 .

[4]  P. Rudol,et al.  Human Body Detection and Geolocalization for UAV Search and Rescue Missions Using Color and Thermal Imagery , 2008, 2008 IEEE Aerospace Conference.

[5]  Dmitry Kalyadin,et al.  Sea Robot-Assisted Inspection , 2011, IEEE Robotics & Automation Magazine.

[6]  Jürgen Beyerer,et al.  Deep learning based multi-category object detection in aerial images , 2017, Defense + Security.

[7]  Farid Melgani,et al.  A Convolutional Neural Network Approach for Assisting Avalanche Search and Rescue Operations with UAV Imagery , 2017, Remote. Sens..

[8]  Antonio-Javier Gallego,et al.  Automatic Ship Classification from Optical Aerial Images with Convolutional Neural Networks , 2018, Remote. Sens..

[9]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Joost van de Weijer,et al.  Review on computer vision techniques in emergency situations , 2017, Multimedia Tools and Applications.

[11]  Ian F. Akyildiz,et al.  Help from the Sky: Leveraging UAVs for Disaster Management , 2017, IEEE Pervasive Computing.

[12]  Rogelio Lozano,et al.  Fast and viewpoint robust human detection for SAR operations , 2014, 2014 IEEE International Symposium on Safety, Security, and Rescue Robotics (2014).

[13]  Tomasz Niedzielski,et al.  A real‐time field experiment on search and rescue operations assisted by unmanned aerial vehicles , 2018, J. Field Robotics.

[14]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[15]  Georgios Ch. Sirakoulis,et al.  Real‐time surveillance detection system for medium‐altitude long‐endurance unmanned aerial vehicles , 2018, Concurr. Comput. Pract. Exp..

[16]  Georgios D. Evangelidis,et al.  Parametric Image Alignment Using Enhanced Correlation Coefficient Maximization , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Andrew Zisserman,et al.  Return of the Devil in the Details: Delving Deep into Convolutional Nets , 2014, BMVC.

[18]  Francesco Visin,et al.  A guide to convolution arithmetic for deep learning , 2016, ArXiv.

[19]  Jason J. Ford,et al.  Evaluation of Maritime Vision Techniques for Aerial Search of Humans in Maritime Environments , 2008, 2008 Digital Image Computing: Techniques and Applications.

[20]  Lin Li,et al.  The application of unmanned aerial vehicle remote sensing for monitoring secondary geological disasters after earthquakes , 2017, International Conference on Digital Image Processing.

[21]  Zhenwei Shi,et al.  Ship Detection in Spaceborne Optical Image With SVD Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Agathoniki Trigoni,et al.  Probabilistic target detection by camera-equipped UAVs , 2010, 2010 IEEE International Conference on Robotics and Automation.

[23]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[24]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[25]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[26]  Howie Choset,et al.  Editorial: Search and rescue robots , 2008 .

[27]  Gui-Song Xia,et al.  Learning High-level Features for Satellite Image Classification With Limited Labeled Samples , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[29]  Jürgen Beyerer,et al.  Low Resolution Person Detection with a Moving Thermal Infrared Camera by Hot Spot Classification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[30]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Lei Zheng,et al.  Marine Search and Rescue of UAV in Long-Distance Security Modeling Simulation , 2017 .

[32]  Aníbal Ollero,et al.  Journal of Intelligent & Robotic Systems manuscript No. (will be inserted by the editor) An Unmanned Aircraft System for Automatic Forest Fire Monitoring and Measurement , 2022 .

[33]  Sébastien Lefèvre,et al.  Human Detection from Aerial Imagery for Automatic Counting of Shellfish Gatherers , 2016, VISIGRAPP.

[34]  Gui-Song Xia,et al.  Transferring Deep Convolutional Neural Networks for the Scene Classification of High-Resolution Remote Sensing Imagery , 2015, Remote. Sens..

[35]  Marcello Chiaberge,et al.  Multipurpose UAV for search and rescue operations in mountain avalanche events , 2017 .

[36]  Michael A. Goodrich,et al.  Towards using Unmanned Aerial Vehicles (UAVs) in Wilderness Search and Rescue: Lessons from field trials , 2009 .

[37]  Zhenwei Shi,et al.  Fully Convolutional Network With Task Partitioning for Inshore Ship Detection in Optical Remote Sensing Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[38]  Rodney A. Walker,et al.  Vision-based UAV Maritime Search and Rescue Using Point Target Detection , 2007 .

[39]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[40]  Gian Luca Foresti,et al.  Aerial video surveillance system for small-scale UAV environment monitoring , 2017, 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[41]  Youmin Zhang,et al.  Aerial Images-Based Forest Fire Detection for Firefighting Using Optical Remote Sensing Techniques and Unmanned Aerial Vehicles , 2017, Journal of Intelligent & Robotic Systems.

[42]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[43]  Tomasz Niedzielski,et al.  The nested k-means method: A new approach for detecting lost persons in aerial images acquired by unmanned aerial vehicles , 2017, J. Field Robotics.

[44]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[45]  Roland Siegwart,et al.  People detection and tracking from aerial thermal views , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[46]  Georgios Ch. Sirakoulis,et al.  Human and Fire Detection from High Altitude UAV Images , 2015, 2015 23rd Euromicro International Conference on Parallel, Distributed, and Network-Based Processing.

[47]  Tor Arne Johansen,et al.  Automatic detection, classification and tracking of objects in the ocean surface from UAVs using a thermal camera , 2015, 2015 IEEE Aerospace Conference.

[48]  Young-Jun Son,et al.  Vision-Based Target Detection and Localization via a Team of Cooperative UAV and UGVs , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[49]  Jingxuan Sun,et al.  A Camera-Based Target Detection and Positioning UAV System for Search and Rescue (SAR) Purposes , 2016, Sensors.

[50]  Jose Barata,et al.  A cooperative multi-robot team for the surveillance of shipwreck survivors at sea , 2016, OCEANS 2016 MTS/IEEE Monterey.

[51]  Wilbert G. Aguilar,et al.  Pedestrian Detection for UAVs Using Cascade Classifiers with Meanshift , 2017, 2017 IEEE 11th International Conference on Semantic Computing (ICSC).

[52]  Bernt Schiele,et al.  Vision based victim detection from unmanned aerial vehicles , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[53]  Aníbal Ollero,et al.  A cooperative perception system for multiple UAVs: Application to automatic detection of forest fires , 2006, J. Field Robotics.

[54]  Atsuto Maki,et al.  Factors of Transferability for a Generic ConvNet Representation , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[55]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[56]  Lei Ren,et al.  Target detection of maritime search and rescue: Saliency accumulation method , 2012, FSKD.