Small target detection for search and rescue operations using distributed deep learning and synthetic data generation

It is important to find the target as soon as possible for search and rescue operations. Surveillance camera systems and unmanned aerial vehicles (UAVs) are used to support search and rescue. Automatic object detection is important because a person cannot monitor multiple surveillance screens simultaneously for 24 hours. Also, the object is often too small to be recognized by the human eye on the surveillance screen. This study used an UAVs around the Port of Houston and fixed surveillance cameras to build an automatic target detection system that supports the US Coast Guard (USCG) to help find targets (e.g., person overboard). We combined image segmentation, enhancement, and convolution neural networks to reduce detection time to detect small targets. We compared the performance between the autodetection system and the human eye. Our system detected the target within 8 seconds, but the human eye detected the target within 25 seconds. Our systems also used synthetic data generation and data augmentation techniques to improve target detection accuracy. This solution may help the search and rescue operations of the first responders in a timely manner.

[1]  Irène Abi-Zeid,et al.  SARPlan: A decision support system for Canadian Search and Rescue Operations , 2005, Eur. J. Oper. Res..

[2]  Thomas Lu,et al.  Deep Neural Networks for Pattern Recognition , 2018, ArXiv.

[3]  Desanka Polajnar,et al.  Local binary pattern network: A deep learning approach for face recognition , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[4]  Cordelia Schmid,et al.  MoCap-guided Data Augmentation for 3D Pose Estimation in the Wild , 2016, NIPS.

[5]  Edward Chow,et al.  Automatic speech recognition for launch control center communication using recurrent neural networks with data augmentation and custom language model , 2018, Defense + Security.

[6]  Agathoniki Trigoni,et al.  Supporting Search and Rescue Operations with UAVs , 2010, 2010 International Conference on Emerging Security Technologies.

[7]  Daniel Serrano,et al.  The EU-ICARUS project: Developing assistive robotic tools for search and rescue operations , 2013, 2013 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[8]  Patrick Doherty,et al.  A UAV Search and Rescue Scenario with Human Body Detection and Geolocalization , 2007, Australian Conference on Artificial Intelligence.

[9]  Alan L. Yuille,et al.  UnrealCV: Connecting Computer Vision to Unreal Engine , 2016, ECCV Workshops.

[10]  Edward Chow,et al.  Occluded object reconstruction for first responders with augmented reality glasses using conditional generative adversarial networks , 2018, Defense + Security.

[11]  Thomas Lu,et al.  Predicting Rapid Fire Growth (Flashover) Using Conditional Generative Adversarial Networks , 2018, IRIACV.

[12]  Magnus Wrenninge,et al.  Procedural Modeling and Physically Based Rendering for Synthetic Data Generation in Automotive Applications , 2017, ArXiv.

[13]  Marcello Chiaberge,et al.  Multipurpose UAV for search and rescue operations in mountain avalanche events , 2017 .

[14]  Michael A. Goodrich,et al.  Towards using Unmanned Aerial Vehicles (UAVs) in Wilderness Search and Rescue: Lessons from field trials , 2009 .

[15]  Guangming Shi,et al.  Feature-fused SSD: fast detection for small objects , 2017, International Conference on Graphic and Image Processing.

[16]  Vladan Papic,et al.  Analysis of saliency object detection algorithms for search and rescue operations , 2016, 2016 24th International Conference on Software, Telecommunications and Computer Networks (SoftCOM).

[17]  Marc Donner,et al.  Design of an Autonomous Robot for Mapping, Navigation, and Manipulation in Underground Mines , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  Min Chen,et al.  Detecting Small Signs from Large Images , 2017, 2017 IEEE International Conference on Information Reuse and Integration (IRI).