Drone vs. Bird Detection: Deep Learning Algorithms and Results from a Grand Challenge

Adopting effective techniques to automatically detect and identify small drones is a very compelling need for a number of different stakeholders in both the public and private sectors. This work presents three different original approaches that competed in a grand challenge on the “Drone vs. Bird” detection problem. The goal is to detect one or more drones appearing at some time point in video sequences where birds and other distractor objects may be also present, together with motion in background or foreground. Algorithms should raise an alarm and provide a position estimate only when a drone is present, while not issuing alarms on birds, nor being confused by the rest of the scene. In particular, three original approaches based on different deep learning strategies are proposed and compared on a real-world dataset provided by a consortium of universities and research centers, under the 2020 edition of the Drone vs. Bird Detection Challenge. Results show that there is a range in difficulty among different test sequences, depending on the size and the shape visibility of the drone in the sequence, while sequences recorded by a moving camera and very distant drones are the most challenging ones. The performance comparison reveals that the different approaches perform somewhat complementary, in terms of correct detection rate, false alarm rate, and average precision.

[1]  Angelo Coluccia,et al.  CFAR Feature Plane: A Novel Framework for the Analysis and Design of Radar Detectors , 2019, IEEE Transactions on Signal Processing.

[2]  Giuseppe Ricci,et al.  A novel approach to robust radar detection of range-spread targets , 2020, Signal Process..

[3]  Petros Daras,et al.  Deep Learning on Multi Sensor Data for Counter UAV Applications—A Systematic Review , 2019, Sensors.

[4]  Arne Schumann,et al.  An image processing pipeline for long range UAV detection , 2018, Security + Defence.

[5]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[7]  Jürgen Beyerer,et al.  Drone-vs-Bird detection challenge at IEEE AVSS2017 , 2017, 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[8]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[9]  Cemal Aker,et al.  Using deep networks for drone detection , 2017, 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[10]  Stephanie A. Shwiff,et al.  Modeling the cost of bird strikes to US civil aircraft , 2015 .

[11]  Martial Hebert,et al.  Cut, Paste and Learn: Surprisingly Easy Synthesis for Instance Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[12]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  F. Ozge Unel,et al.  The Power of Tiling for Small Object Detection , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[14]  Takio Kurita,et al.  Fast and Accurate Image Super Resolution by Deep CNN with Skip Connection and Network in Network , 2017, ICONIP.

[15]  Pratap Tokekar,et al.  Sensor planning for a symbiotic UAV and UGV system for precision agriculture , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Yingjian Liu,et al.  A drone detection with aircraft classification based on a camera array , 2018 .

[17]  Vincent Lepetit,et al.  Flying objects detection from a single moving camera , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Mehmet Çağrı Aksoy,et al.  Drone Dataset: Amateur Unmanned Air Vehicle Detection , 2019 .

[19]  Zhaohui Zheng,et al.  Distance-IoU Loss: Faster and Better Learning for Bounding Box Regression , 2019, AAAI.

[20]  Angelo Coluccia,et al.  A k-nearest neighbors approach to the design of radar detectors , 2020, Signal Process..

[21]  Thomas Müller,et al.  Robust drone detection for day/night counter-UAV with static VIS and SWIR cameras , 2017, Defense + Security.

[22]  Salem Ardjoune,et al.  Spatio-Temporal Semantic Segmentation for Drone Detection , 2019, 2019 16th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[23]  Jing Li,et al.  Multi-target detection and tracking from a single camera in Unmanned Aerial Vehicles (UAVs) , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[24]  Michael Blumenstein,et al.  Drone Detection in Long-Range Surveillance Videos , 2019, 2019 16th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[25]  Ronald Kemker,et al.  Measuring Catastrophic Forgetting in Neural Networks , 2017, AAAI.

[26]  Leïla Azouz Saïdane,et al.  Monitoring road traffic with a UAV-based system , 2018, 2018 IEEE Wireless Communications and Networking Conference (WCNC).

[27]  Nuno Vasconcelos,et al.  Cascade R-CNN: Delving Into High Quality Object Detection , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[28]  Marek Wojtyra,et al.  Real World Object Detection Dataset for Quadcopter Unmanned Aerial Vehicle Detection , 2020, IEEE Access.

[29]  Nicolas Riviere,et al.  Deep learning-based strategies for the detection and tracking of drones using several cameras , 2019, IPSJ Trans. Comput. Vis. Appl..

[30]  Mohsen Guizani,et al.  Unmanned Aerial Vehicles (UAVs): A Survey on Civil Applications and Key Research Challenges , 2018, IEEE Access.

[31]  Joseph Redmon,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[32]  Brais Bosquet,et al.  STDnet: A ConvNet for Small Target Detection , 2018, BMVC.

[33]  Giuseppe Ricci,et al.  Spectrum sensing by higher-order SVM-based detection , 2019, 2019 27th European Signal Processing Conference (EUSIPCO).

[34]  Giuseppe Ricci,et al.  Online Estimation and Smoothing of a Target Trajectory in Mixed Stationary/moving Conditions , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[35]  Angelo Coluccia,et al.  Robust CFAR Radar Detection Using a K-nearest Neighbors Rule , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[36]  Petros Daras,et al.  Does Deep Super-Resolution Enhance UAV Detection? , 2019, 2019 16th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[37]  Gregory C. Colati,et al.  Better, Faster, Stronger , 2009 .

[38]  Jürgen Beyerer,et al.  Flying object detection for automatic UAV recognition , 2017, 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[39]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[40]  Michael Blumenstein,et al.  A study on detecting drones using deep convolutional neural networks , 2017, 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[41]  Arne Schumann,et al.  Deep cross-domain flying object classification for robust UAV detection , 2017, 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[42]  Sinan Kalkan,et al.  Localization Recall Precision (LRP): A New Performance Metric for Object Detection , 2018, ECCV.

[43]  Alexandr A. Kalinin,et al.  Albumentations: fast and flexible image augmentations , 2018, Inf..

[44]  Toby P. Breckon,et al.  Style Augmentation: Data Augmentation via Style Randomization , 2018, CVPR Workshops.

[45]  Konrad Schindler,et al.  Reconstruction of 3D ight trajectories from ad-hoc camera networks , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[46]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[47]  Petros Daras,et al.  Drone-vs-Bird Detection Challenge at IEEE AVSS2019 , 2019, 2019 16th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[48]  Yu Qiao,et al.  ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks , 2018, ECCV Workshops.

[49]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[50]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  T. Humphreys,et al.  STATEMENT ON THE SECURITY THREAT POSED BY UNMANNED AERIAL SYSTEMS AND POSSIBLE COUNTERMEASURES , 2015 .

[52]  Jianlin Wang,et al.  DC-SPP-YOLO: Dense Connection and Spatial Pyramid Pooling Based YOLO for Object Detection , 2019, Inf. Sci..