Machine Learning-Based Drone Detection and Classification: State-of-the-Art in Research

This paper presents a comprehensive review of current literature on drone detection and classification using machine learning with different modalities. This research area has emerged in the last few years due to the rapid development of commercial and recreational drones and the associated risk to airspace safety. Addressed technologies encompass radar, visual, acoustic, and radio-frequency sensing systems. The general finding of this study demonstrates that machine learning-based classification of drones seems to be promising with many successful individual contributions. However, most of the performed research is experimental and the outcomes from different papers can hardly be compared. A general requirement-driven specification for the problem of drone detection and classification is still missing as well as reference datasets which would help in evaluating different solutions.

[1]  Mohammed Jahangir,et al.  Extended dwell Doppler characteristics of birds and micro-UAS at l-band , 2017, 2017 18th International Radar Symposium (IRS).

[2]  Jonathan Histon,et al.  Feature extraction and radar track classification for detecting UAVs in civillian airspace , 2014, 2014 IEEE Radar Conference.

[3]  Jian Wang,et al.  Software Defined Radio and Wireless Acoustic Networking for Amateur Drone Surveillance , 2018, IEEE Communications Magazine.

[4]  Richard Han,et al.  Investigating Cost-effective RF-based Detection of Drones , 2016, DroNet@MobiSys.

[5]  John C. Gallagher,et al.  UAV Detection System with Multiple Acoustic Nodes Using Machine Learning Models , 2019, 2019 Third IEEE International Conference on Robotic Computing (IRC).

[6]  Junghyun Park,et al.  Real-time UAV sound detection and analysis system , 2017, 2017 IEEE Sensors Applications Symposium (SAS).

[7]  Hugh D. Griffiths,et al.  Classification of Birds and UAVs Based on Radar Polarimetry , 2016, IEEE Geoscience and Remote Sensing Letters.

[8]  Alexander Charlish,et al.  Micro-Doppler based detection and tracking of UAVs with multistatic radar , 2016, 2016 IEEE Radar Conference (RadarConf).

[9]  L. Fuhrmann,et al.  Micro-Doppler analysis and classification of UAVs at Ka band , 2017, 2017 18th International Radar Symposium (IRS).

[10]  Michael Blumenstein,et al.  A study on detecting drones using deep convolutional neural networks , 2017, 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[11]  Francesco Fioranelli,et al.  Multistatic micro-Doppler radar feature extraction for classification of unloaded/loaded micro-drones , 2017 .

[12]  Cemal Aker,et al.  Using deep networks for drone detection , 2017, 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[13]  Emmanuel Zenou,et al.  Using Shape Descriptors for UAV Detection , 2018, IRIACV.

[14]  Chris Baker,et al.  Robust Detection of Micro-UAS Drones with L-Band 3-D Holographic Radar , 2016, 2016 Sensor Signal Processing for Defence (SSPD).

[15]  Ismail Güvenç,et al.  Detection, Tracking, and Interdiction for Amateur Drones , 2018, IEEE Communications Magazine.

[16]  Louise Hauzenberger,et al.  Drone Detection using Audio Analysis , 2015 .

[17]  Sungbin Im,et al.  Drone Detection Using Convolutional Neural Networks with Acoustic STFT Features , 2018, 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[18]  J. J. M. de Wit,et al.  Classification of small UAVs and birds by micro-Doppler signatures , 2013, 2013 European Radar Conference.

[19]  Dusan Zrnic,et al.  Observations of insects and birds with a polarimetric radar , 1998, IEEE Trans. Geosci. Remote. Sens..

[20]  Jin Wei,et al.  Deep learning cognitive radar for micro UAS detection and classification , 2017, 2017 Cognitive Communications for Aerospace Applications Workshop (CCAA).

[21]  Takeshi Naemura,et al.  Differentiating Objects by Motion: Joint Detection and Tracking of Small Flying Objects , 2017 .

[22]  S. Haykin,et al.  Cognitive radar: a way of the future , 2006, IEEE Signal Processing Magazine.

[23]  Dov Wulich,et al.  Classification of Single and Multi Propelled Miniature Drones Using Multilayer Perceptron Artificial Neural Network , 2017 .

[24]  Mubashir Husain Rehmani,et al.  Amateur Drone Monitoring: State-of-the-Art Architectures, Key Enabling Technologies, and Future Research Directions , 2017, IEEE Wireless Communications.

[25]  Mohammed Jahangir,et al.  Doppler characteristics of micro-drones with L-Band multibeam staring radar , 2017, 2017 IEEE Radar Conference (RadarConf).

[26]  Alessio Del Bue,et al.  Seeing the Sound: A New Multimodal Imaging Device for Computer Vision , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[27]  Seong-Ook Park,et al.  Drone Classification Using Convolutional Neural Networks With Merged Doppler Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[28]  Jin Wei,et al.  Deep learning based doppler radar for micro UAS detection and classification , 2016, MILCOM 2016 - 2016 IEEE Military Communications Conference.

[29]  Mais Nijim,et al.  Drone classification and identification system by phenome analysis using data mining techniques , 2016, 2016 IEEE Symposium on Technologies for Homeland Security (HST).

[30]  Francesco Fioranelli,et al.  Classification of loaded/unloaded micro-drones using multistatic radar , 2015 .

[31]  Jian Yang,et al.  Robust direction of arrival estimation approach for unmanned aerial vehicles at low signal-to-noise ratios , 2019, IET Signal Process..

[32]  Hwangnam Kim,et al.  Drone Detection and Identification System using Artificial Intelligence , 2018, 2018 International Conference on Information and Communication Technology Convergence (ICTC).

[33]  Fatih Erden,et al.  Micro-UAV Detection and Classification from RF Fingerprints Using Machine Learning Techniques , 2019, 2019 IEEE Aerospace Conference.

[34]  Francesco Fioranelli,et al.  Review of radar classification and RCS characterisation techniques for small UAVs or drones , 2018, IET Radar, Sonar & Navigation.

[35]  Pin Lv,et al.  Using images rendered by PBRT to train faster R-CNN for UAV detection , 2018 .

[36]  H. Vincent Poor,et al.  Introduction to the Issue on Machine Learning for Cognition in Radio Communications and Radar , 2018, IEEE J. Sel. Top. Signal Process..

[37]  Senén Barro,et al.  Do we need hundreds of classifiers to solve real world classification problems? , 2014, J. Mach. Learn. Res..

[38]  P. Fua,et al.  Detecting Flying Objects Using a Single Moving Camera , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Sofie Pollin,et al.  Key Technologies and System Trade-offs for Detection and Localization of Amateur Drones , 2017, IEEE Communications Magazine.

[40]  Gang Li,et al.  Classification of drones based on micro-Doppler signatures with dual-band radar sensors , 2017, 2017 Progress in Electromagnetics Research Symposium - Fall (PIERS - FALL).

[41]  Gang Li,et al.  Detection of multiple micro-drones via cadence velocity diagram analysis , 2018 .

[42]  Matthieu Cord,et al.  Temporal Deep Learning for Drone Micro-Doppler Classification , 2018, 2018 19th International Radar Symposium (IRS).

[43]  Xiaojiang Du,et al.  Detection of LSSUAV using hash fingerprint based SVDD , 2017, 2017 IEEE International Conference on Communications (ICC).

[44]  Robert L. Williams,et al.  A collaborative smartphone sensing platform for detecting and tracking hostile drones , 2013, Defense, Security, and Sensing.

[45]  Young-Jun Lee,et al.  Empirical study of drone sound detection in real-life environment with deep neural networks , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).

[46]  Licia Capodiferro,et al.  Drone detection by acoustic signature identification , 2017, IMAWM.