Noise2Weight: On Detecting Payload Weight from Drones Acoustic Emissions

The increasing popularity of autonomous and remotely-piloted drones have paved the way for several use-cases, e.g., merchandise delivery and surveillance. In many scenarios, estimating with zero-touch the weight of the payload carried by a drone before its physical approach could be attractive, e.g., to provide an early tampering detection. In this paper, we investigate the possibility to remotely detect the weight of the payload carried by a commercial drone by analyzing its acoustic fingerprint. We characterize the difference in the thrust needed by the drone to carry different payloads, resulting in significant variations of the related acoustic fingerprint. We applied the above findings to different use-cases, characterized by different computational capabilities of the detection system. Results are striking: using the Mel-Frequency Cepstral Coefficients (MFCC) components of the audio signal and different Support Vector Machine (SVM) classifiers, we achieved a minimum classification accuracy of 98% in the detection of the specific payload class carried by the drone, using an acquisition time of 0.25 s---performances improve when using longer time acquisitions. All the data used for our analysis have been released as open-source, to enable the community to validate our findings and use such data as a ready-to-use basis for further investigations.

[1]  Roberto Di Pietro,et al.  Semantically-Aware Statistical Metrics via Weighting Kernels , 2019, 2019 IEEE International Conference on Data Science and Advanced Analytics (DSAA).

[2]  Kristin P. Bennett,et al.  Multicategory Classification by Support Vector Machines , 1999, Comput. Optim. Appl..

[3]  Roberto Di Pietro,et al.  PiNcH: An effective, efficient, and robust solution to drone detection via network traffic analysis , 2019, Comput. Networks.

[4]  Mia Suhanek,et al.  Analysis of a Quadcopter’s Acoustic Signature in Different Flight Regimes , 2020, IEEE Access.

[5]  Riham Altawy,et al.  Security, Privacy, and Safety Aspects of Civilian Drones , 2016, ACM Trans. Cyber Phys. Syst..

[6]  Emmanuel Lemoine,et al.  Amazon Prime Air , 2019 .

[7]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[8]  Geoffrey H. Goldman,et al.  Acoustic Detection and Tracking of a Class I UAS with a Small Tetrahedral Microphone Array , 2014 .

[9]  Soundarya Ramesh,et al.  SoundUAV: Towards Delivery Drone Authentication via Acoustic Noise Fingerprinting , 2019 .

[10]  Jian Wang,et al.  Software Defined Radio and Wireless Acoustic Networking for Amateur Drone Surveillance , 2018, IEEE Communications Magazine.

[11]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[12]  KyungHi Chang,et al.  Hidden Markov model based drone sound recognition using MFCC technique in practical noisy environments , 2018, Journal of Communications and Networks.

[13]  Young-Jun Lee,et al.  Empirical study of drone sound detection in real-life environment with deep neural networks , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).

[14]  Licia Capodiferro,et al.  Drone detection by acoustic signature identification , 2017, IMAWM.

[15]  Louise Hauzenberger,et al.  Drone Detection using Audio Analysis , 2015 .

[16]  Roberto Di Pietro,et al.  Drive me not: GPS spoofing detection via cellular network: (architectures, models, and experiments) , 2019, WiSec.

[17]  Roberto Di Pietro,et al.  Short-Range Audio Channels Security: Survey of Mechanisms, Applications, and Research Challenges , 2020, ArXiv.

[18]  Raffaello D'Andrea,et al.  Guest Editorial Can Drones Deliver? , 2014, IEEE Trans Autom. Sci. Eng..

[19]  Richard Han,et al.  Matthan: Drone Presence Detection by Identifying Physical Signatures in the Drone's RF Communication , 2017, MobiSys.

[20]  Ismail Güvenç,et al.  Drones for smart cities: Issues in cybersecurity, privacy, and public safety , 2016, 2016 International Wireless Communications and Mobile Computing Conference (IWCMC).

[21]  Pietro Tedeschi,et al.  Leveraging Jamming to Help Drones Complete Their Mission , 2020, IEEE Access.

[22]  Dane Bamburry,et al.  Drones: Designed for Product Delivery , 2015, Design Management Review.

[23]  Dongho Kim,et al.  Neural Network based Real-time UAV Detection and Analysis by Sound , 2018, JOURNAL OF ADVANCED INFORMATION TECHNOLOGY AND CONVERGENCE.

[24]  Xuejing Sun,et al.  Pitch determination and voice quality analysis using Subharmonic-to-Harmonic Ratio , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[25]  Abbas Jamalipour,et al.  Machine Learning Inspired Sound-Based Amateur Drone Detection for Public Safety Applications , 2019, IEEE Transactions on Vehicular Technology.

[26]  Adi Shamir,et al.  Drones' Cryptanalysis - Smashing Cryptography with a Flicker , 2019, 2019 IEEE Symposium on Security and Privacy (SP).

[27]  Roberto Di Pietro,et al.  Detecting Drones Status via Encrypted Traffic Analysis , 2019, WiseML@WiSec.

[28]  Junfeng Wu,et al.  A Surveillance System for Drone Localization and Tracking Using Acoustic Arrays , 2018, 2018 IEEE 10th Sensor Array and Multichannel Signal Processing Workshop (SAM).

[29]  Ronald W. Schafer,et al.  Theory and Applications of Digital Speech Processing , 2010 .

[30]  Hanif Ullah,et al.  5G Communication: An Overview of Vehicle-to-Everything, Drones, and Healthcare Use-Cases , 2019, IEEE Access.

[31]  Alexander Charlish,et al.  Micro-Doppler based detection and tracking of UAVs with multistatic radar , 2016, 2016 IEEE Radar Conference (RadarConf).

[32]  Jiming Chen,et al.  Anti-Drone System with Multiple Surveillance Technologies: Architecture, Implementation, and Challenges , 2018, IEEE Communications Magazine.

[33]  Roberto Di Pietro,et al.  GNSS spoofing detection via opportunistic IRIDIUM signals , 2020, WISEC.