Singular Spectrum Analysis for Source Separation in Drone-Based Audio Recording

The usage of drones is increasingly spreading into new fields of application, ranging from agriculture to security. One of these new applications is sound recording in areas of difficult access. The challenge that arises when using drones for this purpose is that the sound of the recorded sources must be separated from the noise produced by the drone. The intensity of the noise emitted by the drone depends on several factors such as engine power, propeller rotation speed, or propeller type. Noise reduction is thus one of the greatest challenges for the next generations of unmanned aerial vehicles (UAVs) and unmanned aerial systems (UAS). Even though some advances have been made on that matter, drones still produce a considerable noise. In this article, we approach the problem of removing drone noise from single-channel audio recordings using blind source separation (BSS) techniques, and in particular, the singular spectrum analysis algorithm (SSA). Furthermore, we propose an optimization of this algorithm with a spatial complexity of <inline-formula> <tex-math notation="LaTeX">$\mathcal {O}(nt)$ </tex-math></inline-formula>, which is significantly lower than the naive implementation which has a spatial complexity of <inline-formula> <tex-math notation="LaTeX">$O(tk^{2})$ </tex-math></inline-formula> (where <inline-formula> <tex-math notation="LaTeX">$n$ </tex-math></inline-formula> is the number of sounds to be recovered, <inline-formula> <tex-math notation="LaTeX">$t$ </tex-math></inline-formula> is the signal length and <inline-formula> <tex-math notation="LaTeX">$k$ </tex-math></inline-formula> is the window size). The best value for each parameter (window length and number of components used to reconstruct the source) is selected by testing a wide range of values on different noise-sound ratios. Our system can greatly reduce the noise produced by the drone on said recordings. On average, after the recording has been processed by our method, the noise is reduced by 1.41 decibels.

[1]  Rui Wang,et al.  Selection of window length for singular spectrum analysis , 2015, J. Frankl. Inst..

[2]  Lin Wang,et al.  Deep Learning Assisted Time-Frequency Processing for Speech Enhancement on Drones , 2021, IEEE Transactions on Emerging Topics in Computational Intelligence.

[3]  Anthony Zaknich,et al.  Principles of Adaptive Filters and Self-learning Systems (Advanced Textbooks in Control and Signal Processing) , 2005 .

[4]  Bojja Venkata Hemambhar,et al.  Denoising of ECG Signals Using Fuzzy Based Singular Spectrum Analysis , 2018, RAICS 2018.

[5]  Anton Korobeynikov,et al.  Computation- and Space-Efficient Implementation of SSA , 2009, ArXiv.

[6]  Zengli Liu,et al.  Method of Multi-resolution and Effective Singular Value Decomposition in Under-determined Blind Source Separation and Its Application to the Fault Diagnosis of Roller Bearing , 2015, 2015 11th International Conference on Computational Intelligence and Security (CIS).

[7]  Jorge Ivan Marin-Hurtado,et al.  Multichannel Wiener filter method for noise reduction in reverberant environments for binaural hearing aids , 2015, 2015 20th Symposium on Signal Processing, Images and Computer Vision (STSIVA).

[8]  J. L. Cross,et al.  In-flight acoustic testing techniques using the YO-3A acoustic research aircraft , 1983 .

[9]  Xin Wang,et al.  A new fast nonlinear principal component analysis algorithm for blind source separation , 2015, 2015 12th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[10]  Robert S. Freeland,et al.  Overall results and key findings on the use of UAV visible-color, multispectral, and thermal infrared imagery to map agricultural drainage pipes , 2020 .

[11]  Chan-Cheng Liu,et al.  Evolutionary noise reduction based on correlation evaluation , 2010 .

[12]  Andrea Cavallaro,et al.  A Blind Source Separation Framework for Ego-Noise Reduction on Multi-Rotor Drones , 2020, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[13]  Hiroshi Sawada,et al.  Grouping Separated Frequency Components by Estimating Propagation Model Parameters in Frequency-Domain Blind Source Separation , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[14]  Walter Kellermann,et al.  Ego-noise reduction using a motor data-guided multichannel dictionary , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[15]  Marc Moonen,et al.  GEVD Based Speech and Noise Correlation Matrix Estimation for Multichannel Wiener Filter Based Noise Reduction , 2018, 2018 26th European Signal Processing Conference (EUSIPCO).

[16]  Jean-Marc Valin,et al.  A Hybrid DSP/Deep Learning Approach to Real-Time Full-Band Speech Enhancement , 2017, 2018 IEEE 20th International Workshop on Multimedia Signal Processing (MMSP).

[17]  Hyunseung Choo,et al.  A Software Platform for Noise Reduction in Sound Sensor Equipped Drones , 2019, IEEE Sensors Journal.

[18]  W. Jatmiko,et al.  Particle Swarm Optimization based Nonlocal Means for Denoising ECG Signal , 2019, 2019 IEEE International Conference on Signals and Systems (ICSigSys).

[19]  Wiesław Fiebig,et al.  Use of Acoustic Camera for Noise Sources Localization and Noise Reduction in the Industrial Plant , 2020, Archives of Acoustics.

[20]  Mohsen Guizani,et al.  Unmanned Aerial Vehicles (UAVs): A Survey on Civil Applications and Key Research Challenges , 2018, IEEE Access.

[21]  Min Zhang,et al.  Research on blind source separation and blind beamforming , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[22]  Jiaxin Zhou,et al.  Background noise suppression of magnetic anomaly signal based on wavelet transform , 2017, 2017 IEEE 17th International Conference on Communication Technology (ICCT).

[23]  ZhongGao Sun,et al.  Removal of Baseline Wander in ECG Signals Using Singular Spectrum Analysis , 2019, 2019 IEEE 9th International Conference on Electronics Information and Emergency Communication (ICEIEC).

[24]  L. Marino,et al.  Experimental analysis on the noise of propellers for small UAV , 2013 .

[25]  Li Zhang,et al.  A reconfigurable 1/2/3-order Butterworth LP/CBP filter with noise canceller for sub-GHz applications , 2016, 2016 13th IEEE International Conference on Solid-State and Integrated Circuit Technology (ICSICT).

[26]  Prasant Misra,et al.  Aerial Drones with Location-Sensitive Ears , 2018, IEEE Communications Magazine.

[28]  Seismic Data De-noising Based on Second Wavelet Transform , 2008, 2008 International Conference on Advanced Computer Theory and Engineering.

[29]  Anatoly A. Zhigljavsky,et al.  Singular Spectrum Analysis for Time Series , 2013, International Encyclopedia of Statistical Science.

[30]  Kwang-Cheng Chen,et al.  Sparse PCA via hard thresholding for blind source separation , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[31]  Bojja Venkata Hemambhar,et al.  Denoising of ECG Signals Using Fuzzy Based Singular Spectrum Analysis , 2018, 2018 IEEE Recent Advances in Intelligent Computational Systems (RAICS).

[32]  Seyed Ghorshi,et al.  Noise reduction using multi-channel FIR warped Wiener filter , 2016, 2016 13th International Multi-Conference on Systems, Signals & Devices (SSD).

[33]  Ching-Haur Chang,et al.  Denoising of mixed noises in ECG with separate noise estimators based on discrete wavelet transform , 2016, 2016 International Conference on Advanced Materials for Science and Engineering (ICAMSE).

[34]  Keisuke Nakamura,et al.  Improvement in outdoor sound source detection using a quadrotor-embedded microphone array , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[35]  Suhap Sahin,et al.  Indoor reduction of noise in RF signal with Kalman Filter , 2015, 2015 23nd Signal Processing and Communications Applications Conference (SIU).

[36]  Yang Li,et al.  Study on Improved Singular Value Decomposition De-noising Method Applied to UAV Flight Parameter Data , 2019, 2019 IEEE 20th International Conference on High Performance Switching and Routing (HPSR).

[37]  Donald B. Hanson,et al.  Influence of Propeller Design Parameters on Far-Field Harmonic Noise in Forward Flight , 1980 .

[38]  André Sales Mendes,et al.  An Architectural Multi-Agent System for a Pavement Monitoring System with Pothole Recognition in UAV Images , 2020, Sensors.

[39]  V. Hoehne,et al.  The quieted aircraft as a military tool , 1969 .

[40]  Gang Liu,et al.  A novel blind source separation method for single-channel signal , 2010, Signal Process..

[41]  B. Widrow,et al.  Adaptive noise cancelling: Principles and applications , 1975 .

[42]  Ming Liu,et al.  Environmental Attention-Guided Branchy Neural Network for Speech Enhancement , 2020, Applied Sciences.

[43]  Jorge Sá Silva,et al.  PRISER: Managing Notification in Multiples Devices with Data Privacy Support , 2019, Sensors.

[44]  MingChui Dong,et al.  Environmental noise elimination of heart sound based on singular spectrum analysis , 2014, 2014 Cairo International Biomedical Engineering Conference (CIBEC).

[45]  Seyed Ghorshi,et al.  Noise reduction of speech signal using bayesian state-space Kalman filter , 2013, 2013 19th Asia-Pacific Conference on Communications (APCC).