Beamforming-Based Acoustic Source Localization and Enhancement for Multirotor UAVs

The problem of acoustic source localization and signal enhancement through beamforming techniques is especially challenging when the acoustic recording is performed using microphone arrays installed on multirotor unmanned aerial vehicles (UAVs), The principal source of disturbances in this class of devices is given by the high frequency, narrowband noise originated by the electrical engines, and by the broadband aerodynamic noise induced by the propellers. A solution to this problem is investigated, which employs an efficient beamforming-based spectral distance response algorithm for both localization and enhancement of the source. The beamforming relies on a diagonal unloading (DU) transformation. The proposed algorithm was tested on a multirotor micro aerial vehicle (MAV) equipped with a compact uniform linear array (ULA) of four microphones, perpendicular to the rear-front axis of the drone. The array is positioned slightly above the plane of propellers, and centered with respect to the drone body. The experimental results conducted in stable hovering conditions are illustrated, and the localization and signal enhancing performances are reported under various noise conditions and source characteristics.

[1]  Andrea Cavallaro,et al.  Time-frequency processing for sound source localization from a micro aerial vehicle , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[2]  Richard Han,et al.  Matthan: Drone Presence Detection by Identifying Physical Signatures in the Drone's RF Communication , 2017, MobiSys.

[3]  Makoto Kumon,et al.  Design model of microphone arrays for multirotor helicopters , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[4]  Yusuke Hioka,et al.  Speech enhancement using a microphone array mounted on an unmanned aerial vehicle , 2016, 2016 IEEE International Workshop on Acoustic Signal Enhancement (IWAENC).

[5]  Dario Floreano,et al.  On-Board Relative Bearing Estimation for Teams of Drones Using Sound , 2016, IEEE Robotics and Automation Letters.

[6]  Rajesh M. Hegde,et al.  Near-Field Acoustic Source Localization and Beamforming in Spherical Harmonics Domain , 2016, IEEE Transactions on Signal Processing.

[7]  Hiroshi G. Okuno,et al.  Design of UAV-Embedded Microphone Array System for Sound Source Localization in Outdoor Environments † , 2017, Sensors.

[8]  G. Carter,et al.  The generalized correlation method for estimation of time delay , 1976 .

[9]  Carlo Drioli,et al.  Frequency map selection using a RBFN-based classifier in the MVDR beamformer for speaker localization in reverberant rooms , 2015, INTERSPEECH.

[10]  Enrico Pagello,et al.  DOA Acoustic Source Localization in Mobile Robot Sensor Networks , 2015, 2015 IEEE International Conference on Autonomous Robot Systems and Competitions.

[11]  Carlo Drioli,et al.  A Low-Complexity Robust Beamforming Using Diagonal Unloading for Acoustic Source Localization , 2018, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[12]  R. McAulay Maximum likelihood spectral estimation and its application to narrow-band speech coding , 1984 .

[13]  R. O. Schmidt,et al.  Multiple emitter location and signal Parameter estimation , 1986 .

[14]  Athanasios Mouchtaris,et al.  A Survey of Sound Source Localization Methods in Wireless Acoustic Sensor Networks , 2017, Wirel. Commun. Mob. Comput..

[15]  Andrea Cavallaro,et al.  Microphone-Array Ego-Noise Reduction Algorithms for Auditory Micro Aerial Vehicles , 2017, IEEE Sensors Journal.

[16]  Carlo Drioli,et al.  A weighted MVDR beamformer based on SVM learning for sound source localization , 2016, Pattern Recognit. Lett..

[17]  Yeong-Ju Go,et al.  Sound source positioning using microphone array installed on a flying drone , 2016 .

[18]  Katsutoshi Itoyama,et al.  Noise correlation matrix estimation for improving sound source localization by multirotor UAV , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Philippe Souères,et al.  A survey on sound source localization in robotics: From binaural to array processing methods , 2015, Comput. Speech Lang..

[20]  B.D. Van Veen,et al.  Beamforming: a versatile approach to spatial filtering , 1988, IEEE ASSP Magazine.

[21]  Paris Smaragdis,et al.  Robust Source Localization and Enhancement With a Probabilistic Steered Response Power Model , 2016, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[22]  Sunggeun Yoo,et al.  Advanced sound capturing method with adaptive noise reduction system for broadcasting multicopters , 2015, 2015 IEEE International Conference on Consumer Electronics (ICCE).

[23]  Jean Rouat,et al.  Robust sound source localization using a microphone array on a mobile robot , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[24]  Carlo Drioli,et al.  Incoherent Frequency Fusion for Broadband Steered Response Power Algorithms in Noisy Environments , 2014, IEEE Signal Processing Letters.

[25]  Keisuke Nakamura,et al.  Outdoor auditory scene analysis using a moving microphone array embedded in a quadrocopter , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.