Multiple Concurrent Sound Source Tracking Based on Observation-Guided Adaptive Particle Filter

Particle filter (PF) has been proved to be an effective tool to track sound sources. In traditional PF, a pre-defined dynamic model is used to model source motion, which tends to be mismatched due to the uncertainty of source motion. Besides, nonstationary interferences pose a severe challenge to source tracking. To this end, an observation-guided adaptive particle filter (OAPF) is proposed for multiple concurrent sound source tracking. Firstly, sensor signals are processed in the time-frequency domain to obtain the direction of arrival (DOA) observations of sources. Then, by updating particle states with these DOA observations, angular distances between particles and observations are reduced to guide particles to directions of sources. Thirdly, particle weights are updated by an interference-adaptive likelihood function to reduce the impacts of interferences. At last, with the updated particles and the corresponding weights, OAPF is utilized to determine the final DOAs of sources. Experimental results demonstrate that our method achieves favorable performance for multiple concurrent sound source tracking in noisy environments.

[1]  V. G. Reju,et al.  Swarm Intelligence Based Particle Filter for Alternating Talker Localization and Tracking Using Microphone Arrays , 2017, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[2]  Friedrich Faubel,et al.  A Multiple Hypothesis Gaussian Mixture Filter for Acoustic Source Localization and Tracking , 2012, IWAENC.

[3]  Ivan Markovic,et al.  Speaker localization and tracking with a microphone array on a mobile robot using von Mises distribution and particle filtering , 2010, Robotics Auton. Syst..

[4]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[5]  D. M. Green,et al.  Sound localization by human listeners. , 1991, Annual review of psychology.

[6]  Sharon Gannot,et al.  Microphone Array Speaker Localizers Using Spatial-Temporal Information , 2006, EURASIP J. Adv. Signal Process..

[7]  Jean Rouat,et al.  Robust localization and tracking of simultaneous moving sound sources using beamforming and particle filtering , 2007, Robotics Auton. Syst..

[8]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[9]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[10]  Athanasios Mouchtaris,et al.  Real-Time Multiple Sound Source Localization and Counting Using a Circular Microphone Array , 2013, IEEE Transactions on Audio, Speech, and Language Processing.

[11]  Takanobu Nishiura,et al.  A study on multiple sound source localization with a distributed microphone system , 2009, INTERSPEECH.

[12]  Hong Liu,et al.  Multiple Sound Source Counting and Localization Based on Spatial Principal Eigenvector , 2017, INTERSPEECH.

[13]  G. Carter,et al.  The generalized correlation method for estimation of time delay , 1976 .

[14]  Ba-Ngu Vo,et al.  Tracking an unknown time-varying number of speakers using TDOA measurements: a random finite set approach , 2006, IEEE Transactions on Signal Processing.

[15]  Dietrich Klakow,et al.  Multiple concurrent speaker short-term tracking using a Kalman filter bank , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[16]  Eric A. Lehmann,et al.  Diffuse Reverberation Model for Efficient Image-Source Simulation of Room Impulse Responses , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[17]  James R. Hopgood,et al.  Particle filtering for TDOA based acoustic source tracking: Nonconcurrent Multiple Talkers , 2014, Signal Process..

[18]  Hong Liu,et al.  Robust Acoustic Localization Via Time-Delay Compensation and Interaural Matching Filter , 2015, IEEE Transactions on Signal Processing.

[19]  Aparajita Sengupta,et al.  Likelihood function modeling of particle filter in presence of non-stationary non-gaussian measurement noise , 2010, Signal Process..

[20]  Darren B. Ward,et al.  Particle filtering algorithms for tracking an acoustic source in a reverberant environment , 2003, IEEE Trans. Speech Audio Process..

[21]  Simon J. Godsill,et al.  Acoustic Source Localization and Tracking Using Track Before Detect , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[22]  Hong Liu,et al.  Binaural Sound Localization Based on Reverberation Weighting and Generalized Parametric Mapping , 2017, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[23]  Andrew Blake,et al.  Nonlinear filtering for speaker tracking in noisy and reverberant environments , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).