Multisource DOA Estimation in a Reverberant Environment Using a Single Acoustic Vector Sensor

We address the problem of direction-of-arrival (DOA) estimation for multiple speech sources in an enclosed environment using a single acoustic vector sensor. The challenges in such scenario include reverberation and overlapping of the source signals. In this work, we exploit low-reverberant-single-source (LRSS) points in the time–frequency (TF) domain, where a particular source is dominant with high signal-to-reverberation ratio. Unlike conventional algorithms having limitation that such potential points need to be detected at “TF-zone” level, the proposed algorithm performs LRSS detection at “TF-point” level. Therefore, for the proposed algorithm, the potential LRSS points need not be neighbors of each other within a TF zone to be detected, resulting an increased number of detected LRSS points. The detected LRSS points are further screened by an outlier removal step such that only reliable LRSS points will be used for DOA estimation. Simulations and experiments were conducted to demonstrate the effectiveness of the proposed algorithm in multisource reverberant environments.

[1]  Arye Nehorai,et al.  Acoustic vector-sensor array processing , 1994, IEEE Trans. Signal Process..

[2]  Athanasios Mouchtaris,et al.  3D DOA estimation of multiple sound sources based on spatially constrained beamforming driven by intensity vectors , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Yuexian Zou,et al.  Learning soft mask with DNN and DNN-SVM for multi-speaker DOA estimation using an acoustic vector sensor , 2018, J. Frankl. Inst..

[4]  E. Habets,et al.  On the angular error of intensity vector based direction of arrival estimation in reverberant sound fields. , 2010, The Journal of the Acoustical Society of America.

[5]  Sakari Tervo Direction estimation based on sound intensity vectors , 2009, 2009 17th European Signal Processing Conference.

[6]  Shengkui Zhao,et al.  A real-time 3D sound localization system with miniature microphone array for virtual reality , 2012, 2012 7th IEEE Conference on Industrial Electronics and Applications (ICIEA).

[7]  E. Habets,et al.  Maximum likelihood estimation of direction of arrival using an acoustic vector-sensor. , 2012, The Journal of the Acoustical Society of America.

[8]  V. G. Reju,et al.  Multi-source direction-of-arrival estimation in a reverberant environment using single acoustic vector sensor , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[10]  Douglas L. Jones,et al.  Localization of multiple acoustic sources with small arrays using a coherence test. , 2008, The Journal of the Acoustical Society of America.

[11]  Ivan Zhao Rong. Yeo Acoustic vector sensor , 2013 .

[12]  W. Peizhuang Pattern Recognition with Fuzzy Objective Function Algorithms (James C. Bezdek) , 1983 .

[13]  Michael S. Brandstein,et al.  Robust Localization in Reverberant Rooms , 2001, Microphone Arrays.

[14]  Bhaskar D. Rao,et al.  A Two Microphone-Based Approach for Source Localization of Multiple Speech Sources , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[15]  V. G. Reju,et al.  An algorithm for mixing matrix estimation in instantaneous blind source separation , 2009, Signal Process..

[16]  Sina Hafezi,et al.  Multi-source estimation consistency for improved multiple direction-of-arrival estimation , 2017, 2017 Hands-free Speech Communications and Microphone Arrays (HSCMA).

[17]  Arye Nehorai,et al.  Wideband source localization using a distributed acoustic vector-sensor array , 2003, IEEE Trans. Signal Process..

[18]  Jacob Benesty,et al.  Immersive Audio Schemes , 2011, IEEE Signal Process. Mag..

[19]  Huawei Chen,et al.  Coherent signal-subspace processing of acoustic vector sensor array for DOA estimation of wideband sources , 2005, Signal Process..

[20]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[21]  Arye Nehorai,et al.  Acoustic vector-sensor beamforming and Capon direction estimation , 1998, IEEE Trans. Signal Process..

[22]  Athanasios Mouchtaris,et al.  Real-Time Multiple Sound Source Localization and Counting Using a Circular Microphone Array , 2013, IEEE Transactions on Audio, Speech, and Language Processing.

[23]  Don H. Johnson,et al.  Array Signal Processing: Concepts and Techniques , 1993 .

[24]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[25]  Alastair H. Moore,et al.  Direction of Arrival Estimation in the Spherical Harmonic Domain Using Subspace Pseudointensity Vectors , 2017, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[26]  Toon van Waterschoot,et al.  Multi-Channel Linear Prediction-Based Speech Dereverberation With Sparse Priors , 2015, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[27]  Zhengyou Zhang,et al.  Maximum Likelihood Sound Source Localization and Beamforming for Directional Microphone Arrays in Distributed Meetings , 2008, IEEE Transactions on Multimedia.

[28]  Emanuel A. P. Habets,et al.  Direction-of-arrival estimation using acoustic vector sensors in the presence of noise , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[29]  Atiyeh Alinaghi,et al.  Reverberant speech separation with probabilistic time-frequency masking for B-format recordings , 2015, Speech Commun..

[30]  Jiangtao Xi,et al.  Multisource DOA estimation based on time-frequency sparsity and joint inter-sensor data ratio with single acoustic vector sensor , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[31]  Boaz Rafaely,et al.  Localization of Multiple Speakers under High Reverberation using a Spherical Microphone Array and the Direct-Path Dominance Test , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[32]  Rui Xu,et al.  Survey of clustering algorithms , 2005, IEEE Transactions on Neural Networks.

[33]  A. Benjamin Premkumar,et al.  Particle Filtering Approaches for Multiple Acoustic Source Detection and 2-D Direction of Arrival Estimation Using a Single Acoustic Vector Sensor , 2012, IEEE Transactions on Signal Processing.