Acoustic Reflector Localization and Classification

The process of understanding acoustic properties of environments is important for several applications, such as spatial audio, augmented reality and source separation. In this paper, multichannel room impulse responses are recorded and transformed into their direction of arrival (DOA)-time domain, by employing a superdirective beamformer. This domain can be represented as a 2D image. Hence, a novel image processing method is proposed to analyze the DOA-time domain, and estimate the reflection times of arrival and DOAs. The main acoustically reflective objects are then localized. Recent studies in acoustic reflector localization usually assume the room to be free from furniture. Here, by analyzing the scattered reflections, an algorithm is also proposed to binary classify reflectors into room boundaries and interior furniture. Experiments were conducted in four rooms. The classification algorithm showed high quality performance, also improving the localization accuracy, for non-static listener scenarios.

[1]  Walter Kellermann,et al.  Joint DOA and TDOA estimation for 3D localization of reflective surfaces using eigenbeam MVDR and spherical microphone arrays , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[2]  Sylvain Lefebvre,et al.  Instant Sound Scattering , 2007, Rendering Techniques.

[3]  Rémi Gribonval,et al.  From Blind to Guided Audio Source Separation: How models and side information can improve the separation of sound , 2014, IEEE Signal Processing Magazine.

[4]  Ivan Dokmanic,et al.  Raking the Cocktail Party , 2015, IEEE Journal of Selected Topics in Signal Processing.

[5]  Philip J. B. Jackson,et al.  Estimation of Room Reflection Parameters for a Reverberant Spatial Audio Object , 2015 .

[6]  Walter Kellermann,et al.  Room geometry inference based on spherical microphone array eigenbeam processing. , 2013, Journal of the Acoustical Society of America.

[7]  Emanuel A. P. Habets,et al.  Time of arrival disambiguation using the linear Radon transform , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[8]  Martin Vetterli,et al.  From acoustic room reconstruction to slam , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  M. Bai,et al.  Application of convex optimization to acoustical array signal processing , 2013 .

[10]  Piotr Klukowski,et al.  Computer vision-based automated peak picking applied to protein NMR spectra , 2015, Bioinform..

[11]  Emanuel A. P. Habets,et al.  Inference of Room Geometry From Acoustic Impulse Responses , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[12]  Jin Yong Jeon,et al.  A tutorial on scattering and diffusion coefficients for room acoustic surfaces , 2006 .

[13]  J. E. Piercy,et al.  Review of noise propagation in the atmosphere. , 1977, The Journal of the Acoustical Society of America.

[14]  Maximo Cobos,et al.  Room acoustics analysis using circular arrays: an experimental study based on sound field plane-wave decomposition. , 2013, The Journal of the Acoustical Society of America.

[15]  Sakari Tervo,et al.  Estimation of reflective surfaces from continuous signals , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[16]  Philip J. B. Jackson,et al.  Acoustic Reflector Localization: Novel Image Source Reversion and Direct Localization Methods , 2016, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[17]  Frank Melchior,et al.  Object-Based Reverberation for Spatial Audio , 2017 .

[18]  Andrea Fusiello,et al.  Automation of peak-tracking analysis of stepwise perturbed NMR spectra , 2017, Journal of biomolecular NMR.

[19]  D. S. Garrett,et al.  A common sense approach to peak picking in two-, three-, and four-dimensional spectra using automatic computer analysis of contour diagrams. 1991. , 2011, Journal of magnetic resonance.

[20]  D. Vries,et al.  Acoustic imaging in enclosed spaces: Analysis of room geometry modifications on the impulse response , 2004 .

[21]  Ian Oakley,et al.  Auditory display design for exploration in mobile audio-augmented reality , 2012, Personal and Ubiquitous Computing.

[22]  Heinrich Kuttruff,et al.  Room acoustics , 1973 .

[23]  Martin Vetterli,et al.  Acoustic echoes reveal room shape , 2013, Proceedings of the National Academy of Sciences.

[24]  Hafiz Malik,et al.  Acoustic Environment Identification and Its Applications to Audio Forensics , 2013, IEEE Transactions on Information Forensics and Security.

[25]  Adrian Hilton,et al.  3D Room Geometry Reconstruction Using Audio-Visual Sensors , 2017, 2017 International Conference on 3D Vision (3DV).

[26]  Guy Lapalme,et al.  A systematic analysis of performance measures for classification tasks , 2009, Inf. Process. Manag..

[27]  Sakari Tervo,et al.  3D room geometry estimation from measured impulse responses , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[28]  Jont B. Allen,et al.  Image method for efficiently simulating small‐room acoustics , 1976 .