Applications of short space-time fourier analysis in digital acoustics

This paper presents a signal processing tool for analyzing and manipulating digitized acoustic wave fields, based on a spatio-temporal extension of the time-frequency representation space. The emphasis is on wave fields acquired with a 1-D linear array of equidistant microphones (representing the spatial samples), but the basic formulation is valid for the three dimensions of space. We start by defining a spatio-temporal extension of the short time Fourier transform, in both continuous and discrete space and time, and then focus on applications of the proposed representation. In particular, we show that acoustic scenes with multiple sources can benefit from the use of space-frequency analysis in applications such as source separation (spatial filtering) and spatial audio coding (wave field coding). The experiments suggest that there is a spatial window size for which the performance of filtering and coding is optimal.

[1]  Martin Vetterli,et al.  Space-Time-Frequency Processing of Acoustic Wave Fields: Theory, Algorithms, and Applications , 2010, IEEE Transactions on Signal Processing.

[2]  Martin Vetterli,et al.  Wave Field coding in the spacetime frequency domain , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[3]  A.K. Krishnamurthy,et al.  Multidimensional digital signal processing , 1985, Proceedings of the IEEE.

[4]  T. Ajdler,et al.  The Plenacoustic Function and Its Sampling , 2006, IEEE Transactions on Signal Processing.

[5]  Prashant Parikh A Theory of Communication , 2010 .

[6]  A. Berkhout,et al.  Acoustic control by wave field synthesis , 1993 .

[7]  Jürgen Herre,et al.  MP3 Surround: Efficient and Compatible Coding of Multi-Channel Audio , 2004 .