Digital acoustics: processing wave fields in space and time using DSP tools

Systems with hundreds of microphones for acoustic field acquisition, or hundreds of loudspeakers for rendering, have been proposed and built. To analyze, design, and apply such systems requires a framework that allows us to leverage the vast set of tools available in digital signal processing in order to achieve intuitive and efficient algorithms. We thus propose a discrete space–time framework, grounded in classical acoustics, which addresses the discrete nature of the spatial and temporal sampling. In particular, a short-space/time Fourier transform is introduced, which is the natural extension of the localized or short-time Fourier transform. Processing in this intuitive domain allows us to easily devise algorithms for beam-forming, source separation, and multi-channel compression, among other useful tasks. The essential space band-limitedness of the Fourier spectrum is also used to solve the spatial equalization task required for sound field rendering in a region of interest. Examples of applications are shown.

[1]  A. V. D. Veen.  Algebraic methods for deterministic blind beamforming , 1998, Proc. IEEE.

[2]  Kim-Chuan Toh,et al.  SDPT3 -- A Matlab Software Package for Semidefinite Programming , 1996 .

[3]  T. Ajdler,et al.  The Plenacoustic Function and Its Sampling , 2006, IEEE Transactions on Signal Processing.

[4]  Thushara D. Abhayapala,et al.  Reproduction of a plane-wave sound field using an array of loudspeakers , 2001, IEEE Trans. Speech Audio Process..

[5]  Christof Faller,et al.  Reproducing Sound Fields Using MIMO Acoustic Channel Inversion , 2011 .

[6]  Jerome Daniel,et al.  Further Investigations of High-Order Ambisonics and Wavefield Synthesis for Holophonic Sound Imaging , 2003 .

[7]  A. Berkhout,et al.  Acoustic control by wave field synthesis , 1993 .

[8]  John J. Neumann.  MEMS (Microelectromechanical Systems) Audio Devices - Dreams and Realities , 2003 .

[9]  Rafik A. Goubran,et al.  Near-field beamforming for microphone arrays , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[10]  A. J. Berkhout,et al.  A Holographic Approach to Acoustic Control , 1988 .

[11]  S.J. Elliott,et al.  Active noise control , 1993, IEEE Signal Processing Magazine.

[12]  Jont B. Allen,et al.  Image method for efficiently simulating small‐room acoustics , 1976 .

[13]  Jelena Kovacevic,et al.  Wavelets and Subband Coding , 2013, Prentice Hall Signal Processing Series.

[14]  S. Spors.  Extension of an Analytic Secondary Source Selection Criterion for Wave Field Synthesis , 2007 .

[16]  Vivek K Goyal,et al.  Foundations of Signal Processing , 2014 .

[17]  Jos F. Sturm,et al.  A Matlab toolbox for optimization over symmetric cones , 1999 .

[18]  Hareo Hamada,et al.  Fast deconvolution of multichannel systems using regularization , 1998, IEEE Trans. Speech Audio Process..

[19]  Duane H. Cooper,et al.  Discrete-Matrix Multichannel Stereo , 1972 .

[20]  Philippe-Aubert Gauthier,et al.  Adaptive Wave Field Synthesis for Sound Field Reproduction: Theory, Experiments, and Future Perspectives , 2007 .

[21]  J. Blauert.  Spatial Hearing: The Psychophysics of Human Sound Localization , 1983 .

[22]  Jürgen Herre,et al.  MP3 Surround: Efficient and Compatible Coding of Multi-Channel Audio , 2004 .

[23]  Alan V. Oppenheim,et al.  Discrete-Time Signal Pro-cessing , 1989 .

[24]  Jürgen Herre,et al.  Intensity Stereo Coding , 1994 .

[25]  Prashant Parikh.  A Theory of Communication , 2010 .

[26]  O. Kirkeby,et al.  Reproduction of plane wave sound fields , 1993 .

[27]  E. Verheijen.  Sound reproduction by wave field synthesis , 1998 .

[28]  James D. Johnston,et al.  Transform coding of audio signals using perceptual noise criteria , 1988, IEEE J. Sel. Areas Commun..

[29]  Rodney A. Kennedy,et al.  Intrinsic Limits of Dimensionality and Richness in Random Multipath Fields , 2007, IEEE Transactions on Signal Processing.

[30]  O. Kirkeby,et al.  Local sound field reproduction using digital signal processing , 1996 .

[31]  Masato Miyoshi,et al.  Inverse filtering of room acoustics , 1988, IEEE Trans. Acoust. Speech Signal Process..

[32]  Michael A. Gerzon,et al.  Practical Periphony: The Reproduction of Full-Sphere Sound , 1980 .

[33]  Sen M. Kuo,et al.  Active noise control: a tutorial review , 1999, Proc. IEEE.

[34]  Christof Faller,et al.  Binaural cue coding: a novel and efficient representation of spatial audio , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[35]  Etienne Corteel.  Synthesis of Directional Sources Using Wave Field Synthesis, Possibilities, and Limitations , 2007, EURASIP J. Adv. Signal Process..

[36]  Michael J. Gerzon.  Periphony: With-Height Sound Reproduction , 1973 .

[37]  David G. Long,et al.  Array signal processing , 1985, IEEE Trans. Acoust. Speech Signal Process..

[38]  C.-C. Jay Kuo,et al.  High-fidelity multichannel audio coding with Karhunen-Loeve transform , 2003, IEEE Trans. Speech Audio Process..

[39]  Robert Bregovic,et al.  Multirate Systems and Filter Banks , 2002 .

[40]  Martin Vetterli,et al.  Space-Time-Frequency Processing of Acoustic Wave Fields: Theory, Algorithms, and Applications , 2010, IEEE Transactions on Signal Processing.

[41]  Henrique S. Malvar,et al.  Signal processing with lapped transforms , 1992 .

[42]  Sascha Spors,et al.  Sound Field Reproduction Using Planar and Linear Arrays of Loudspeakers , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[43]  Marina Bosi,et al.  Introduction to Digital Audio Coding and Standards , 2004, J. Electronic Imaging.

[44]  J. D. Johnston,et al.  Sum-difference stereo transform coding , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[45]  B.D. Van Veen,et al.  Beamforming: a versatile approach to spatial filtering , 1988, IEEE ASSP Magazine.