A reconfigurable beamformer for audio applications

Beamforming is a signal processing technique that improves the signal strength received from a specific location. It is already used for many decades in telecommunications, while over the last years, it has been adopted by the audio research society, mostly to enhance speech recognition. In this paper, we propose a scalable organization for a hardware time-invariant beamformer that can be used in small handheld devices and complete 3D-audio systems. Our design can be configured according to the number of input channels. Furthermore, all critical internal modules, such as decimators, FIR filters and interpolators can be adjusted to support various input sampling rates. We developed a hardware prototype in VHDL targeting the Xilinx ML410 board incorporating Virtex4 FX60 FPGA. Following a constrained approach regarding FPGA resource utilization, our hardware prototype occupies 21% of the aforementioned FPGA when instantiating 16 beamforming modules, and consumes approximately 2 Watts of power. Furthermore, our design achieves a speedup of 28 compared to an OMP-annotated software implementation running on a Pentium D at 3.4 GHz. We also compared our design against prior related work. Results suggest that it can extract an audio source up to 11 times faster compared to a reconfigurable adaptive beamformer, and up to 19 times faster compared to DSP implementations.

[1]  Henrique S. Malvar,et al.  A new beamformer design algorithm for microphone arrays , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[2]  Michael R. M. Jenkin,et al.  Audiovisual localization of multiple speakers in a video teleconferencing setting , 2003, Int. J. Imaging Syst. Technol..

[3]  Wayne Luk,et al.  Reconfigurable acceleration of microphone array algorithms for speech enhancement , 2008, 2008 International Conference on Application-Specific Systems, Architectures and Processors.

[4]  Miroslav Pajic,et al.  Implementing a Real-Time Beamformer on an FPGA Platform , 2007 .

[5]  Ivan Tashev,et al.  Enhanced Sound Capture System for Small Devices , 2008 .

[6]  B.D. Van Veen,et al.  Beamforming: a versatile approach to spatial filtering , 1988, IEEE ASSP Magazine.

[7]  Ingvar Claesson,et al.  Real-Time DSP Implementation of a Subband Beamforming Algorithm for Dual Microphone Speech Enhancement , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[8]  Walter Kellermann,et al.  An integrated real-time system for immersive audio applications , 2003, 2003 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (IEEE Cat. No.03TH8684).

[9]  Lucas C. Parra,et al.  Steerable frequency-invariant beamforming for arbitrary arrays , 2006 .

[10]  M. Fiala,et al.  provided that the source of such material is fully acknowledged. A Panoramic Video and Acoustic Beamforming Sensor for , 2004 .

[11]  Soledad Torres-Guijarro,et al.  On Building Immersive Audio Applications Using Robust Adaptive Beamforming and Joint Audio-Video Source Localization , 2006, EURASIP J. Adv. Signal Process..

[12]  M. Swartling,et al.  REAL TIME IMPLEMENTATION OF A BLIND BEAMFORMER FOR SUBBAND SPEECH ENHANCEMENT USING KURTOSIS MAXIMIZATION , 2006 .