Circular Microphone Array Based Beamforming and Source Localization on Reconfigurable Hardware

Source localization and beamforming using microphone arrays are common strategies for speech enhancement and source separation in various applications related to voice capturing. This thesis focuses on their implementation on hardware with real time constraints. Several algorithms are used and the idea is to increase performances as much as possible. Therefore, mathematical and physical optimizations are considered, as well as improvements due to the board's specificities. Nevertheless, the work focuses more on handling of basic solutions by the hardware features. A hybrid plateform is at disposal ; it puts a reprogrammable computation unit and a more classical cpu together. The improvements are significant and the real-time constraints are achieved notwithstanding the fact that hardware capacities and ressources are limited regarding this application that deals with multiple microphone outputs. Acknowledgements I first want to thank Harald Romsdorfer and Gernot Kubin that made this master thesis possible by welcoming me at the Signal Processing and Speech Communication Laboratory, respectively in their capacity as supervisor and head of the laboratory. Then, Manfred Mücke and Thang Viet Huynh for helping me with the board and Tania Habib who helped me to learn more about beamforming. Wolfgang Jäger and I had very close work together on this project and we gave each other advice and hints: I am really grateful to him for all this. I also want to thank all the workers at the SPSC laboratory, the administration members, administrators, and Ph.D students whom have ever been kind to me. Finally, all the master students with whom I have been working during these six months are to acknowledge, especially

[1]  Nikolaos Mitianoudis,et al.  Audio source separation of convolutive mixtures , 2003, IEEE Trans. Speech Audio Process..

[2]  Rainer Martin,et al.  Acoustic Source Localization with Microphone Arrays , 2008 .

[3]  L. J. Griffiths,et al.  An alternative approach to linearly constrained adaptive beamforming , 1982 .

[4]  Wei-Xing Sheng,et al.  Robust partially adaptive array processing based on generalized sidelobe canceller , 2008, 2008 Asia-Pacific Microwave Conference.

[5]  Kok Lay Teo,et al.  Steerable Far-field Circular Array , 2006, 2006 Australian Communications Theory Workshop.

[6]  Jianfeng Chen,et al.  A fixed blocking matrix for robust microphone array beamforming , 2003, Seventh International Symposium on Signal Processing and Its Applications, 2003. Proceedings..

[7]  John McDonough,et al.  Distant Speech Recognition , 2009 .

[8]  P. Stoica,et al.  Robust Adaptive Beamforming , 2013 .

[9]  Zhengyou Zhang,et al.  Maximum Likelihood Sound Source Localization and Beamforming for Directional Microphone Arrays in Distributed Meetings , 2008, IEEE Transactions on Multimedia.

[10]  Henry Cox,et al.  Robust adaptive beamforming , 2005, IEEE Trans. Acoust. Speech Signal Process..

[11]  Kazuya Takeda,et al.  Speech enhancement using nonlinear microphone array with complementary beamforming , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[12]  Akihiko Sugiyama,et al.  A robust generalized sidelobe canceller with a blocking matrix using leaky adaptive filters , 1997 .

[13]  Terence Betlehem,et al.  Acoustic beamforming exploiting directionality of human speech sources , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[14]  Akihiko Sugiyama,et al.  A robust adaptive beamformer for microphone arrays with a blocking matrix using constrained adaptive filters , 1999, IEEE Trans. Signal Process..

[15]  Rahman Fatama Documentation and Help , 2016 .

[16]  Bin Huang,et al.  Microphone Array Speech Enhancement Based on Filter Bank Generalized Sidelobe Canceller , 2009, 2009 First International Workshop on Education Technology and Computer Science.

[17]  Jingdong Chen,et al.  Microphone Array Signal Processing , 2008 .

[18]  B.D. Van Veen,et al.  Beamforming: a versatile approach to spatial filtering , 1988, IEEE ASSP Magazine.

[19]  Nikolaos Mitianoudis,et al.  Using beamforming in the audio source separation problem , 2003, Seventh International Symposium on Signal Processing and Its Applications, 2003. Proceedings..