Front-end for far-field speech recognition based on frequency domain linear prediction

Automatic Speech Recognition (ASR) systems usually fail when they encounter speech from far-field microphone in reverberant environments. This is due to the application of short-term feature extraction techniques which do not compensate for the artifacts introduced by long room impulse responses. In this paper, we propose a front-end, based on Frequency Domain Linear Prediction (FDLP), that tries to remove reverberation artifacts present in far-field speech. Long temporal segments of far-field speech are analyzed in narrow frequency sub-bands to extract FDLP envelopes and residual signals. Filtering the residual signals with gain normalized inverse FDLP filters result in a set of sub-band signals which are synthesized to reconstruct the signal back. ASR experiments on far-field speech data processed by the proposed front-end show significant improvements (relative reduction of $30 %$ in word error rate) compared to other robust feature extraction techniques.

[1]  Aaron E. Rosenberg,et al.  Cepstral channel normalization techniques for HMM-based speaker verification , 1994, ICSLP.

[2]  John Mourjopoulos,et al.  Modelling and enhancement of reverberant speech using an envelope convolution method , 1983, ICASSP.

[3]  S. Marple Computing the discrete-time 'analytic' signal via FFT , 1997 .

[4]  J. Makhoul,et al.  Linear prediction: A tutorial review , 1975, Proceedings of the IEEE.

[5]  Nelson Morgan,et al.  Double the trouble: handling noise and reverberation in far-field automatic speech recognition , 2002, INTERSPEECH.

[6]  Hynek Hermansky,et al.  Temporal processing of speech in a time-feature space , 1997 .

[7]  James David Johnston,et al.  Enhancing the Performance of Perceptual Audio Coders by Using Temporal Noise Shaping (TNS) , 1996 .

[8]  H Hermansky,et al.  Perceptual linear predictive (PLP) analysis of speech. , 1990, The Journal of the Acoustical Society of America.

[9]  J. Flanagan,et al.  Computer‐steered microphone arrays for sound transduction in large rooms , 1985 .

[10]  Fumitada Itakura,et al.  An approach to dereverberation using multi-microphone sub-band envelope estimation , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[11]  David Pearce,et al.  The aurora experimental framework for the performance evaluation of speech recognition systems under noisy conditions , 2000, INTERSPEECH.

[12]  Hynek Hermansky,et al.  On the effects of short-term spectrum smoothing in channel normalization , 1997, IEEE Trans. Speech Audio Process..

[13]  Daniel P. W. Ellis,et al.  LP-TRAP: linear predictive temporal patterns , 2004, INTERSPEECH.