Low Delay Error Concealment for Audio Signals

This paper is concerned with error concealment in digital audio signals. Two model based methods for signal extrapolation are developed and compared. Among these is the usage of adaptive Kalman filtering which can be processed with zero algorithmic delay in real-time. We also improved an approach which is based on linear prediction by enhancing it with an adaptive parameter usage. The proposed methods, especially the linear prediction approach, perform excellently on maximum gap lengths of about 10ms. On some monophonic signals the concealment can be extended up to 100ms without a loss of perceived quality. Both approaches have been compared and evaluated by an informal listening test.

[1]  Mathieu Lagrange,et al.  Long Interpolation of Audio Signals Using Linear Prediction in Sinusoidal Modeling , 2005 .

[2]  S. Vaseghi.  Detection and suppression of impulsive noise in speech communication systems , 1990 .

[3]  Robert C. Maher,et al.  A Method for Extrapolation of Missing Digital Audio Data , 1994 .

[4]  Jyrki Kauppinen,et al.  Reconstruction Method for Missing or Damaged Long Portions in Audio Signal , 2002 .

[5]  Amir Averbuch,et al.  Interacting Multiple Model Methods in Target Tracking: A Survey , 1988 .

[6]  M. Gabrea,et al.  Robust adaptive kalman filter for speech signal recovery in colored noise , 2005 .

[7]  Raymond N. J. Veldhuis,et al.  Adaptive interpolation of discrete-time signals that can be modeled as autoregressive processes , 1986, IEEE Trans. Acoust. Speech Signal Process..

[8]  Werner Verhelst,et al.  An overlap-add technique based on waveform similarity (WSOLA) for high quality time-scale modification of speech , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[9]  Bernd Edler,et al.  Parametric audio coding , 2000, WCC 2000 - ICCT 2000. 2000 International Conference on Communication Technology Proceedings (Cat. No.00EX420).

[10]  C. L. Nikias,et al.  Algorithms for Statistical Signal Processing , 2002 .

[11]  Maciej Niedzwiecki,et al.  Smart copying-a new approach to reconstruction of audio signals , 2001, IEEE Trans. Signal Process..

[12]  Thomas F. Quatieri,et al.  Speech analysis/Synthesis based on a sinusoidal representation , 1986, IEEE Trans. Acoust. Speech Signal Process..

[13]  Jae Lim,et al.  Signal estimation from modified short-time Fourier transform , 1984 .

[14]  Gerhard Doblinger,et al.  An adaptive Kalman filter for the enhancement of noisy AR signals , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[15]  R. Coelho,et al.  An Adaptive Algorithm for Real-Time Multi-Tone Estimation and Frequency Tracking of Non-Stationary Signals , 2011, IEEE Transactions on Nuclear Science.

[16]  C. Doncarli,et al.  Stationarity index for abrupt changes detection in the time-frequency plane , 1996, IEEE Signal Processing Letters.

[17]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[18]  David J. Goodman,et al.  The effect of waveform substitution on the quality of PCM packet communications , 1988, IEEE Trans. Acoust. Speech Signal Process..

[19]  Ehud Weinstein,et al.  Iterative and sequential Kalman filter-based speech enhancement algorithms , 1998, IEEE Trans. Speech Audio Process..

[20]  Richard A. Davis,et al.  Time Series: Theory and Methods , 2013 .

[21]  Saeed Vaseghi,et al.  Multimedia Signal Processing: Theory and Applications in Speech, Music and Communications , 2007 .

[22]  Ismo Kauppinen,et al.  AN ADAPTIVE TECHNIQUE FOR MODELING AUDIO SIGNALS , 2001 .

[23]  W. Etter,et al.  Restoration of a discrete-time signal segment by interpolation based on the left-sided and right-sided autoregressive parameters , 1996, IEEE Trans. Signal Process..

[24]  Mohamed Najim,et al.  Two-Kalman filters approach for unbiased AR parameter estimation from noisy observations, application to speech enhancement , 2004, 2004 12th European Signal Processing Conference.

[25]  V. Hardman,et al.  A survey of packet loss recovery techniques for streaming audio , 1998, IEEE Network.

[26]  Ismo Kauppinen,et al.  Audio Signal Extrapolation - Theory And Applications , 2002 .

[27]  Michael Elad,et al.  Audio Inpainting , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[28]  Wai-Choong Wong,et al.  Waveform substitution techniques for recovering missing speech segments in packet voice communications , 1986, ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[29]  Maciej Niedzwiecki,et al.  Smart copying-a new approach to reconstruction of audio signals , 1999, ISCAS'99. Proceedings of the 1999 IEEE International Symposium on Circuits and Systems VLSI (Cat. No.99CH36349).