New signal decomposition method based speech enhancement

The auditory system, like the visual system, may be sensitive to abrupt stimulus changes, and the transient component in speech may be particularly critical to speech perception. If this component can be identified and selectively amplified, improved speech perception in background noise may be possible. This paper describes an algorithm to decompose speech into tonal, transient, and residual components. The modified discrete cosine transform (MDCT) was used to capture the tonal component and the wavelet transform was used to capture transient features. A hidden Markov chain (HMC) model and a hidden Markov tree (HMT) model were applied to capture statistical dependencies between the MDCT coefficients and between the wavelet coefficients, respectively. The transient component identified by the wavelet transform was selectively amplified and recombined with the original speech to generate modified speech, with energy adjusted to equal the energy of the original speech. The intelligibility of the original and modified speech was evaluated in eleven human subjects using the modified rhyme protocol. Word recognition rate results show that the modified speech can improve speech intelligibility at low SNR levels (8% at -15dB, 14% at -20dB, and 18% at -25dB) and has minimal effect on intelligibility at higher SNR levels.

[1]  Graham W. Horgan,et al.  Using wavelets for data smoothing: A simulation study , 1999 .

[2]  H. Chipman,et al.  Adaptive Bayesian Wavelet Shrinkage , 1997 .

[3]  Bruno Torrésani,et al.  TOWARDS A HYBRID AUDIO CODER , 2004 .

[4]  Maxim J. Goldberg,et al.  Removing noise from music using local trigonometric bases and wavelet packets , 1994 .

[5]  G. Fairbanks Test of Phonemic Differentiation: The Rhyme Test , 1958 .

[6]  I. Johnstone,et al.  Adapting to Unknown Smoothness via Wavelet Shrinkage , 1995 .

[7]  Henrique S. Malvar Lapped transforms for efficient transform/subband coding , 1990, IEEE Trans. Acoust. Speech Signal Process..

[8]  J. C. Steinberg,et al.  Factors Governing the Intelligibility of Speech Sounds , 1945 .

[9]  Bruno Torrésani,et al.  Hybrid representations for audiophonic signal encoding , 2002, Signal Process..

[10]  R Carhart,et al.  An expanded test for speech discrimination utilizing CNC monosyllabic words. Northwestern University Auditory Test No. 6. SAM-TR-66-55. , 1966, [Technical report] SAM-TR. USAF School of Aerospace Medicine.

[11]  Robert D. Nowak,et al.  Wavelet-based statistical signal processing using hidden Markov models , 1998, IEEE Trans. Signal Process..

[12]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[13]  S. Mallat A wavelet tour of signal processing , 1998 .

[14]  Sungyub Yoo,et al.  Speech decomposition and enhancement , 2005 .

[15]  K. D. Kryter,et al.  ARTICULATION-TESTING METHODS: CONSONANTAL DIFFERENTIATION WITH A CLOSED-RESPONSE SET. , 1965, The Journal of the Acoustical Society of America.

[16]  A. Spanias,et al.  Perceptual coding of digital audio , 2000, Proceedings of the IEEE.

[17]  Mark B. Sandler,et al.  MDCT analysis of sinusoids: exact results and applications to coding artifacts reduction , 2004, IEEE Transactions on Speech and Audio Processing.

[18]  A. El-Jaroudi,et al.  Automatic speech decomposition and speech coding using MDCT-based hidden Markov chain and wavelet-based hidden Markov tree models , 2005, IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, 2005..

[19]  Nikos A. Vlassis,et al.  A Greedy EM Algorithm for Gaussian Mixture Learning , 2002, Neural Processing Letters.

[20]  G. A. Miller,et al.  An Analysis of Perceptual Confusions Among Some English Consonants , 1955 .

[21]  H Levitt,et al.  A comparison of response time and word recognition measures using a word-monitoring and closed-set identification task. , 1999, Ear and hearing.

[22]  A.V. Oppenheim,et al.  Enhancement and bandwidth compression of noisy speech , 1979, Proceedings of the IEEE.

[23]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[24]  Donald B. Rubin,et al.  Max-imum Likelihood from Incomplete Data , 1972 .

[25]  R. Niederjohn,et al.  The enhancement of speech intelligibility in high noise levels by high-pass filtering followed by rapid amplitude compression , 1976 .

[26]  John Princen,et al.  Analysis/Synthesis filter bank design based on time domain aliasing cancellation , 1986, IEEE Trans. Acoust. Speech Signal Process..

[27]  Andrew C. Simpson,et al.  The effect of cue-enhancement on the intelligibility of nonsense word and sentence materials presented in noise , 1998, Speech Commun..

[28]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[29]  Amro El-Jaroudi,et al.  Speech Enhancement Using Transient Speech Components , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[30]  P. Gonçalves,et al.  Statistical Inference for Hidden Markov Tree Models and Application to Wavelet Trees , 2022 .