A portable digital speech-rate converter for hearing impairment.

A real-time hand-sized portable device that slows speech speed without changing the pitch is proposed for hearing impairment. By using this device, people can listen to fast speech at a comfortable speed. A combination of solid-state memory recording and real-time digital signal processing with a single chip processor enables this unique function. A simplified pitchsynchronous, time-scale-modification algorithm is proposed to minimize the complexity of the DSP operation. Unlike the traditional algorithm, this dynamic-processing algorithm reduces distortion even when the expansion rate is only just above 1. Seven out of 10 elderly hearing-impaired listeners showed improvement in a sentence recognition test when using speech-rate conversion with the largest expansion rate, although no improvement was observed in a word recognition test. Some subjects who showed large improvement had limited auditory temporal resolution, but the correlation was not significant. The results suggest that, unlike conventional hearing aids, this device can be used to overcome the deterioration of auditory ability by improving the transfer of information from short-term (echoic) memory into a more stable memory trace in the human auditory system.

[1]  Michael T. Turvey,et al.  An auditory analogue of the sperling partial report procedure: Evidence for brief auditory storage , 1972 .

[2]  S. Blumstein,et al.  The effects of slowed speech on auditory comprehension in aphasia , 1985, Brain and Language.

[3]  David Malah,et al.  Time-domain algorithms for harmonic bandwidth reduction and time scaling of speech signals , 1979 .

[4]  Yoshito Nejime,et al.  A portable digital speech-rate converter for elderly hearing-impaired listeners , 1994, Proceedings of 16th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[5]  M. Misaki,et al.  Time-scale modification of speech signals using cross-correlation functions , 1992 .

[6]  M. Picheny,et al.  Speaking clearly for the hard of hearing. II: Acoustic characteristics of clear and conversational speech. , 1986, Journal of speech and hearing research.

[7]  N I Durlach,et al.  Speaking clearly for the hard of hearing. III: An attempt to determine the contribution of speaking rate to differences in intelligibility between clear and conversational speech. , 1989, Journal of speech and hearing research.

[8]  N I Durlach,et al.  Speaking clearly for the hard of hearing I: Intelligibility differences between clear and conversational speech. , 1985, Journal of speech and hearing research.

[9]  A. Wilgus,et al.  High quality time-scale modification for speech , 1985, ICASSP '85. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[10]  Jae Lim,et al.  Signal estimation from modified short-time Fourier transform , 1984 .

[11]  B. Moore,et al.  Psychoacoustic abilities of subjects with unilateral and bilateral cochlear hearing impairments and their relationship to the ability to understand speech. , 1989, Scandinavian audiology. Supplementum.

[12]  A.M. Engebretson Benefits of digital hearing aids , 1994, IEEE Engineering in Medicine and Biology Magazine.

[13]  Akira Nakamura,et al.  Real time speech rate converting system for elderly people , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[14]  S. Gordon-Salant,et al.  Temporal factors and speech recognition performance in young and elderly listeners. , 1993, Journal of speech and hearing research.

[15]  Yoshito Nejime,et al.  A portable digital speech rate converter and its evaluation by hearing-impaired listeners , 1994, ICSLP.