Lipreading sentences with vibrotactile vocoders: performance of normal-hearing and hearing-impaired subjects.

Three vibrotactile vocoders were compared in a training study involving several different speech perception tasks. Vocoders were: (1) the Central Institute for the Deaf version of the Queen's University vocoder, with 1/3-oct filter spacing and logarithmic output scaling (CIDLog) [Engebretson and O'Connell, IEEE Trans. Biomed. Eng. BME-33, 712-716 (1986)]; (2) the same vocoder with linear output scaling (CIDLin); and (3) the Gallaudet University vocoder designed with greater resolution in the second formant region, relative to the CID vocoders, and linear output scaling (GULin). Four normal-hearing subjects were assigned to either of two control groups, visual-only control and vocoder control, for which they received the CIDLog vocoder. Five normal-hearing and four hearing-impaired subjects were assigned to the linear vocoders. Results showed that the three vocoders provided equivalent information in word-initial and word-final tactile-only consonant identification. However, GULin was the only vocoder significantly effective in enhancing lipreading of isolated prerecorded sentences. Individual subject analyses showed significantly enhanced lipreading by the three normal-hearing and two hearing-impaired subjects who received the GULin vocoder. Over the entire training period of the experiment, the mean difference between aided and unaided lipreading of sentences by the GULin aided hearing-impaired subjects was approximately 6% words correct. Possible explanations for failure to confirm previous success with the CIDLog vocoder [Weisenberger et al., J. Acoust. Soc. Am. 86, 1764-1775 (1989)] are discussed.

[1]  N. Tye‐Murray,et al.  A critique of continuous discourse tracking as a test procedure. , 1988, The Journal of speech and hearing disorders.

[2]  R. H. Gault TOUCH AS A SUBSTITUTE FOR HEARING IN THE INTERPRETATION AND CONTROL OF SPEECH , 1926 .

[3]  A M Liberman,et al.  Perception of the speech code. , 1967, Psychological review.

[4]  M. Matthies,et al.  A modified speech tracking procedure as a communicative performance measure. , 1988, Journal of speech and hearing research.

[5]  L. Bernstein,et al.  Single-channel vibrotactile supplements to visual perception of intonation and stress. , 1989, The Journal of the Acoustical Society of America.

[6]  P L Brooks,et al.  Continuing evaluation of the Queen's University tactile vocoder. I: Identification of open set words. , 1986, Journal of rehabilitation research and development.

[7]  Reliability of individual differences in lipreading , 1987 .

[8]  Evaluation of a cochlear prosthesis using connected discourse tracking. , 1986, Journal of rehabilitation research and development.

[9]  P L Brooks,et al.  Evaluation of a tactile vocoder for work recognition. , 1983, The Journal of the Acoustical Society of America.

[10]  E. Owens,et al.  Visemes observed by hearing-impaired and normal-hearing adult viewers. , 1985, Journal of speech and hearing research.

[11]  B L Scott,et al.  A method for training and evaluating the reception of ongoing speech. , 1978, The Journal of the Acoustical Society of America.

[12]  I Hochberg,et al.  Effect of text complexity on connected discourse tracking rate. , 1989, Ear and hearing.

[13]  M. Pichora-Fuller,et al.  Coarticulation effects in lipreading. , 1982, Journal of speech and hearing research.

[14]  B. Walden,et al.  Effects of consonantal context on vowel lipreading. , 1981, Journal of speech and hearing research.

[15]  M E Demorest,et al.  Speechreading sentences with single-channel vibrotactile presentation of voice fundamental frequency. , 1990, The Journal of the Acoustical Society of America.

[16]  P L Brooks,et al.  Continuing evaluation of the Queen's University tactile vocoder II: Identification of open set sentences and tracking narrative. , 1986, Journal of rehabilitation research and development.

[17]  J. Pickett THEORETICAL CONSIDERATIONS IN TESTING SPEECH PERCEPTION THROUGH ELECTROAUDITORY STIMULATION a , 1983, Annals of the New York Academy of Sciences.