Increasing the intelligibility of speech through multiple phonemic restorations

Outside of the laboratory, listening conditions are often less than ideal, and when attending to sounds from a particular source, portions are often obliterated by extraneous noises. However, listeners possess rather elegant reconstructive mechanisms. Restoration can be complete, so that missing segments are indistinguishable from those actually present and the listener is unaware that the signal is fragmented. This phenomenon, called temporal induction (TI), has been studied extensively with nonverbal signals and to a lesser extent with speech. Earlier studies have demonstrated that TI can produce illusory continuity spanning gaps of a few hundred milliseconds when portions of a signal are replaced by a louder sound capable of masking the signal were it actually present. The present study employed various types of speech signals with periodic gaps and measured the effects upon intelligibility produced by filling these gaps with noises. Enhancement of intelligibility through multiple phonemic restoration occurred when the acoustic requirements for TI were met and when sufficient contextual information was available in the remaining speech fragments. It appears that phonemic restoration is a specialized form of TI that uses linguistic skills for the reconstruction of obliterated speech.

[1]  R. M. Warren,et al.  Perceptual synthesis of deleted phonemes , 1979 .

[2]  Takayuki Sasaki,et al.  Sound Restoration and Temporal Localization of Noise in Speech and Music Sounds , 1981 .

[3]  J. M. Ackroff,et al.  Auditory Induction: Perceptual Synthesis of Absent Sounds , 1972, Science.

[4]  J Verschuure,et al.  Intelligibility of interrupted meaningful and nonsense speech with and without intervening noise , 1983, Perception & psychophysics.

[5]  T. Houtgast Masking Patterns and Lateral Inhibition , 1974 .

[6]  Arthur G. Samuel,et al.  Phonemic Restoration: Insights From a New Methodology , 1981 .

[7]  A. Samuel,et al.  The role of knowledge-based expectations in music perception: evidence from musical restoration. , 1990, Journal of experimental psychology. General.

[8]  D. Dirks,et al.  Effect of forward and backward masking on speech intelligibility. , 1970, The Journal of the Acoustical Society of America.

[9]  L. L. Elliott Backward and Forward Masking , 1971 .

[10]  B. Layton Differential effects of two nonspeech sounds on phonemic restoration , 1975 .

[11]  T. Houtgast Psychophysical evidence for lateral inhibition in hearing. , 1972, The Journal of the Acoustical Society of America.

[12]  H. Verschuure Auditory excitation patterns : the significance of the pulsation threshold method for the measurement of auditory nonlinearity , 1978 .

[13]  G. L. Powers,et al.  Intelligibility of temporally interrupted speech with and without intervening noise , 1973 .

[14]  R. M. Warren,et al.  Multiple phonemic restorations follow the rules for auditory induction , 1987, Perception & psychophysics.

[15]  R. M. Warren Perceptual Restoration of Missing Speech Sounds , 1970, Science.

[16]  A. Samuel The role of bottom-up confirmation in the phonemic restoration illusion. , 1981, Journal of experimental psychology. Human perception and performance.

[17]  C. M. Holloway,et al.  Passing the Strongly Voiced Components of Noisy Speech , 1970, Nature.

[18]  COLIN CHERRY,et al.  Speech Communication in Very Noisy Environments , 1967, Nature.

[19]  H. Fastl Pulsation patterns of sinusoids vs. critical band noise , 1975 .

[20]  J A Bashford,et al.  Effects of spectral alternation on the intelligibility of words and sentences , 1987, Perception & psychophysics.

[21]  Ira J. Hirsh,et al.  CX Problems Related to the Use of Speech in Clinical Audiometry , 1955, The Annals of otology, rhinology, and laryngology.

[22]  D. L. Weber Do off-frequency simultaneous maskers suppress the signal? , 1983, The Journal of the Acoustical Society of America.

[23]  G L Dannenbring,et al.  Perceived auditory continuity with alternately rising and falling frequency transitions. , 1976, Canadian journal of psychology.

[24]  L L Elliott,et al.  Development of a test of speech intelligibility in noise using sentence materials with controlled word predictability. , 1977, The Journal of the Acoustical Society of America.

[25]  R M Warren,et al.  Perceptual restoration of obliterated sounds. , 1984, Psychological bulletin.

[26]  G. A. Miller,et al.  The Intelligibility of Interrupted Speech , 1948 .