Effects of Speech Clarity on Recognition Memory for Spoken Sentences

Extensive research shows that inter-talker variability (i.e., changing the talker) affects recognition memory for speech signals. However, relatively little is known about the consequences of intra-talker variability (i.e. changes in speaking style within a talker) on the encoding of speech signals in memory. It is well established that speakers can modulate the characteristics of their own speech and produce a listener-oriented, intelligibility-enhancing speaking style in response to communication demands (e.g., when speaking to listeners with hearing impairment or non-native speakers of the language). Here we conducted two experiments to examine the role of speaking style variation in spoken language processing. First, we examined the extent to which clear speech provided benefits in challenging listening environments (i.e. speech-in-noise). Second, we compared recognition memory for sentences produced in conversational and clear speaking styles. In both experiments, semantically normal and anomalous sentences were included to investigate the role of higher-level linguistic information in the processing of speaking style variability. The results show that acoustic-phonetic modifications implemented in listener-oriented speech lead to improved speech recognition in challenging listening conditions and, crucially, to a substantial enhancement in recognition memory for sentences.

[1]  P. Trudgill,et al.  Phonetic and linguistic markers in speech , 1979 .

[2]  Ann R Bradlow,et al.  Production and perception of clear speech in Croatian and English. , 2004, The Journal of the Acoustical Society of America.

[3]  M. Boxtel,et al.  Mild Hearing Impairment Can Reduce Verbal Memory Performance in a Healthy Adult Population , 2000, Journal of clinical and experimental neuropsychology.

[4]  Ann R Bradlow,et al.  Temporal organization of English clear and conversational speech. , 2008, The Journal of the Acoustical Society of America.

[5]  Bruce A Schneider,et al.  Comparing the effects of aging and background noise on short-term memory performance. , 2000, Psychology and aging.

[6]  J. Laver,et al.  Voice quality and indexical information. , 1968, The British journal of disorders of communication.

[7]  E. Glisky,et al.  Double dissociation between item and source memory. , 1995 .

[8]  D. Pisoni,et al.  SPEECH PERCEPTION AS A TALKER-CONTINGENT PROCESS. , 1993, Psychological science.

[9]  Ann R Bradlow,et al.  Semantic and phonetic enhancements for speech-in-noise recognition by native and non-native listeners. , 2007, The Journal of the Acoustical Society of America.

[10]  Sheng Liu,et al.  Temporal properties in clear speech perception. , 2006, The Journal of the Acoustical Society of America.

[11]  S. Goldinger,et al.  On the nature of talker variability effects on recall of spoken word lists. , 1991, Journal of experimental psychology. Learning, memory, and cognition.

[12]  K. Scherer,et al.  Social Markers in Speech , 1980 .

[13]  Tessa Bent,et al.  The clear speech effect for non-native listeners. , 2002, The Journal of the Acoustical Society of America.

[14]  D. Broadbent,et al.  Information Conveyed by Vowels , 1957 .

[15]  L L Elliott,et al.  Development of a test of speech intelligibility in noise using sentence materials with controlled word predictability. , 1977, The Journal of the Acoustical Society of America.

[16]  D. Kewley-Port,et al.  Vowel intelligibility in clear and conversational speech for normal-hearing and hearing-impaired listeners. , 2002, The Journal of the Acoustical Society of America.

[17]  T. Landis,et al.  Dissociation of ear preference in monaural word and voice recognition , 1982, Neuropsychologia.

[18]  Ann R. Bradlow,et al.  Speaking and Hearing Clearly: Talker and Listener Factors in Speaking Style Changes , 2009, Lang. Linguistics Compass.

[19]  P. Rabbitt,et al.  Channel-Capacity, Intelligibility and Immediate Memory , 1968, The Quarterly journal of experimental psychology.

[20]  P. Rabbitt Mild hearing loss can cause apparent memory failures which increase with age and reduce with IQ. , 1990, Acta oto-laryngologica. Supplementum.

[21]  D B Pisoni,et al.  Stimulus variability and processing dependencies in speech perception , 1990, Perception & psychophysics.

[22]  Steve Stewart-Williams,et al.  Face recognition and aging: Effects of target age and memory load , 2005, Memory & cognition.

[23]  Murray Glanzer,et al.  The size of the unit in short-term storage. , 1974 .

[24]  J. Mullennix,et al.  Talker Variability in Speech Processing , 1997 .

[25]  Paul Boersma,et al.  Praat: doing phonetics by computer , 2003 .

[26]  D J Schum,et al.  Intelligibility of clear and conversational speech of young and elderly talkers. , 1996, Journal of the American Academy of Audiology.

[27]  D. Pisoni,et al.  The Handbook of Speech Perception , 2004 .

[28]  Ann R. Bradlow,et al.  Stability of temporal contrasts across speaking styles in English and Croatian , 2008, J. Phonetics.

[29]  Jean C. Krause,et al.  Investigating alternative forms of clear speech: the effects of speaking rate and speaking mode on intelligibility. , 2002, The Journal of the Acoustical Society of America.

[30]  A. Wingfield,et al.  Aging, hearing acuity, and the attentional costs of effortful listening. , 2009, Psychology and aging.

[31]  D. Pisoni,et al.  Effects of talker, rate, and amplitude variation on recognition memory for spoken words , 1999, Perception & psychophysics.

[32]  Lauren Calandruccio,et al.  New sentence recognition materials developed using a basic non-native English lexicon. , 2012, Journal of speech, language, and hearing research : JSLHR.

[33]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .

[34]  S. Goldinger Words and voices: episodic traces in spoken word identification and recognition memory. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[35]  Bharath Chandrasekaran,et al.  Neural Processing of What and Who Information in Speech , 2011, Journal of Cognitive Neuroscience.

[36]  D. Lancker,et al.  Familiar voice recognition: Patterns and parameters. Part I. Recognition of backward voices , 1985 .

[37]  E. Tulving,et al.  Concurrent effects of contextual constraint and word frequency on immediate recall and learning of verbal material. , 1962, Canadian journal of psychology.

[38]  Valerie Hazan,et al.  Acoustic-phonetic correlates of talker intelligibility for adults and children. , 2004, The Journal of the Acoustical Society of America.

[39]  J. C. Krause,et al.  Acoustic properties of naturally produced clear speech at normal speaking rates. , 1996, The Journal of the Acoustical Society of America.

[40]  Cynthia G. Clopper,et al.  Perception of Dialect Variation , 2008, The Handbook of Speech Perception.

[41]  M. Daneman,et al.  How young and old adults listen to and remember speech in noise. , 1995, The Journal of the Acoustical Society of America.

[42]  D. Abercrombie,et al.  Elements of General Phonetics , 1967 .

[43]  M. Picheny,et al.  Speaking clearly for the hard of hearing. II: Acoustic characteristics of clear and conversational speech. , 1986, Journal of speech and hearing research.

[44]  A. Surprenant,et al.  Effects of Noise on Identification and Serial Recall of Nonsense Syllables in Older and Younger Adults , 2007, Neuropsychology, development, and cognition. Section B, Aging, neuropsychology and cognition.

[45]  D. Schacter,et al.  Auditory priming: implicit and explicit memory for words and voices. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[46]  K. Zilles,et al.  The neural correlates of person familiarity. A functional magnetic resonance imaging study with clinical implications. , 2001, Brain : a journal of neurology.

[47]  A. Boothroyd,et al.  Mathematical treatment of context effects in phoneme and word recognition. , 1988, The Journal of the Acoustical Society of America.

[48]  J S Perkell,et al.  Variation in anticipatory coarticulation with changes in clarity and rate. , 2001, Journal of speech, language, and hearing research : JSLHR.

[49]  A. Stevens,et al.  Dissociating the cortical basis of memory for voices, words and tones. , 2004, Brain research. Cognitive brain research.

[50]  A. Nakamura,et al.  Neural substrates for recognition of familiar voices: a PET study , 2001, Neuropsychologia.

[51]  A. Jongman,et al.  Acoustic characteristics of clearly spoken English fricatives. , 2009, The Journal of the Acoustical Society of America.

[52]  S. Goldinger,et al.  Episodic encoding of voice attributes and recognition memory for spoken words. , 1993, Journal of experimental psychology. Learning, memory, and cognition.

[53]  Jennifer M. Fellowes,et al.  Talker identification based on phonetic information. , 1997, Journal of experimental psychology. Human perception and performance.

[54]  G. A. Miller,et al.  Some perceptual consequences of linguistic rules , 1963 .

[55]  Aimée M. Surprenant,et al.  The Effect of Noise on Memory for Spoken Syllables , 1999 .

[56]  J. Perkell,et al.  Economy of effort in different speaking conditions. I. A preliminary study of intersubject differences and modeling issues. , 2002, The Journal of the Acoustical Society of America.

[57]  N I Durlach,et al.  Speaking clearly for the hard of hearing. III: An attempt to determine the contribution of speaking rate to differences in intelligibility between clear and conversational speech. , 1989, Journal of speech and hearing research.

[58]  A. Wingfield,et al.  Hearing Loss in Older Adulthood , 2005 .

[59]  Arthur Wingfield,et al.  Hearing Loss and Perceptual Effort: Downstream Effects on Older Adults’ Memory for Speech , 2005, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[60]  J. G. Snodgrass,et al.  Pragmatics of measuring recognition memory: applications to dementia and amnesia. , 1988, Journal of experimental psychology. General.

[61]  Sheng Liu,et al.  Clear speech perception in acoustic and electric hearing. , 2004, The Journal of the Acoustical Society of America.

[62]  M. Kathleen Pichora-Fuller,et al.  Effects of aging on auditory processing of speech , 2003, International journal of audiology.

[63]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[64]  S. H. Ferguson,et al.  Talker differences in clear and conversational speech: vowel intelligibility for normal-hearing listeners. , 2004, The Journal of the Acoustical Society of America.

[65]  S. H. Ferguson,et al.  Talker differences in clear and conversational speech: vowel intelligibility for older adults with hearing loss. , 2012, Journal of speech, language, and hearing research : JSLHR.

[66]  L D Braida,et al.  Intelligibility of conversational and clear speech in noise and reverberation for listeners with normal and impaired hearing. , 1994, The Journal of the Acoustical Society of America.

[67]  S. G. Guion,et al.  Clear speech production of Korean stops: changing phonetic targets and enhancement strategies. , 2008, The Journal of the Acoustical Society of America.

[68]  J. Podd The effects of memory load and delay on facial recognition , 1990 .

[69]  H D Ellis,et al.  Similarity effects in face recognition. , 1979, The American journal of psychology.

[70]  Jody Kreiman,et al.  Hemispheric specialization for voice recognition: Evidence from dichotic listening , 1988, Brain and Language.

[71]  Nina Kraus,et al.  Speaking clearly for children with learning disabilities: sentence perception in noise. , 2003, Journal of speech, language, and hearing research : JSLHR.