The 34th Sir Frederick Bartlett Lecture: The abstract representations in speech processing

Speech processing by human listeners derives meaning from acoustic input via intermediate steps involving abstract representations of what has been heard. Recent results from several lines of research are here brought together to shed light on the nature and role of these representations. In spoken-word recognition, representations of phonological form and of conceptual content are dissociable. This follows from the independence of patterns of priming for a word's form and its meaning. The nature of the phonological-form representations is determined not only by acoustic-phonetic input but also by other sources of information, including metalinguistic knowledge. This follows from evidence that listeners can store two forms as different without showing any evidence of being able to detect the difference in question when they listen to speech. The lexical representations are in turn separate from prelexical representations, which are also abstract in nature. This follows from evidence that perceptual learning about speaker-specific phoneme realization, induced on the basis of a few words, generalizes across the whole lexicon to inform the recognition of all words containing the same phoneme. The efficiency of human speech processing has its basis in the rapid execution of operations over abstract representations.

[1]  Anne Cutler,et al.  The Dynamic Nature of Speech Perception , 2006, Language and speech.

[2]  D. Swinney Lexical access during sentence comprehension: (Re)consideration of context effects , 1979 .

[3]  A. Cutler,et al.  Formant transitions in fricative identification: the role of native fricative inventory. , 2006, The Journal of the Acoustical Society of America.

[4]  William D. Marslen-Wilson,et al.  Integrating Form and Meaning: A Distributed Model of Speech Perception. , 1997 .

[5]  Päivi Majaranta,et al.  Eye Tracking , 2009, The Universal Access Handbook.

[6]  Paola Escudero,et al.  Novel second-language words and asymmetric lexical access , 2008, J. Phonetics.

[7]  A. Samuel,et al.  Generalization in perceptual learning for speech , 2006, Psychonomic bulletin & review.

[8]  J. McQueen,et al.  Perceptual learning in speech: Stability over time (L) , 2006 .

[9]  Anne Cutler,et al.  Continuity and gradedness in speech processing , 2003 .

[10]  Anne Cutler,et al.  Phonological Abstraction in the Mental Lexicon , 2006, Cogn. Sci..

[11]  A. Cutler,et al.  Exploring the Role of Lexical stress in Lexical Recognition , 2005, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[12]  Anne Cutler,et al.  Are there really interactive processes in speech perception? , 2006, Trends in Cognitive Sciences.

[13]  A. Samuel,et al.  Accommodating variation: Dialects, idiolects, and speech processing , 2008, Cognition.

[14]  Takashi Otake,et al.  Asymmetric mapping from phonetic to lexical representations in second-language listening , 2006, J. Phonetics.

[15]  J. Mullennix,et al.  Some effects of talker variability on spoken word recognition. , 1989, The Journal of the Acoustical Society of America.

[16]  Arthur B. Markman A Tribute to Larry Erlbaum , 2007, Cogn. Sci..

[17]  Anne Cutler,et al.  Phonological and conceptual activation in speech comprehension , 2006, Cognitive Psychology.

[18]  Meghan Sumner,et al.  Perception and representation of regular variation: The case of final /t/ , 2005 .

[19]  J. McQueen,et al.  Perceptual learning in speech: stability over time. , 2006, The Journal of the Acoustical Society of America.

[20]  Paul A Luce,et al.  Representation of lexical form. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[21]  S. Soto-Faraco,et al.  Journal of Memory and Language , 2001 .

[22]  A. Samuel,et al.  First Impressions and Last Resorts , 2008, Psychological science.

[23]  A. Samuel,et al.  Perceptual learning for speech , 2009, Attention, perception & psychophysics.

[24]  P. Bertelson,et al.  Visual Recalibration of Auditory Speech Identification , 2003, Psychological science.

[25]  James L. McClelland,et al.  The TRACE model of speech perception , 1986, Cognitive Psychology.

[26]  A. Weber,et al.  Lexical competition in non-native spoken-word recognition , 2004 .

[27]  N. Takagi Signal detection modeling of Japanese listeners' /r/-/l/ labeling behavior in one-interval identification task. , 1995, The Journal of the Acoustical Society of America.

[28]  S. Goldinger A COMPLEMENTARY-SYSTEMS APPROACH TO ABSTRACT AND EPISODIC SPEECH PERCEPTION , 2007 .

[29]  W. Levelt,et al.  Word frequency effects in speech production: Retrieval of syntactic information and of phonological form , 1994 .

[30]  A. Samuel,et al.  Perceptual adjustments to multiple speakers , 2007 .

[31]  Lori L. Holt,et al.  Are there interactive processes in speech perception? , 2006, Trends in Cognitive Sciences.

[32]  D. Norris,et al.  Shortlist B: a Bayesian model of continuous speech recognition. , 2008, Psychological review.

[33]  Anne Cutler,et al.  Prelexically-driven perceptual retuning of phoneme boundaries , 2008, INTERSPEECH.

[34]  P. Luce,et al.  Specificity of memory representations for spoken words , 1998, Memory & cognition.

[35]  A. Cutler,et al.  Constraints of Lexical Stress on Lexical Access in English: Evidence from Native and Non-native Listeners , 2002, Language and speech.

[36]  Anne Cutler,et al.  Short Article: Lexically Guided Retuning of Letter Perception , 2006, Quarterly journal of experimental psychology.

[37]  Gary S. Dell,et al.  Effects of Frequency and Vocabulary Type on Phonological Speech Errors , 1990 .

[38]  James S. Magnuson,et al.  The Dynamics of Lexical Competition During Spoken Word Recognition , 2007, Cogn. Sci..

[39]  A. Samuel,et al.  Perceptual learning for speech: Is there a return to normal? , 2005, Cognitive Psychology.

[40]  Cecile T. L. Kuijpers,et al.  Facilitatory Effects of Vowel Epenthesis on Word Processing in Dutch , 1999 .

[41]  S. Goldinger Echoes of echoes? An episodic theory of lexical access. , 1998, Psychological review.

[42]  S. Goldinger Words and voices: episodic traces in spoken word identification and recognition memory. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[43]  James M. McQueen,et al.  Prelexical adjustments to speaker idiosyncrasies: are they position-specific? , 2007, INTERSPEECH.

[44]  Gary S. Dell,et al.  The retrieval of phonological forms in production: tests of predictions from a connectionist model , 1988 .

[45]  Y. Tohkura,et al.  A perceptual interference account of acquisition difficulties for non-native phonemes , 2003, Cognition.

[46]  D. Norris,et al.  How abstract phonemic categories are necessary for coping with speaker-related variation , 2010 .

[47]  J. McQueen,et al.  The specificity of perceptual learning in speech processing , 2005, Perception & psychophysics.

[48]  Holger Mitterer,et al.  Recalibrating Color Categories Using World Knowledge , 2008, Psychological science.

[49]  J. Call,et al.  Word Learning in a Domestic Dog: Evidence for "Fast Mapping" , 2004, Science.

[50]  Michael S Vitevitch,et al.  The influence of sublexical and lexical representations on the processing of spoken words in English , 2003, Clinical linguistics & phonetics.

[51]  D Norris,et al.  Merging information in speech recognition: Feedback is never necessary , 2000, Behavioral and Brain Sciences.

[52]  D. Pisoni,et al.  SPEECH PERCEPTION AS A TALKER-CONTINGENT PROCESS. , 1993, Psychological science.

[53]  D. Norris Shortlist: a connectionist model of continuous speech recognition , 1994, Cognition.

[54]  R. Smits,et al.  Patterns of English phoneme confusions by native and non-native listeners. , 2004, The Journal of the Acoustical Society of America.

[55]  Willem J. M. Levelt,et al.  A theory of lexical access in speech production , 1999, Behavioral and Brain Sciences.

[56]  P. Luce,et al.  When Words Compete: Levels of Processing in Perception of Spoken Words , 1998 .

[57]  Klaus Zuberbühler,et al.  Language evolution: Semantic combinations in primate calls , 2006, Nature.

[58]  D. Pisoni,et al.  Some observations on representations and representational specificity in speech perception and spoken word recognition , 2005 .

[59]  Douglas L. Hintzman,et al.  "Schema Abstraction" in a Multiple-Trace Memory Model , 1986 .