A critical evaluation of visually moderated phonetic context effects

Fowler, Brown, and Mann (2000) have reported a visually moderated phonetic context effect in which a video disambiguates an acoustically ambiguous precursor syllable, which, in turn, influences perception of a subsequent syllable. In the present experiments, we explored this finding and the claims that stem from it. Experiment 1 failed to replicate Fowler et al. with novel materials modeled after the original study, but Experiment 2 successfully replicated the effect, using Fowler et al.’s stimulus materials. This discrepancy was investigated in Experiments 3 and 4, which demonstrate that variation in visual information concurrent with the test syllable is sufficient to account for the original results. Fowler et al.’s visually moderated phonetic context effect appears to have been a demonstration of audiovisual interaction between concurrent stimuli, and not an effect whereby preceding visual information elicits changes in the perception of subsequent speech sounds.

[1]  V. Mann,et al.  Influence of preceding fricative on stop consonant perception. , 1981, The Journal of the Acoustical Society of America.

[2]  P. Gribble,et al.  Temporal constraints on the McGurk effect , 1996, Perception & psychophysics.

[3]  James L. McClelland,et al.  The TRACE model of speech perception , 1986, Cognitive Psychology.

[4]  P. Denes On the Motor Theory of Speech Perception , 1965 .

[5]  V. Mann,et al.  Contrast effects do not underlie effects of preceding liquids on stop-consonant identification by humans. , 2000, Journal of experimental psychology. Human perception and performance.

[6]  G. Plant Perceiving Talking Faces: From Speech Perception to a Behavioral Principle , 1999 .

[7]  E. Wagenmakers,et al.  A Model-Averaging Approach to Replication : The Case of p rep , 2009 .

[8]  James S. Magnuson,et al.  Lexical effects on compensation for coarticulation: the ghost of Christmash past , 2003, Cogn. Sci..

[9]  C. Fowler An event approach to the study of speech perception from a direct realist perspective , 1986 .

[10]  James L. McClelland,et al.  Cognitive penetration of the mechanisms of perception: Compensation for coarticulation of lexically restored phonemes , 1988 .

[11]  A. Liberman,et al.  The motor theory of speech perception revised , 1985, Cognition.

[12]  Dennis H. Klatt,et al.  Software for a cascade/parallel formant synthesizer , 1980 .

[13]  J. Vroomen,et al.  Hearing Voices and Seeing Lips. Investigations in the Psychology of Lipreading , 1992 .

[14]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[15]  V. Mann Influence of preceding liquid on stop-consonant perception. , 1980, Perception & psychophysics.

[16]  M. Pitt,et al.  Is Compensation for Coarticulation Mediated by the Lexicon , 1998 .

[17]  Monique Radeau,et al.  Les illusions McGurk dans la parole: 25 ans de recherches , 2003 .

[18]  M. Pitt,et al.  Lexical activation (and other factors) can mediate compensation for coarticulation , 2003 .

[19]  Edward E. Smith,et al.  An Invitation to cognitive science , 1997 .

[20]  A. Lotto,et al.  General contrast effects in speech perception: Effect of preceding liquid on stop consonant identification , 1998, Perception & psychophysics.

[21]  D. Massaro Speech Perception By Ear and Eye: A Paradigm for Psychological Inquiry , 1989 .

[22]  J. Vroomen,et al.  Lipreading and the compensation for coarticulation mechanism , 2001 .

[23]  K P Green,et al.  Perception of /r/ and /l/ in a stop cluster: evidence of cross-modal context effects. , 2001, Journal of experimental psychology. Human perception and performance.

[24]  R. Diehl,et al.  Speech Perception , 2004, Annual review of psychology.