Infants' use of synchronized visual information to separate streams of speech.

In 4 studies, 7.5-month-olds used synchronized visual-auditory correlations to separate a target speech stream when a distractor passage was presented at equal loudness. Infants succeeded in a segmentation task (using the head-turn preference procedure with video familiarization) when a video of the talker's face was synchronized with the target passage (Experiment 1, N = 30). Infants did not succeed in this task when an unsynchronized (Experiment 2, N = 30) or static (Experiment 3, N = 30) face was presented during familiarization. Infants also succeeded when viewing a synchronized oscilloscope pattern (Experiment 4, N = 26), suggesting that their ability to use visual information is related to domain-general sensitivities to any synchronized auditory-visual correspondence.

[1]  P. C. Pandey,et al.  The Journal of the Acoustical Society of America , 1939 .

[2]  Ira J. Hirsh,et al.  The Relation between Localization and Intelligibility , 1950 .

[3]  D. Broadbent Listening to one of two synchronous messages. , 1952, Journal of experimental psychology.

[4]  E. C. Cherry Some Experiments on the Recognition of Speech, with One and with Two Ears , 1953 .

[5]  D. Broadbent The role of auditory localization in attention and memory span. , 1954, Journal of experimental psychology.

[6]  W. H. Sumby,et al.  Visual contribution to speech intelligibility in noise , 1954 .

[7]  Irwin Pollack,et al.  Stereophonic Listening and Speech Intelligibility against Voice Babble , 1958 .

[8]  H. Pick,et al.  Visual capture produced by prism spectacles , 1965 .

[9]  R. M. Warren Perceptual Restoration of Missing Speech Sounds , 1970, Science.

[10]  S Rosenbloom,et al.  Space Perception in Early Infancy: Perception within a Common Auditory-Visual Space , 1971, Science.

[11]  M. Bergman Hearing and aging. Implications of recent research findings. , 1971, Audiology : official organ of the International Society of Audiology.

[12]  W R Thurlow,et al.  Effects of degree of visual association and angle of displacement on the "ventriloquism" effect. , 1973, Perceptual and motor skills.

[13]  E. Gibson,et al.  Principles of Perceptual Learning and Development , 1973 .

[14]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[15]  M Dumitrache [Visual information]. , 1977, Revista de chirurgie, oncologie, radiologie, o. r. l., oftalmologie, stomatologie. Seria: Oftalmologie.

[16]  D. Reisberg,et al.  Looking where you listen: visual cues and auditory attention. , 1978, Acta psychologica.

[17]  S. Pinker,et al.  Auditory streaming and the building of timbre. , 1978, Canadian journal of psychology.

[18]  A S Bregman,et al.  Streaming vs. fusion of sinusoidal components of complex tones , 1978, Perception & psychophysics.

[19]  E. Spelke,et al.  Intermodal exploration and knowledge in infancy , 1979 .

[20]  A. Meltzoff,et al.  Intermodal matching by human neonates , 1979, Nature.

[21]  Barbara Dodd,et al.  Lip reading in infants: Attention to speech presented in- and out-of-synchrony , 1979, Cognitive Psychology.

[22]  E. Spelke Perceiving Bimodally Specified Events in Infancy , 1979 .

[23]  B A Schneider,et al.  Infants' detection of speech in noise. , 1981, Journal of speech and hearing research.

[24]  A. Meltzoff,et al.  The bimodal perception of speech in infancy. , 1982, Science.

[25]  A. Walker,et al.  Intermodal perception of expressive behaviors by human infants. , 1982, Journal of experimental child psychology.

[26]  M Studdert-Kennedy,et al.  Infant intermodal speech perception is a left-hemisphere function. , 1983, Science.

[27]  Richard N Aslin,et al.  A Comparison of Pure Tone Auditory Thresholds in Human Infants and Adults. , 1983, Infant behavior & development.

[28]  R J Nozza,et al.  Masked and unmasked pure-tone thresholds of infants and adults: development of auditory frequency selectivity and sensitivity. , 1984, Journal of speech and hearing research.

[29]  A. Meltzoff,et al.  The Intermodal Representation of Speech in Infants , 1984 .

[30]  S. Mateeff,et al.  Dynamic Visual Capture: Apparent Auditory Motion Induced by a Moving Visual Target , 1985, Perception.

[31]  C. Darwin,et al.  Spectral integration based on common amplitude modulation , 1985, Perception & psychophysics.

[32]  David J. Lewkowicz,et al.  Developmental changes in infants' bisensory response to synchronous durations☆ , 1986 .

[33]  L. Bahrick Infants' intermodal perception of two levels of temporal structure in natural events☆ , 1987 .

[34]  P. Kuhl,et al.  Acoustic determinants of infant preference for motherese speech , 1987 .

[35]  D. Reisberg,et al.  Easy to hear but hard to understand: A lip-reading advantage with intact auditory stimuli. , 1987 .

[36]  D. Massaro Speech Perception By Ear and Eye: A Paradigm for Psychological Inquiry , 1989 .

[37]  Daniel H. Ashmead,et al.  Precision of Auditory Localization in Human Infants. , 1987 .

[38]  D. Burnham,et al.  Processing Speechread Information. , 1988 .

[39]  L. Bahrick,et al.  Intermodal learning in infancy: learning on the basis of two kinds of invariant relations in audible and visible events. , 1988, Child development.

[40]  P K Kuhl,et al.  The role of visual information in the processing of , 1989, Perception & psychophysics.

[41]  A. Nabelek,et al.  English consonant recognition in noise and in reverberation by Japanese and American listeners. , 1990, The Journal of the Acoustical Society of America.

[42]  G. Altmann,et al.  Cognitive Models of Speech Processing: Psycholinguistic and Computational Perspectives - Workshop Overview , 1989, AI Mag..

[43]  R J Nozza,et al.  Infant speech-sound discrimination in noise. , 1990, The Journal of the Acoustical Society of America.

[44]  Anne Cutler,et al.  Exploiting prosodic probabilities in speech segmentation , 1991 .

[45]  A. Macleod,et al.  A procedure for measuring auditory and audio-visual speech-reception thresholds for sentences in noise: rationale, evaluation, and recommendations for use. , 1990, British journal of audiology.

[46]  A. Meltzoff,et al.  Integrating speech information across talkers, gender, and sensory modality: Female faces and male voices in the McGurk effect , 1991, Perception & psychophysics.

[47]  R J Nozza,et al.  Infant-adult differences in unmasked thresholds for the discrimination of consonant-vowel syllable pairs. , 1991, Audiology : official organ of the International Society of Audiology.

[48]  Mark H. Johnson,et al.  Biology and Cognitive Development: The Case of Face Recognition , 1993 .

[49]  P K Kuhl,et al.  Cross-modal speech perception in adults and infants using nonspeech auditory stimuli. , 1991, Journal of experimental psychology. Human perception and performance.

[50]  P. Kuhl,et al.  Integral processing of visual place and auditory voicing information during phonetic perception. , 1991, Journal of experimental psychology. Human perception and performance.

[51]  P. Green Biology and Cognitive Development: the Case of Face Recognition, Mark H. Johnson, John Morton. Blackwell, Oxford (1991), x, +180. Price £35.00 hardback, £10.95 paperback , 1992 .

[52]  L. Bahrick Infants' perceptual differentiation of amodal and modality-specific audio-visual relations. , 1992, Journal of experimental child psychology.

[53]  S. Arlinger,et al.  Normal-hearing and hearing-impaired subjects' ability to just follow conversation in competing speech, reversed speech, and noise backgrounds. , 1992, Journal of speech and hearing research.

[54]  P. Jusczyk,et al.  Infants' preference for the predominant stress patterns of English words. , 1993, Child development.

[55]  T. Bower,et al.  Amodal representation of speech in infants , 1993 .

[56]  Speech perception without audition , 1993 .

[57]  L. Werner,et al.  Adults Listen Selectively; Infants Do Not , 1994 .

[58]  P. Jusczyk,et al.  Infants' sensitivity to phonotactic patterns in the native language. , 1994 .

[59]  Tiffany M Field,et al.  Full-term and preterm infants' perception of face-voice synchrony , 1994 .

[60]  P. Jusczyk,et al.  Infants′ Detection of the Sound Patterns of Words in Fluent Speech , 1995, Cognitive Psychology.

[61]  J. Driver Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading , 1996, Nature.

[62]  P. Jusczyk,et al.  The cocktail party effect in infants. , 1995, Perception & psychophysics.

[63]  J. A. Johnson,et al.  Point-light facial displays enhance comprehension of speech in noise. , 1996, Journal of speech and hearing research.

[64]  Josef P. Rauschecker,et al.  The Development of Intersensory Perception: Comparative Perspectives , 1996, Journal of Cognitive Neuroscience.

[65]  L. Rosenblum,et al.  An audiovisual test of kinematic primitives for visual speech perception. , 1996, Journal of experimental psychology. Human perception and performance.

[66]  M. Goldsmith,et al.  Statistical Learning by 8-Month-Old Infants , 1996 .

[67]  Geoffrey P. Bingham,et al.  "Dynamics and the orientation of kinematic forms in visual event recognition": Correction. , 1996 .

[68]  S Buus,et al.  Age of second-language acquisition and perception of speech in noise. , 1997, Journal of speech, language, and hearing research : JSLHR.

[69]  Catharine H. Echols,et al.  The perception of rhythmic units in speech by infants and adults. , 1997 .

[70]  L. Rosenblum,et al.  The McGurk effect in infants , 1997 .

[71]  L. Bahrick,et al.  Intermodal perception of adult and child faces and voices by infants. , 1998, Child development.

[72]  Peter W. Jusczyk,et al.  Constraining the search for structure in the input , 1998 .

[73]  Mary R. Newsome,et al.  The Beginnings of Word Segmentation in English-Learning Infants , 1999, Cognitive Psychology.

[74]  J. Werker,et al.  Matching phonetic information in lips and voice is robust in 4.5-month-old infants , 1999 .

[75]  G. Plant Perceiving Talking Faces: From Speech Perception to a Behavioral Principle , 1999 .

[76]  Israel Nelken,et al.  Responses of auditory-cortex neurons to structural features of natural sounds , 1999, Nature.

[77]  D. Todt,et al.  Auditory–visual stimulus pairing enhances perceptual learning in a songbird , 1999, Animal Behaviour.

[78]  Joost Van de Weijer,et al.  Language input for word discovery , 1999 .

[79]  Dylan M. Jones,et al.  Organizational factors in selective attention: The interplay of acoustic distinctiveness and auditory streaming in the irrelevant sound effect , 1999 .

[80]  R. Lickliter,et al.  Intersensory redundancy guides attentional selectivity and perceptual learning in infancy. , 2000, Developmental psychology.

[81]  P F Seitz,et al.  The use of visible speech cues for improving auditory detection of spoken sentences. , 2000, The Journal of the Acoustical Society of America.

[82]  John S. Bradley,et al.  Revisiting Speech Interference in Classrooms:Revisando la interferencia en el habla dentro del salón de clases , 2001 .

[83]  C. Nelson The Development and Neural Bases of Face Recognition , 2001 .

[84]  J. S. Bradley,et al.  Revisiting speech interference in classrooms. , 2001, Audiology : official organ of the International Society of Audiology.

[85]  L. Bahrick,et al.  Increasing specificity in perceptual development: infants' detection of nested levels of multimodal stimulation. , 2001, Journal of experimental child psychology.

[86]  Elizabeth K. Johnson,et al.  Word Segmentation by 8-Month-Olds: When Speech Cues Count More Than Statistics , 2001 .

[87]  R. Newman Prosodic differences in mothers' speech to toddlers in quiet and noisy environments , 2003, Applied Psycholinguistics.

[88]  Chiara Turati,et al.  Why Faces Are Not Special to Newborns , 2004 .

[89]  F. Simion,et al.  Can a Nonspecific Bias Toward Top-Heavy Patterns Explain Newborns' Face Preference? , 2004, Psychological science.

[90]  M. Bance Hearing and aging , 2007, Canadian Medical Association Journal.