Learning and discrimination of audiovisual events in human infants: the hierarchical relation between intersensory temporal synchrony and rhythmic pattern cues.

This study examined 4- to 10-month-old infants' perception of audio-visual (A-V) temporal synchrony cues in the presence or absence of rhythmic pattern cues. Experiment 1 established that infants of all ages could successfully discriminate between two different audiovisual rhythmic events. Experiment 2 showed that only 10-month-old infants detected a desynchronization of the auditory and visual components of a rhythmical event. Experiment 3 showed that 4- to 8-month-old infants could detect A-V desynchronization but only when the audiovisual event was nonrhythmic. These results show that initially in development infants attend to the overall temporal structure of rhythmic audiovisual events but that later in development they become capable of perceiving the embedded intersensory temporal synchrony relations as well.

[1]  D. Lewkowicz.  Perception of auditory-visual temporal synchrony in human infants. , 1996, Journal of experimental psychology. Human perception and performance.

[2]  J. R. Pomerantz,et al.  The Perception of Structure: Essays in Honor of Wendell R. Garner , 1991 .

[3]  J G Martin,et al.  Rhythmic (hierarchical) versus serial structure in speech and other behavior. , 1972, Psychological review.

[4]  M. Hallett,et al.  Neural Correlates of Auditory–Visual Stimulus Onset Asynchrony Detection , 2001, The Journal of Neuroscience.

[5]  L. Bahrick,et al.  Intermodal learning in infancy: learning on the basis of two kinds of invariant relations in audible and visible events. , 1988, Child development.

[6]  D. Lewkowicz,et al.  The development of intersensory temporal perception: an epigenetic systems/limitations view. , 2000, Psychological bulletin.

[7]  Q. Summerfield,et al.  Intermodal timing relations and audio-visual speech recognition by normal-hearing adults. , 1985, The Journal of the Acoustical Society of America.

[8]  M. Radeau.  Auditory-visual spatial interaction and modularity , 1994, Current psychology of cognition = Cahiers de psychologie cognitive : CPC.

[9]  C. Krumhansl.  Rhythm and pitch in music cognition. , 2000, Psychological bulletin.

[10]  Elizabeth K. Johnson,et al.  Word Segmentation by 8-Month-Olds: When Speech Cues Count More Than Statistics , 2001 .

[11]  E. Spelke.  Perceiving Bimodally Specified Events in Infancy , 1979 .

[12]  K. Lashley.  The problem of serial order in behavior , 1951 .

[13]  Sandra E. Trehub,et al.  Duration Illusion and Auditory Grouping in Infancy , 1989 .

[14]  N. B. Spetner,et al.  Infant auditory temporal acuity: gap detection. , 1992, Child development.

[15]  James R. Pomerantz,et al.  Perception of structure: An overview. , 1991 .

[16]  D. Lewkowicz.  Heterogeneity and heterochrony in the development of intersensory perception. , 2002, Brain research. Cognitive brain research.

[17]  B A Schneider,et al.  Gap detection in infants, children, and adults. , 1995, The Journal of the Acoustical Society of America.

[18]  David J. Lewkowicz,et al.  Developmental changes in infants' bisensory response to synchronous durations☆ , 1986 .

[19]  Jeffrey M. Zacks,et al.  Event structure in perception and conception. , 2001, Psychological bulletin.

[20]  Jodie A. Baird,et al.  Discerning intentions in dynamic human action , 2001, Trends in Cognitive Sciences.

[21]  David J. Lewkowicz,et al.  Infants' response to temporally based intersensory equivalence: The effect of synchronous sounds on visual preferences for moving stimuli , 1992 .

[22]  L. Demany,et al.  Rhythm perception in early infancy , 1977, Nature.

[23]  Sandra E. Trehub,et al.  Perceptual grouping by infants and preschool children. , 1988 .

[24]  W. Friedman.  The Developmental psychology of time , 1982 .

[25]  Dan Zakay,et al.  Time and human cognition : a life-span perspective , 1989 .

[26]  C. Rowe.  Receiver psychology and the evolution of multicomponent signals , 1999, Animal Behaviour.

[27]  D. Lewkowicz.  Limitations on Infants' Response to Rate-Based Auditory-Visual Relations. , 1994 .

[28]  G. Plant.  Perceiving Talking Faces: From Speech Perception to a Behavioral Principle , 1999 .

[29]  D. Lewkowicz.  Chapter 1 The Role of Temporal Factors in Infant Behavior and Development , 1989 .

[30]  Albert S. Bregman,et al.  The Auditory Scene. (Book Reviews: Auditory Scene Analysis. The Perceptual Organization of Sound.) , 1990 .

[31]  M. Goldsmith,et al.  Statistical Learning by 8-Month-Old Infants , 1996 .

[32]  D. Lewkowicz.  Infants' perception of the audible, visible, and bimodal attributes of multimodal syllables. , 2000, Child development.

[33]  Lorraine E. Bahrick,et al.  Do infants perceive invariant tempo and rhythm in auditory-visual events? , 1997 .

[34]  R. Lynn,et al.  A secular decline in the strength of Spearman’s g in Japan , 1994 .

[35]  N. F. Dixon,et al.  The Detection of Auditory Visual Desynchrony , 1980, Perception.

[36]  B. Morrongiello,et al.  Auditory Temporal Pattern Perception in 6- and 12-Month-Old Infants. , 1984 .

[37]  Barbara Dodd,et al.  Lip reading in infants: Attention to speech presented in- and out-of-synchrony , 1979, Cognitive Psychology.

[38]  L. A. Jeffress.  Cerebral mechanisms in behavior : the Hixon symposium , 1951 .

[39]  Sandra E. Trehub,et al.  Auditory Processing of Relational Information by Young Infants , 1977 .

[40]  P. Marler,et al.  Communication Goes Multimodal , 1999, Science.

[41]  L. Bahrick,et al.  Infants' discrimination of bimodal events on the basis of rhythm and tempo , 1995 .

[42]  P. Fraisse.  6 – Rhythm and Tempo , 1982 .

[43]  D. Lewkowicz.  Infants’ responsiveness to the auditory and visual attributes of a sounding/moving stimulus , 1992, Perception & psychophysics.