Audiovisual alignment in child-directed speech facilitates word learning

Adult-to-child interactions are often characterized by prosodically-exaggerated speech accompanied by visually captivating co-speech gestures. In a series of adult studies, we have shown that these gestures are linked in a sophisticated manner to the prosodic structure of adults' utterances. In the current study, we use the Preferential Looking Paradigm to demonstrate that two-year-olds can use the alignment of these gestures to speech to deduce the meaning of words. Index Terms: speech perception, audiovisual alignment, word learning

[1]  C. Mervis,et al.  Early object labels: the case for a developmental lexical principles framework , 1994, Journal of Child Language.

[2]  Jeffery A. Jones,et al.  Visual Prosody and Speech Intelligibility , 2004, Psychological science.

[3]  L. Gogate,et al.  Intersensory redundancy facilitates learning of arbitrary relations between vowel sounds and objects in seven-month-old infants. , 1998, Journal of experimental child psychology.

[4]  M. Tomasello,et al.  Variability in early communicative development. , 1994, Monographs of the Society for Research in Child Development.

[5]  R. Lickliter,et al.  Intersensory redundancy guides early perceptual and cognitive development. , 2002, Advances in child development and behavior.

[6]  A. Fernald,et al.  Intonation and communicative intent in mothers' speech to infants: is the melody the message? , 1989, Child development.

[7]  Rebecca J. Brand,et al.  Fine-Grained Analysis of Motionese: Eye Gaze, Object Exchanges, and Action Units in Infant-versus Adult-Directed Action. , 2007 .

[8]  A. Fernald,et al.  Prosody and focus in speech to infants and adults , 1991 .

[9]  L. Gogate,et al.  Intersensory Redundancy and 7-Month-Old Infants' Memory for Arbitrary Syllable-Object Relations , 2001 .

[10]  L. Trainor,et al.  Feeling the Beat: Movement Influences Infant Rhythm Perception , 2005, Science.

[11]  B E Walden,et al.  Spectral distribution of prosodic information. , 1996, Journal of speech and hearing research.

[12]  Dare A. Baldwin,et al.  Infants' contribution to the achievement of joint reference. , 1991, Child development.

[13]  E. Markman,et al.  Young children's inductions from natural kinds: the role of categories and appearances. , 1987, Child development.

[14]  A. Fernald Intonation and Communicative Intent in Mothers' Speech to Infants: Is the Melody the Message?. , 1989 .

[15]  Dare A. Baldwin,et al.  Evidence for ‘motionese’: modifications in mothers’ infant-directed action , 2002 .

[16]  E. Markman,et al.  When it is better to receive than to give: Syntactic and conceptual constraints on vocabulary growth , 1994 .

[17]  P. Jusczyk,et al.  Some Beginnings of Word Comprehension in 6-Month-Olds , 1999 .

[18]  Amanda L. Woodward,et al.  Infants' use of action knowledge to get a grasp on words , 2003 .

[19]  Rebecca J. Brand,et al.  Breaking the language barrier: an emergentist coalition model for the origins of word learning. , 2000, Monographs of the Society for Research in Child Development.

[20]  L. Gogate,et al.  Attention to Maternal Multimodal Naming by 6- to 8-Month-Old Infants and Learning of Word-Object Relations. , 2006, Infancy : the official journal of the International Society on Infant Studies.

[21]  R. Aslin,et al.  Spoken word recognition and lexical representation in very young children , 2000, Cognition.

[22]  U. Hadar,et al.  Head Movement Correlates of Juncture and Stress at Sentence Level , 1983, Language and speech.

[23]  Kathy Hirsh-Pasek,et al.  The birth of words: ten-month-olds learn words through perceptual salience. , 2006, Child development.

[24]  Irwin Pollack,et al.  Effects of High Pass and Low Pass Filtering on the Intelligibility of Speech in Noise , 1948 .

[25]  Stefanie Shattuck-Hufnagel,et al.  THE TIMING OF SPEECH-ACCOMPANYING GESTURES WITH RESPECT TO PROSODY , 2004 .

[26]  L. Gogate,et al.  A study of multimodal motherese: the role of temporal synchrony between verbal labels and gestures. , 2000, Child development.

[27]  P. Jusczyk The discovery of spoken language , 1997 .