Sensitivity to audio‐visual synchrony and its relation to language abilities in children with and without ASD

Autism Spectrum Disorder (ASD) is often accompanied by deficits in speech and language processing. Speech processing relies heavily on the integration of auditory and visual information, and it has been suggested that the ability to detect correspondence between auditory and visual signals helps to lay the foundation for successful language development. The goal of the present study was to examine whether young children with ASD show reduced sensitivity to temporal asynchronies in a speech processing task when compared to typically developing controls, and to examine how this sensitivity might relate to language proficiency. Using automated eye tracking methods, we found that children with ASD failed to demonstrate sensitivity to asynchronies of 0.3s, 0.6s, or 1.0s between a video of a woman speaking and the corresponding audio track. In contrast, typically developing children who were language‐matched to the ASD group, were sensitive to both 0.6s and 1.0s asynchronies. We also demonstrated that individual differences in sensitivity to audiovisual asynchronies and individual differences in orientation to relevant facial features were both correlated with scores on a standardized measure of language abilities. Results are discussed in the context of attention to visual language and audio‐visual processing as potential precursors to language impairment in ASD. Autism Res 2018, 11: 645–653. © 2018 International Society for Autism Research, Wiley Periodicals, Inc.

[1]  Morgan D. Barense,et al.  Multisensory speech perception in autism spectrum disorder: From phoneme to whole‐word perception , 2017, Autism research : official journal of the International Society for Autism Research.

[2]  E. Walker,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[3]  David M. Sobel,et al.  Attention to the mouth and gaze following in infancy predict language development. , 2015, Journal of child language.

[4]  W. H. Sumby,et al.  Visual contribution to speech intelligibility in noise , 1954 .

[5]  Katarzyna Chawarska,et al.  Speech Disturbs Face Scanning in 6-Month-Old Infants Who Develop Autism Spectrum Disorder , 2014, Biological Psychiatry.

[6]  M. Wallace,et al.  Brief Report: Arrested Development of Audiovisual Speech Perception in Autism Spectrum Disorders , 2013, Journal of Autism and Developmental Disorders.

[7]  Tony Charman,et al.  Atypical Audiovisual Speech Integration in Infants at Risk for Autism , 2012, PloS one.

[8]  A. Meltzoff,et al.  The Intermodal Representation of Speech in Infants , 1984 .

[9]  J. Werker,et al.  Two-month-old infants match phonetic information in lips and voice , 2003 .

[10]  Jon Oberlander,et al.  Corpus-based generation of head and eyebrow motion for an embodied conversational agent , 2007, Lang. Resour. Evaluation.

[11]  N. P. Erber Auditory-visual perception of speech. , 1975, The Journal of speech and hearing disorders.

[12]  C. Lord Autism diagnostic observation schedule : ADOS manual , 2003 .

[13]  C. Gillberg,et al.  Face-viewing patterns in young children with autism spectrum disorders: speaking up for the role of language comprehension. , 2014, Journal of speech, language, and hearing research : JSLHR.

[14]  S. Rogers,et al.  Gaze behavior and affect at 6 months: predicting clinical outcomes and language development in typically developing infants and infants at risk for autism. , 2009, Developmental science.

[15]  Morgan D. Barense,et al.  The cascading influence of multisensory processing on speech perception in autism , 2018, Autism : the international journal of research and practice.

[16]  G. Baranek,et al.  Temporal Synchrony Detection and Associations with Language in Young Children with ASD , 2014, Autism research and treatment.

[17]  Loisa Bennetto,et al.  Audiovisual speech integration and lipreading in autism. , 2007, Journal of child psychology and psychiatry, and allied disciplines.

[18]  J. Weiss,et al.  Discrimination of temporal synchrony in intermodal events by children with autism and children with developmental disabilities without autism. , 2006, Journal of child psychology and psychiatry, and allied disciplines.

[19]  Inge-Marie Eigsti,et al.  Language acquisition in autism spectrum disorders: A developmental review. , 2011 .

[20]  John J. Foxe,et al.  Severe multisensory speech integration deficits in high-functioning school-aged children with Autism Spectrum Disorder (ASD) and their resolution during early adolescence. , 2015, Cerebral cortex.

[21]  T. Mitchell,et al.  “Look who's talking!” Gaze Patterns for Implicit and Explicit Audio‐Visual Speech Synchrony Detection in Children With High‐Functioning Autism , 2015, Autism research : official journal of the International Society for Autism Research.

[22]  Kate Nation,et al.  Eye-movement patterns are associated with communicative competence in autistic spectrum disorders. , 2009, Journal of child psychology and psychiatry, and allied disciplines.

[23]  A. Meltzoff,et al.  The bimodal perception of speech in infancy. , 1982, Science.

[24]  J. Schwartz,et al.  Seeing to hear better: evidence for early audio-visual interactions in speech identification , 2004, Cognition.

[25]  Lawrence Brancazio,et al.  Can children with autism spectrum disorders "hear" a speaking face? , 2011, Child development.

[26]  Volker Strom,et al.  Visual prosody: facial movements accompanying speech , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[27]  Randy W. Kamphaus,et al.  Stanford-Binet Intelligence Scales , 2010, Encyclopedia of Autism Spectrum Disorders.

[28]  The Bayley Scales Bayley Scales of Infant Development Definition , 2007 .

[29]  Morgan D. Barense,et al.  Keeping time in the brain: Autism spectrum disorder and audiovisual temporal processing , 2016, Autism research : official journal of the International Society for Autism Research.

[30]  Katarzyna Chawarska,et al.  Context modulates attention to social scenes in toddlers with autism. , 2012, Journal of child psychology and psychiatry, and allied disciplines.

[31]  D H Whalen,et al.  Audiovisual Processing in Children with and without Autism Spectrum Disorders , 2008, Journal of autism and developmental disorders.

[32]  S. Thibeault,et al.  Vocal fold epithelial barrier in health and injury: a research review. , 2014, Journal of speech, language, and hearing research : JSLHR.

[33]  Robert Lickliter,et al.  The role of intersensory redundancy in early perceptual, cognitive, and social development , 2012 .