Auditory Deficits in Audiovisual Speech Perception in Adult Asperger’s Syndrome: fMRI Study

Audiovisual (AV) integration deficits have been proposed to underlie difficulties in speech perception in Asperger’s syndrome (AS). It is not known, if the AV deficits are related to alterations in sensory processing at the level of unisensory processing or at levels of conjoint multisensory processing. Functional Magnetic-resonance images (MRI) was performed in 16 adult subjects with AS and 16 healthy controls (HC) matched for age, gender, and verbal IQ as they were exposed to disyllabic AV congruent and AV incongruent nouns. A simple semantic categorization task was used to ensure subjects’ attention to the stimuli. The left auditory cortex (BA41) showed stronger activation in HC than in subjects with AS with no interaction regarding AV congruency. This suggests that alterations in auditory processing in unimodal low-level areas underlie AV speech perception deficits in AS. Whether this is signaling a difficulty in the deployment of attention remains to be demonstrated.

[1]  M. Wallace,et al.  Brief Report: Arrested Development of Audiovisual Speech Perception in Autism Spectrum Disorders , 2013, Journal of Autism and Developmental Disorders.

[2]  Mary Baker,et al.  Visual, Auditory, and Cross Modal Sensory Processing in Adults with Autism: An EEG Power and BOLD fMRI Investigation , 2016, Front. Hum. Neurosci..

[3]  R. Campbell,et al.  Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex , 2000, Current Biology.

[4]  Audrey R. Nath,et al.  Dynamic Changes in Superior Temporal Sulcus Connectivity during Perception of Noisy Audiovisual Speech , 2011, The Journal of Neuroscience.

[5]  Zhen Yuan,et al.  McGurk Effect by Individuals with Autism Spectrum Disorder and Typically Developing Controls: A Systematic Review and Meta-analysis , 2018, Journal of Autism and Developmental Disorders.

[6]  Elizabeth Milne,et al.  A Comparison of the Development of Audiovisual Integration in Children with Autism Spectrum Disorders and Typically Developing Children , 2010, Journal of autism and developmental disorders.

[7]  Mark T. Wallace,et al.  Frontiers in Integrative Neuroscience Integrative Neuroscience , 2022 .

[8]  J. Piven,et al.  Looking you in the mouth: abnormal gaze in autism resulting from impaired top-down modulation of visual attention. , 2006, Social cognitive and affective neuroscience.

[9]  M. Sams,et al.  Audiovisual Speech Perception and Eye Gaze Behavior of Adults with Asperger Syndrome , 2012, Journal of autism and developmental disorders.

[10]  John J. Foxe,et al.  Neurophysiological Indices of Atypical Auditory Processing and Multisensory Integration are Associated with Symptom Severity in Autism , 2014, Journal of Autism and Developmental Disorders.

[11]  A. Diederich,et al.  The time window of multisensory integration: relating reaction times and judgments of temporal order. , 2015, Psychological review.

[12]  J. Piven,et al.  Visual Scanning of Faces in Autism , 2002, Journal of autism and developmental disorders.

[13]  John J. Foxe,et al.  Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments. , 2006, Cerebral cortex.

[14]  D. Heeger,et al.  Linear Systems Analysis of Functional Magnetic Resonance Imaging in Human V1 , 1996, The Journal of Neuroscience.

[15]  Claus Tempelmann,et al.  Examining the McGurk illusion using high-field 7 Tesla functional MRI , 2012, Front. Hum. Neurosci..

[16]  G. Szycik,et al.  Reduced audiovisual integration in synesthesia--evidence from bimodal speech perception. , 2014, Journal of neuropsychology.

[17]  J. Vroomen,et al.  Face recognition and lip-reading in autism , 1991 .

[18]  W. H. Sumby,et al.  Visual contribution to speech intelligibility in noise , 1954 .

[19]  U. Frith,et al.  The Weak Coherence Account: Detail-focused Cognitive Style in Autism Spectrum Disorders , 2006, Journal of autism and developmental disorders.

[20]  V. Ramachandran,et al.  Reduced multisensory integration in patients with schizophrenia on a target detection task , 2010, Neuropsychologia.

[21]  Lawrence Brancazio,et al.  Can children with autism spectrum disorders "hear" a speaking face? , 2011, Child development.

[22]  Rainer Goebel,et al.  Analysis of functional image analysis contest (FIAC) data with brainvoyager QX: From single‐subject to cortically aligned group general linear model analysis and self‐organizing group independent component analysis , 2006, Human brain mapping.

[23]  Y. Sugita,et al.  Auditory-visual speech perception examined by fMRI and PET , 2003, Neuroscience Research.

[24]  T. Münte,et al.  Audiovisual speech integration in the superior temporal region is dysfunctional in dyslexia , 2017, Neuroscience.

[25]  G. Triebig,et al.  Multiple choice vocabulary test MWT as a valid and short test to estimate premorbid intelligence , 1995, Acta neurologica Scandinavica.

[26]  G. McCarthy,et al.  Neural basis of eye gaze processing deficits in autism. , 2005, Brain : a journal of neurology.

[27]  David B. Pisoni,et al.  Discrete neural substrates underlie complementary audiovisual speech integration processes , 2011, NeuroImage.

[28]  K. Pierce,et al.  Preference for geometric patterns early in life as a risk factor for autism. , 2011, Archives of general psychiatry.

[29]  Michael S. Beauchamp,et al.  A neural basis for interindividual differences in the McGurk effect, a multisensory speech illusion , 2012, NeuroImage.

[30]  D H Whalen,et al.  Audiovisual Processing in Children with and without Autism Spectrum Disorders , 2008, Journal of autism and developmental disorders.

[31]  Mikhail A. Semenov,et al.  Climate variability and crop yields in Europe , 1999, Nature.

[32]  Kate Nation,et al.  Eye-movement patterns are associated with communicative competence in autistic spectrum disorders. , 2009, Journal of child psychology and psychiatry, and allied disciplines.

[33]  T. Kujala,et al.  Language Abilities of Children with Asperger Syndrome , 2008, Journal of autism and developmental disorders.

[34]  A. Klin,et al.  Attention to Eyes is Present But in Decline in 2–6 Month-Olds Later Diagnosed with Autism , 2013, Nature.

[35]  J. Driver Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading , 1996, Nature.

[36]  John J. Foxe,et al.  The development of multisensory integration in high-functioning autism: high-density electrical mapping and psychophysical measures reveal impairments in the processing of audiovisual inputs. , 2013, Cerebral cortex.

[37]  F. Volkmar,et al.  Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. , 2002, Archives of general psychiatry.

[38]  Morgan D. Barense,et al.  Multisensory speech perception in autism spectrum disorder: From phoneme to whole‐word perception , 2017, Autism research : official journal of the International Society for Autism Research.

[39]  E. Walker,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[40]  W. Dillo,et al.  Maladaptive connectivity of Broca’s area in schizophrenia during audiovisual speech perception: An fMRI study , 2011, Neuroscience.

[41]  Caroline E. Robertson,et al.  Sensory perception in autism , 2017, Nature Reviews Neuroscience.

[42]  Jessica H. Schroeder,et al.  The McGurk Effect in Children With Autism and Asperger Syndrome , 2014, Autism research : official journal of the International Society for Autism Research.

[43]  John J. Foxe,et al.  Impairments of multisensory integration and cross-sensory learning as pathways to dyslexia , 2014, Neuroscience & Biobehavioral Reviews.

[44]  S. Baron-Cohen,et al.  The Autism-Spectrum Quotient (AQ): Evidence from Asperger Syndrome/High-Functioning Autism, Malesand Females, Scientists and Mathematicians , 2001, Journal of autism and developmental disorders.

[45]  D. Massaro,et al.  Visual-auditory integration during speech imitation in autism. , 2004, Research in developmental disabilities.

[46]  S. Baron-Cohen,et al.  The "Reading the Mind in the Eyes" Test revised version: a study with normal adults, and adults with Asperger syndrome or high-functioning autism. , 2001, Journal of child psychology and psychiatry, and allied disciplines.

[47]  W. Stone,et al.  Multisensory Speech Perception in Children with Autism Spectrum Disorders , 2013, Journal of autism and developmental disorders.

[48]  John J. Foxe,et al.  Ripe for solution: Delayed development of multisensory processing in autism and its remediation , 2018, Neuroscience & Biobehavioral Reviews.

[49]  John J. Foxe,et al.  Impaired multisensory processing in schizophrenia: Deficits in the visual enhancement of speech comprehension under noisy environmental conditions , 2007, Schizophrenia Research.

[50]  Tony Charman,et al.  Audiovisual speech integration in autism spectrum disorders: ERP evidence for atypicalities in lexical‐semantic processing , 2012, Autism research : official journal of the International Society for Autism Research.

[51]  Kim M. Dalton,et al.  Gaze fixation and the neural circuitry of face processing in autism , 2005, Nature Neuroscience.

[52]  T. Münte,et al.  Audiovisual perception of natural speech is impaired in adult dyslexics: An ERP study , 2015, Neuroscience.

[53]  Jeremy I. Skipper,et al.  Seeing Voices : How Cortical Areas Supporting Speech Production Mediate Audiovisual Speech Perception , 2007 .

[54]  Aina Puce,et al.  Audiovisual Non-Verbal Dynamic Faces Elicit Converging fMRI and ERP Responses , 2009, Brain Topography.

[55]  J L Lancaster,et al.  Automated Talairach Atlas labels for functional brain mapping , 2000, Human brain mapping.

[56]  Thomas E. Nichols,et al.  Thresholding of Statistical Maps in Functional Neuroimaging Using the False Discovery Rate , 2002, NeuroImage.

[57]  T. Kujala,et al.  Speech-feature discrimination in children with Asperger syndrome as determined with the multi-feature mismatch negativity paradigm , 2010, Clinical Neurophysiology.

[58]  Brigitte Röder,et al.  Multisensory processing in the redundant-target effect: A behavioral and event-related potential study , 2005, Perception & psychophysics.

[59]  Hinderk M. Emrich,et al.  Reduced audio–visual integration in synaesthetes indicated by the double-flash illusion , 2012, Brain Research.

[60]  S. Nagarajan,et al.  Sensory Processing in Autism: A Review of Neurophysiologic Findings , 2011, Pediatric Research.

[61]  John J. Foxe,et al.  Severe multisensory speech integration deficits in high-functioning school-aged children with Autism Spectrum Disorder (ASD) and their resolution during early adolescence. , 2015, Cerebral cortex.

[62]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[63]  Uta Noppeney,et al.  Physical and Perceptual Factors Shape the Neural Mechanisms That Integrate Audiovisual Signals in Speech Comprehension , 2011, The Journal of Neuroscience.

[64]  J. Schwartz,et al.  Seeing to hear better: evidence for early audio-visual interactions in speech identification , 2004, Cognition.

[65]  T. Kujala,et al.  Auditory stream segregation in children with Asperger syndrome , 2009, Biological Psychology.

[66]  Frédéric E Theunissen,et al.  The Hierarchical Cortical Organization of Human Speech Processing , 2017, The Journal of Neuroscience.

[67]  Gregory McCarthy,et al.  Polysensory interactions along lateral temporal regions evoked by audiovisual speech. , 2003, Cerebral cortex.

[68]  M. Wallace,et al.  Visual Localization Ability Influences Cross-Modal Bias , 2003, Journal of Cognitive Neuroscience.

[69]  P. Bolton,et al.  Speech-in-noise perception in high-functioning individuals with autism or Asperger's syndrome. , 2004, Journal of child psychology and psychiatry, and allied disciplines.

[70]  M. Wallace,et al.  Audiovisual multisensory integration in individuals with autism spectrum disorder: A systematic review and meta-analysis , 2018, Neuroscience & Biobehavioral Reviews.

[71]  J. Vroomen,et al.  Audio-visual integration in schizophrenia , 2003, Schizophrenia Research.

[72]  D. Dietrich,et al.  Audiovisual integration of speech is disturbed in schizophrenia: An fMRI study , 2009, Schizophrenia Research.

[73]  M. Wallace,et al.  Brief Report: Differences in Multisensory Integration Covary with Sensory Responsiveness in Children with and without Autism Spectrum Disorder , 2018, Journal of autism and developmental disorders.

[74]  Thomas F Münte,et al.  Audiovisual integration during speech comprehension: An fMRI study comparing ROI‐based and whole brain analyses , 2009, Human brain mapping.

[75]  J. Weiss,et al.  Discrimination of temporal synchrony in intermodal events by children with autism and children with developmental disabilities without autism. , 2006, Journal of child psychology and psychiatry, and allied disciplines.

[76]  G. Szycik,et al.  Audio-visual speech perception in adult readers with dyslexia: an fMRI study , 2018, Brain Imaging and Behavior.