A Multidimensional Approach to the Study of Emotion Recognition in Autism Spectrum Disorders

Although deficits in emotion recognition have been widely reported in autism spectrum disorder (ASD), experiments have been restricted to either facial or vocal expressions. Here, we explored multimodal emotion processing in children with ASD (N = 19) and with typical development (TD, N = 19), considering uni (faces and voices) and multimodal (faces/voices simultaneously) stimuli and developmental comorbidities (neuro-visual, language and motor impairments). Compared to TD controls, children with ASD had rather high and heterogeneous emotion recognition scores but showed also several significant differences: lower emotion recognition scores for visual stimuli, for neutral emotion, and a greater number of saccades during visual task. Multivariate analyses showed that: (1) the difficulties they experienced with visual stimuli were partially alleviated with multimodal stimuli. (2) Developmental age was significantly associated with emotion recognition in TD children, whereas it was the case only for the multimodal task in children with ASD. (3) Language impairments tended to be associated with emotion recognition scores of ASD children in the auditory modality. Conversely, in the visual or bimodal (visuo-auditory) tasks, the impact of developmental coordination disorder or neuro-visual impairments was not found. We conclude that impaired emotion processing constitutes a dimension to explore in the field of ASD, as research has the potential to define more homogeneous subgroups and tailored interventions. However, it is clear that developmental age, the nature of the stimuli, and other developmental comorbidities must also be taken into account when studying this dimension.

[1]  Beatrice de Gelder,et al.  Audiovisual speech integration in pervasive developmental disorder: evidence from event-related potentials. , 2008, Journal of child psychology and psychiatry, and allied disciplines.

[2]  N. Minshew,et al.  A fine-grained analysis of facial expression processing in high-functioning adults with autism , 2007, Neuropsychologia.

[3]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[4]  D H Whalen,et al.  Audiovisual Processing in Children with and without Autism Spectrum Disorders , 2008, Journal of autism and developmental disorders.

[5]  Claes von Hofsten,et al.  Young children with Autism Spectrum Disorder look differently at positive versus negative emotional faces , 2008 .

[6]  Gerd Lehmkuhl,et al.  Do hyperactivity, impulsivity and inattention have an impact on the ability of facial affect recognition in children with autism and ADHD? , 2008, European Child & Adolescent Psychiatry.

[7]  M. Lassonde,et al.  Multilevel alterations in the processing of audio–visual emotion expressions in autism spectrum disorders , 2013, Neuropsychologia.

[8]  J. Vroomen,et al.  The perception of emotions by ear and by eye , 2000 .

[9]  Mohamed Chetouani,et al.  Exploring Multimodal Social-Emotional Behaviors in Autism Spectrum Disorders: An Interface between Social Signal Processing and Psychopathology , 2012, 2012 International Conference on Privacy, Security, Risk and Trust and 2012 International Confernece on Social Computing.

[10]  U. Frith,et al.  The Weak Coherence Account: Detail-focused Cognitive Style in Autism Spectrum Disorders , 2006, Journal of autism and developmental disorders.

[11]  S. Abel Discrimination of Temporal Gaps , 1971 .

[12]  B. Jemel,et al.  Parameters of semantic multisensory integration depend on timing and modality order among people on the autism spectrum: Evidence from event-related potentials , 2012, Neuropsychologia.

[13]  R. Blank,et al.  Understanding performance deficits in developmental coordination disorder: a meta‐analysis of recent research , 2013, Developmental medicine and child neurology.

[14]  Michael Erb,et al.  Audiovisual integration of emotional signals in voice and face: An event-related fMRI study , 2007, NeuroImage.

[15]  Alex Martin,et al.  Facial Emotion Recognition in Autism Spectrum Disorders: A Review of Behavioral and Neuroimaging Studies , 2010, Neuropsychology Review.

[16]  Lionel Prevost,et al.  Facial Action Recognition Combining Heterogeneous Features via Multikernel Learning , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  M. Prior,et al.  Autistic children's knowledge of thinking and feeling states in other people. , 1990, Journal of child psychology and psychiatry, and allied disciplines.

[18]  M. Lassonde,et al.  Reduced multisensory facilitation in persons with autism , 2013, Cortex.

[19]  F. Volkmar,et al.  Verbal bias in recognition of facial emotions in children with Asperger syndrome. , 2000, Journal of child psychology and psychiatry, and allied disciplines.

[20]  Tony Charman,et al.  Audiovisual speech integration in autism spectrum disorders: ERP evidence for atypicalities in lexical‐semantic processing , 2012, Autism research : official journal of the International Society for Autism Research.

[21]  Nicu Sebe,et al.  MULTIMODAL EMOTION RECOGNITION , 2005 .

[22]  F. Gosselin,et al.  The Montreal Affective Voices: A validated set of nonverbal affect bursts for research on auditory affective processing , 2008, Behavior research methods.

[23]  B. Rogé,et al.  Recognition of emotional and nonemotional facial expressions: a comparison between Williams syndrome and autism. , 2009, Research in developmental disabilities.

[24]  Tristram H. Smith,et al.  Emotional Understanding, Cooperation, and Social Behavior in High-Functioning Children with Autism , 2004, Journal of autism and developmental disorders.

[25]  Haizhou Li,et al.  Facial emotion recognition , 2017, 2017 IEEE 2nd International Conference on Signal and Image Processing (ICSIP).

[26]  Giacomo Vivanti,et al.  Are emotion impairments unique to, universal, or specific in autism spectrum disorder? A comprehensive review , 2013, Cognition & emotion.

[27]  A. Young,et al.  Deficits in facial, body movement and vocal emotional processing in autism spectrum disorders , 2010, Psychological Medicine.

[28]  J. Weiss,et al.  Discrimination of temporal synchrony in intermodal events by children with autism and children with developmental disabilities without autism. , 2006, Journal of child psychology and psychiatry, and allied disciplines.

[29]  Matthew J. Crossley,et al.  Context-dependent savings in procedural category learning , 2014, Brain and Cognition.

[30]  Monique Plaza,et al.  Reliability and diagnostic efficiency of the Diagnostic Inventory for Disharmony (DID) in youths with Pervasive Developmental Disorder and Multiple Complex Developmental Disorder , 2011 .

[31]  L. Capelle,et al.  Atypical crossmodal emotional integration in patients with gliomas , 2014, Brain and Cognition.

[32]  A. Diederich,et al.  The race model inequality: interpreting a geometric measure of the amount of violation. , 2006, Psychological review.

[33]  C. Dissanayake,et al.  Reactivity to fearful expressions of familiar and unfamiliar people in children with autism: an eye-tracking pupillometry study , 2014, Journal of Neurodevelopmental Disorders.

[34]  Natalie C. Ebner,et al.  FACES—A database of facial expressions in young, middle-aged, and older women and men: Development and validation , 2010, Behavior research methods.

[35]  Michael J. Coleman,et al.  An investigation of basic facial expression recognition in autism spectrum disorders , 2008 .

[36]  F. Volkmar,et al.  Developmental Psychopathology of Multiplex Developmental Disorder , 1994 .

[37]  B. Rogé,et al.  Visual social attention in autism spectrum disorder: Insights from eye tracking studies , 2014, Neuroscience & Biobehavioral Reviews.

[38]  Jean Xavier,et al.  Autism spectrum disorders: An historical synthesis and a multidimensional assessment toward a tailored therapeutic program , 2015 .

[39]  G. Baird,et al.  A multimodal approach to emotion recognition ability in autism spectrum disorders. , 2011, Journal of child psychology and psychiatry, and allied disciplines.

[40]  B. Pennington,et al.  Are there emotion perception deficits in young autistic children? , 1990, Journal of child psychology and psychiatry, and allied disciplines.

[41]  A. Couteur,et al.  Autism Diagnostic Interview-Revised: A revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders , 1994, Journal of autism and developmental disorders.

[42]  Colin Grubb Multimodal Emotion Recognition , 2013 .

[43]  Paul Williamson,et al.  Can Gaze Avoidance Explain Why Individuals with Asperger’s Syndrome Can’t Recognise Emotions From Facial Expressions? , 2012, Journal of autism and developmental disorders.

[44]  F. Castelli,et al.  Understanding emotions from standardized facial expressions in autism and normal development , 2005, Autism : the international journal of research and practice.

[45]  Cong Feng,et al.  Do Individuals with and without Autism Spectrum Disorder Scan Faces Differently? A New Multi‐Method Look at an Existing Controversy , 2014, Autism research : official journal of the International Society for Autism Research.

[46]  A. Montgomery,et al.  Brief Report: Perception and Lateralization of Spoken Emotion by Youths with High-Functioning Forms of Autism , 2010, Journal of autism and developmental disorders.

[47]  D. Skuse,et al.  Avoidance of emotionally arousing stimuli predicts social–perceptual impairment in Asperger's syndrome , 2008, Neuropsychologia.

[48]  Laurence Chaby,et al.  Neutral versus emotional human stimuli processing in children with pervasive developmental disorders not otherwise specified , 2011 .

[49]  Antonia Hamilton,et al.  Recognition of Emotions in Autism: A Formal Meta-Analysis , 2013, Journal of autism and developmental disorders.

[50]  J. Buitelaar,et al.  Theory of mind and emotion-recognition functioning in autistic spectrum disorders and in psychiatric control and normal children , 1999, Development and Psychopathology.

[51]  J. Piven,et al.  Visual Scanning of Faces in Autism , 2002, Journal of autism and developmental disorders.

[52]  Mark Braverman,et al.  Affect comprehension in children with pervasive developmental disorders , 1989, Journal of autism and developmental disorders.

[53]  Livia Colle,et al.  Impaired recognition of negative basic emotions in autism: A test of the amygdala theory , 2006, Social neuroscience.

[54]  L. Kanner Autistic disturbances of affective contact. , 1968, Acta paedopsychiatrica.

[55]  R. J. van der Gaag,et al.  Diagnostic rules for children with PDD-NOS and multiple complex developmental disorder. , 1998, Journal of child psychology and psychiatry, and allied disciplines.