Emotion recognition in autism spectrum disorder across age groups: A cross‐sectional investigation of various visual and auditory communicative domains

Previous research on emotion processing in autism spectrum disorder (ASD) has predominantly focused on human faces and speech prosody, with little attention paid to other domains such as nonhuman faces and music. In addition, emotion processing in different domains was often examined in separate studies, making it challenging to evaluate whether emotion recognition difficulties in ASD generalize across domains and age cohorts. The present study investigated: (i) the recognition of basic emotions (angry, scared, happy, and sad) across four domains (human faces, face-like objects, speech prosody, and song) in 38 autistic and 38 neurotypical (NT) children, adolescents, and adults in a forced-choice labeling task, and (ii) the impact of pitch and visual processing profiles on this ability. Results showed similar recognition accuracy between the ASD and NT groups across age groups for all domains and emotion types, although processing speed was slower in the ASD compared to the NT group. Age-related differences were seen in both groups, which varied by emotion, domain, and performance index. Visual processing style was associated with facial emotion recognition speed and pitch perception ability with auditory emotion recognition in the NT group but not in the ASD group. These findings suggest that autistic individuals may employ different emotion processing strategies compared to NT individuals, and that emotion recognition difficulties as manifested by slower response times may result from a generalized, rather than a domain-specific underlying mechanism that governs emotion recognition processes across domains in ASD.

[1]  Chen Zhao,et al.  Emotion recognition across visual and auditory modalities in autism spectrum disorder: A systematic review and meta-analysis , 2022, Developmental Review.

[2]  J. Taubert,et al.  A visual search advantage for illusory faces in objects , 2021, Attention, Perception, & Psychophysics.

[3]  Hongwei Ding,et al.  Recognition of affective prosody in autism spectrum conditions: A systematic review and meta-analysis , 2021, Autism : the international journal of research and practice.

[4]  V. Brown An Introduction to Linear Mixed-Effects Modeling in R , 2020, Advances in Methods and Practices in Psychological Science.

[5]  Jessica Taubert,et al.  Rapid and dynamic processing of face pareidolia in the human brain , 2020, Nature Communications.

[6]  J. Ristic,et al.  Attention AND mentalizing? Reframing a debate on social orienting of attention , 2020 .

[7]  G. Akdeniz Brain activity underlying face and face pareidolia processing: an ERP study , 2020, Neurological Sciences.

[8]  G. J. Lewis,et al.  Emotion recognition ability: Evidence for a supramodal factor and its links to social cognition , 2020, Cognition.

[9]  Stefanie Schelinski,et al.  The Relation Between Vocal Pitch and Vocal Emotion Recognition Abilities in People with Autism Spectrum Disorder and Typical Development , 2018, Journal of autism and developmental disorders.

[10]  S. Bölte,et al.  The EU-Emotion Voice Database , 2018, Behavior research methods.

[11]  A. Laukkanen,et al.  Emotion Recognition From Singing Voices Using Contemporary Commercial Music and Classical Styles. , 2019, Journal of voice : official journal of the Voice Foundation.

[12]  P. Belin,et al.  Categorical emotion recognition from voice improves during childhood and adolescence , 2018, Scientific Reports.

[13]  Martijn Lappenschaar,et al.  Visual and auditory emotion recognition problems as familial cross-disorder phenomenon in ASD and ADHD , 2018, European Neuropsychopharmacology.

[14]  S. Kotz,et al.  The development of cross-cultural recognition of vocal emotion during childhood and adolescence , 2018, Scientific Reports.

[15]  G. Dingle,et al.  Children’s recognition of emotion in music and speech , 2018 .

[16]  Jennifer A. Walsh,et al.  Processing Speed is Impaired in Adults with Autism Spectrum Disorder, and Relates to Social Communication Abilities , 2018, Journal of Autism and Developmental Disorders.

[17]  S. R. Livingstone,et al.  The Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS): A dynamic, multimodal set of facial and vocal expressions in North American English , 2018, PloS one.

[18]  Per B. Brockhoff,et al.  lmerTest Package: Tests in Linear Mixed Effects Models , 2017 .

[19]  Peter F Assmann,et al.  Production and perception of emotional prosody by adults with autism spectrum disorder , 2017, Autism research : official journal of the International Society for Autism Research.

[20]  M. Munafo,et al.  Impaired Recognition of Basic Emotions from Facial Expressions in Young People with Autism Spectrum Disorder: Assessing the Importance of Expression Intensity , 2017, Journal of autism and developmental disorders.

[21]  R. Adolphs,et al.  Emotion Perception from Face, Voice, and Touch: Comparisons and Convergence , 2017, Trends in Cognitive Sciences.

[22]  L. Mottron,et al.  A Developmental Perspective of Global and Local Visual Perception in Autism Spectrum Disorder , 2019, Journal of autism and developmental disorders.

[23]  Elina Birmingham,et al.  Are emotion recognition abilities related to everyday social functioning in ASD? A meta-analysis , 2016 .

[24]  J. Tanaka,et al.  The “Eye Avoidance” Hypothesis of Autism Face Processing , 2016, Journal of autism and developmental disorders.

[25]  G. J. Lewis,et al.  Functional architecture of visual emotion recognition ability: A latent variable approach. , 2016, Journal of experimental psychology. General.

[26]  B. Rogé,et al.  Intact perception but abnormal orientation towards face-like objects in young children with ASD , 2016, Scientific Reports.

[27]  H. Swaab,et al.  Emotion recognition and alexithymia in high functioning females with autism spectrum disorder , 2016 .

[28]  U. Bellugi,et al.  Social functioning and autonomic nervous system sensitivity across vocal and musical emotion in Williams syndrome and autism spectrum disorder. , 2016, Developmental psychobiology.

[29]  A. D’Ausilio,et al.  Domain-specific and domain-general processes in social perception – A complementary approach , 2015, Consciousness and Cognition.

[30]  J. Buitelaar,et al.  Intelligence May Moderate the Cognitive Profile of Patients with ASD , 2015, PloS one.

[31]  Keith M. Shafritz,et al.  Neural systems mediating decision-making and response inhibition for social and nonsocial stimuli in autism , 2015, Progress in Neuro-Psychopharmacology and Biological Psychiatry.

[32]  Ruth Campbell,et al.  Age, gender, and puberty influence the development of facial emotion recognition , 2015, Front. Psychol..

[33]  A. Bronkhorst The cocktail-party problem revisited: early processing and selection of multi-talker speech , 2015, Attention, perception & psychophysics.

[34]  O. Golan,et al.  Prosody Recognition in Adults With High‐Functioning Autism Spectrum Disorders: From Psychoacoustics to Cognition , 2015, Autism research : official journal of the International Society for Autism Research.

[35]  F. Tsao,et al.  Emotional prosody perception and its association with pragmatic language in school-aged children with high-function autism. , 2015, Research in developmental disabilities.

[36]  M. Brosnan,et al.  Emotion Recognition in Animated Compared to Human Stimuli in Adolescents with Autism Spectrum Disorder , 2015, Journal of autism and developmental disorders.

[37]  W. Coster,et al.  Media use among adolescents with autism spectrum disorder , 2014, Autism : the international journal of research and practice.

[38]  Peter Vuust,et al.  Intact brain processing of musical emotions in autism spectrum disorder, but more cognitive load and arousal in happy vs. sad music , 2014, Front. Neurosci..

[39]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[40]  Martin Schulte-Rüther,et al.  Impairment in face processing in autism spectrum disorder: a developmental perspective , 2014, Journal of Neural Transmission.

[41]  M. Rosnay,et al.  Brief Report: Accuracy and Response Time for the Recognition of Facial Emotions in a Large Sample of Children with Autism Spectrum Disorders , 2014, Journal of autism and developmental disorders.

[42]  O. Golan,et al.  Psychoacoustic abilities as predictors of vocal emotion recognition , 2013, Attention, perception & psychophysics.

[43]  J. Buitelaar,et al.  Recognition of facial emotion and affective prosody in children with ASD (+ADHD) and their unaffected siblings , 2013, European Child & Adolescent Psychiatry.

[44]  Antonia Hamilton,et al.  Recognition of Emotions in Autism: A Formal Meta-Analysis , 2013, Journal of autism and developmental disorders.

[45]  C. Gillberg,et al.  Autism, Processing Speed, and Adaptive Functioning in Preschool Children , 2013, TheScientificWorldJournal.

[46]  J. Buitelaar,et al.  Co-segregation of Social Cognition, Executive Function and Local Processing Style in Children with ASD, their Siblings and Normal Controls , 2013, Journal of Autism and Developmental Disorders.

[47]  James P. Morris,et al.  Multimodal emotion processing in autism spectrum disorders: An event-related potential study , 2013, Developmental Cognitive Neuroscience.

[48]  J. Wood,et al.  Restricted interests and anxiety in children with autism , 2012, Autism : the international journal of research and practice.

[49]  Istvan Molnar-Szakacs,et al.  Music: a unique window into the world of autism , 2012, Annals of the New York Academy of Sciences.

[50]  Yufang Yang,et al.  The Mechanism of Speech Processing in Congenital Amusia: Evidence from Mandarin Speakers , 2012, PloS one.

[51]  R. Campbell,et al.  Attentional status of faces for people with autism spectrum disorder , 2011, Autism : the international journal of research and practice.

[52]  Sonja A. Kotz,et al.  On the Time Course of Vocal Emotion Recognition , 2011, PloS one.

[53]  C. Mohn,et al.  Perception of six basic emotions in music , 2011 .

[54]  Eve-Marie Quintin,et al.  Emotion Perception in Music in High-Functioning Adolescents With Autism Spectrum Disorders , 2011, Journal of autism and developmental disorders.

[55]  M. Pell,et al.  Is there an advantage for recognizing multi-modal emotional stimuli? , 2011 .

[56]  Jessica L. Tracy,et al.  Is Emotion Recognition Impaired in Individuals with Autism Spectrum Disorders? , 2010, Journal of autism and developmental disorders.

[57]  E. Fombonne,et al.  Perception of emotion in musical performance in adolescents with autism spectrum disorders , 2010, Autism research : official journal of the International Society for Autism Research.

[58]  T. Seppänen,et al.  Perception of basic emotions from speech prosody in adolescents with Asperger's syndrome , 2010, Logopedics, phoniatrics, vocology.

[59]  S. McAdams,et al.  Enhanced pure-tone pitch discrimination among persons with autism but not Asperger syndrome , 2010, Neuropsychologia.

[60]  Adrian Fourcin,et al.  Intonation processing in congenital amusia: discrimination, identification and imitation. , 2010, Brain : a journal of neurology.

[61]  S. Porges,et al.  Emotion Recognition in Children with Autism Spectrum Disorders: Relations to Eye Gaze and Autonomic State , 2010, Journal of autism and developmental disorders.

[62]  C. Deruelle,et al.  Do children perceive features of real and cartoon faces in the same way? Evidence from typical development and autism , 2010, Journal of clinical and experimental neuropsychology.

[63]  Claus-Christian Carbon,et al.  Recognition of Emotional Expressions is Affected by Inversion and Presentation Time , 2009, Perception.

[64]  Sonja A. Kotz,et al.  Factors in the recognition of vocally expressed emotions: A comparison of four languages , 2009, J. Phonetics.

[65]  N. Minshew,et al.  The development of emotion recognition in individuals with autism. , 2009, Child development.

[66]  J. Tanaka,et al.  The NimStim set of facial expressions: Judgments from untrained research participants , 2009, Psychiatry Research.

[67]  E. Hill,et al.  The Subjective Experience of Music in Autism Spectrum Disorder , 2009, Annals of the New York Academy of Sciences.

[68]  V. Ramachandran,et al.  Paper Slow Echo: Facial Emg Evidence for the Delay of Spontaneous, but Not Voluntary, Emotional Mimicry in Children with Autism Spectrum Disorders , 2022 .

[69]  C. Deruelle,et al.  Human Versus Non-Human Face Processing: Evidence from Williams Syndrome , 2009, Journal of autism and developmental disorders.

[70]  C. Barthélémy,et al.  Exploration of core features of a human face by healthy and autistic adults analyzed by visual scanning , 2009, Neuropsychologia.

[71]  S. Bölte,et al.  Emotion Recognition in Children and Adolescents with Autism Spectrum Disorders , 2009, Journal of autism and developmental disorders.

[72]  Piotr Winkielman,et al.  Autism and the extraction of emotion from briefly presented facial expressions: stumbling at the first step of empathy. , 2008, Emotion.

[73]  F. Gosselin,et al.  Audio-visual integration of emotion expression , 2008, Brain Research.

[74]  S. Baron-Cohen,et al.  The Autism Spectrum Quotient: Children’s Version (AQ-Child) , 2008, Journal of autism and developmental disorders.

[75]  Mikko Sams,et al.  Impaired recognition of facial emotions from low-spatial frequencies in Asperger syndrome , 2008, Neuropsychologia.

[76]  C. Deruelle,et al.  Typical Emotion Processing for Cartoon but not for Real Faces in Children with Autistic Spectrum Disorders , 2008, Journal of autism and developmental disorders.

[77]  F. Happé,et al.  Autism and pitch processing splinter skills , 2008, Autism : the international journal of research and practice.

[78]  D. Skuse,et al.  Impaired sadness recognition is linked to social interaction deficit in autism , 2007, Neuropsychologia.

[79]  Laurent Mottron,et al.  Local bias and local-to-global interference without global deficit: A robust finding in autism under various conditions of attention, exposure time, and visual angle , 2007, Cognitive neuropsychology.

[80]  C. Mazefsky,et al.  Emotion Perception in Asperger’s Syndrome and High-functioning Autism: The Importance of Diagnostic Criteria and Cue Intensity , 2007, Journal of autism and developmental disorders.

[81]  M. Tsujii,et al.  Reaction Time of Facial Affect Recognition in Asperger’s Disorder for Cartoon and Real, Static and Moving Faces , 2007, Child psychiatry and human development.

[82]  A. Slater,et al.  Assessing emotion recognition in 9–15-years olds: Preliminary analysis of abilities in reading emotion from faces, voices and eyes , 2007, Brain injury.

[83]  Livia Colle,et al.  Impaired recognition of negative basic emotions in autism: A test of the amygdala theory , 2006, Social neuroscience.

[84]  Rebecca C. Knickmeyer,et al.  The Autism-Spectrum Quotient (AQ)—Adolescent Version , 2006, Journal of autism and developmental disorders.

[85]  Paavo Alku,et al.  The discrimination of and orienting to speech and non-speech sounds in children with autism , 2005, Brain Research.

[86]  T. F. Gross Global–Local Precedence in the Perception of Facial Age and Emotional Expression by Children with Autism and Other Developmental Disabilities , 2005, Journal of autism and developmental disorders.

[87]  Klaus R. Scherer,et al.  The role of intonation in emotional expressions , 2005, Speech Commun..

[88]  Rhea Paul,et al.  Perception and Production of Prosody by Speakers with Autism Spectrum Disorders , 2005, Journal of autism and developmental disorders.

[89]  W. Sato,et al.  BRIEF REPORT The dynamic aspects of emotional facial expressions , 2004 .

[90]  I. Peretz,et al.  Enhanced Pitch Sensitivity in Individuals with Autism: A Signal Detection Analysis , 2003, Journal of Cognitive Neuroscience.

[91]  P. Laukka,et al.  Communication of emotions in vocal expression and music performance: different channels, same code? , 2003, Psychological bulletin.

[92]  Mike D Brownell Musically adapted social stories to modify behaviors in students with autism: four case studies. , 2002, Journal of music therapy.

[93]  H. Engeland,et al.  Looking at Images with Human Figures: Comparison Between Autistic and Normal Children , 2002, Journal of autism and developmental disorders.

[94]  Hillary Anger Elfenbein,et al.  On the universality and cultural specificity of emotion recognition: a meta-analysis. , 2002, Psychological bulletin.

[95]  V. Bruce,et al.  Dynamic Properties Influence the Perception of Facial Expressions , 2013, Perception.

[96]  E. Glenn Schellenberg,et al.  Perceiving emotion in melody: Interactive effects of pitch and rhythm. , 2000 .

[97]  J. Boucher,et al.  Voice processing abilities in children with autism, children with specific language impairments, and young typically developing children. , 2000, Journal of child psychology and psychiatry, and allied disciplines.

[98]  L. Obler,et al.  Relationships among Facial, Prosodic, and Lexical Channels of Emotional Perceptual Processing , 2000 .

[99]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[100]  D. Lancker,et al.  Recognition of emotional‐prosodic meanings in speech by autistic, schizophrenic, and normal children , 1989 .

[101]  D. Navon Forest before trees: The precedence of global features in visual perception , 1977, Cognitive Psychology.