Acoustic-Prosodic and Physiological Response to Stressful Interactions in Children with Autism Spectrum Disorder

Social anxiety is a prevalent condition affecting individuals to varying degrees. Research on autism spectrum disorder (ASD), a group of neurodevelopmental disorders marked by impairments in social communication, has found that social anxiety occurs more frequently in this population. Our study aims to further understand the multimodal manifestation of social stress for adolescents with ASD versus neurotypically developing (TD) peers. We investigate this through objective measures of speech behavior and physiology (mean heart rate) acquired during three tasks: a low-stress conversation, a medium-stress interview, and a high-stress presentation. Measurable differences are found to exist for speech behavior and heart rate in relation to task-induced stress. Additionally, we find the acoustic measures are particularly effective for distinguishing between diagnostic groups. Individuals with ASD produced higher prosodic variability, agreeing with previous reports. Moreover, the most informative features captured an individual’s vocal changes between low and high social-stress, suggesting an interaction between vocal production and social stressors in ASD.

[1]  Nivja H. Jong,et al.  Praat script to detect syllable nuclei and measure speech rate automatically , 2009, Behavior research methods.

[2]  N. Schneiderman,et al.  Stress and health: psychological, behavioral, and biological determinants. , 2005, Annual review of clinical psychology.

[3]  C. Looze,et al.  The OMe (Octave-Median) scale: a natural scale for speech melody. , 2014 .

[4]  W. Bardwell,et al.  Effects of stress on heart rate complexity—A comparison between short-term and chronic stress , 2009, Biological Psychology.

[5]  Helen Tager-Flusberg,et al.  Emotional Facial and Vocal Expressions During Story Retelling by Children and Adolescents With High-Functioning Autism , 2022 .

[6]  T. Steimer,et al.  The biology of fear- and anxiety-related behaviors , 2002, Dialogues in clinical neuroscience.

[7]  Duane G. Watson,et al.  An acoustic analysis of prosody in high-functioning autism , 2009 .

[8]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[9]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .

[10]  A. Malliani,et al.  Heart rate variability. Standards of measurement, physiological interpretation, and clinical use , 1996 .

[11]  K. Scherer Vocal affect expression: a review and a model for future research. , 1986, Psychological bulletin.

[12]  E. Zane,et al.  How Anxious Do You Think I Am? Relationship Between State and Trait Anxiety in Children With and Without ASD During Social Tasks , 2017, Journal of autism and developmental disorders.

[13]  Olga V. Demler,et al.  Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Survey Replication. , 2005, Archives of general psychiatry.

[14]  Shrikanth S. Narayanan,et al.  Robust Speech Rate Estimation for Spontaneous Speech , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[15]  K. Scherer,et al.  The New Handbook of Methods in Nonverbal Behavior Research , 2008 .

[16]  Eric Fosler-Lussier,et al.  Combining multiple estimators of speaking rate , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[17]  Shrikanth S. Narayanan,et al.  The psychologist as an interlocutor in autism spectrum disorder assessment: insights from a study of spontaneous prosody. , 2014, Journal of speech, language, and hearing research : JSLHR.

[18]  J. Q. Simmons,et al.  Intonation Patterns in Normal, Autistic and Aphasie Children , 1984 .

[19]  Z. Warren,et al.  Prevalence of Autism Spectrum Disorder Among Children Aged 8 Years — Autism and Developmental Disabilities Monitoring Network, 11 Sites, United States, 2014 , 2018, Morbidity and mortality weekly report. Surveillance summaries.

[20]  Fabien Ringeval,et al.  AVEC 2016: Depression, Mood, and Emotion Recognition Workshop and Challenge , 2016, AVEC@ACM Multimedia.

[21]  F. J. V. van Steensel,et al.  Anxiety Disorders in Children and Adolescents with Autistic Spectrum Disorders: A Meta-Analysis , 2011, Clinical child and family psychology review.

[22]  C. Kirschbaum,et al.  The 'Trier Social Stress Test'--a tool for investigating psychobiological stress responses in a laboratory setting. , 1993, Neuropsychobiology.

[23]  Shrikanth S. Narayanan,et al.  Acoustic-prosodic, turn-taking, and language cues in child-psychologist interactions for varying social demand , 2013, INTERSPEECH.

[24]  Shrikanth S. Narayanan,et al.  The USC CARE Corpus: Child-Psychologist Interactions of Children with Autism Spectrum Disorders , 2011, INTERSPEECH.

[25]  Panayiotis G. Georgiou,et al.  Behavioral Signal Processing: Deriving Human Behavioral Informatics From Speech and Language , 2013, Proceedings of the IEEE.

[26]  M. P. R. van den Broecke,et al.  Proceedings of the Tenth International Congress of Phonetic Sciences , 1984 .

[27]  John H. L. Hansen,et al.  Getting started with SUSAS: a speech under simulated and actual stress database , 1997, EUROSPEECH.

[28]  Shrikanth S. Narayanan,et al.  Spontaneous-Speech Acoustic-Prosodic Features of Children with Autism and the Interacting Psychologist , 2012, INTERSPEECH.

[29]  F. Volkmar,et al.  Speech and prosody characteristics of adolescents and adults with high-functioning autism and Asperger syndrome. , 2001, Journal of speech, language, and hearing research : JSLHR.

[30]  Carlos Busso,et al.  Emotion recognition using a hierarchical binary decision tree approach , 2011, Speech Commun..

[31]  Rahul Gupta,et al.  Acoustic-Prosodic and Turn-Taking Features in Interactions with Children with Neurodevelopmental Disorders , 2016, INTERSPEECH.

[32]  Zhigang Deng,et al.  Analysis of emotion recognition using facial expressions, speech and multimodal information , 2004, ICMI '04.

[33]  Björn W. Schuller,et al.  Autoencoder-based Unsupervised Domain Adaptation for Speech Emotion Recognition , 2014, IEEE Signal Processing Letters.

[34]  Shrikanth S. Narayanan,et al.  Robust Unsupervised Arousal Rating:A Rule-Based Framework withKnowledge-Inspired Vocal Features , 2014, IEEE Transactions on Affective Computing.

[35]  Shrikanth S. Narayanan,et al.  Acoustic-prosodic correlates of 'awkward' prosody in story retellings from adolescents with autism , 2015, INTERSPEECH.

[36]  G. Arbanas Diagnostic and Statistical Manual of Mental Disorders (DSM-5) , 2015 .