Acoustic-prosodic, turn-taking, and language cues in child-psychologist interactions for varying social demand

Impaired social communication and social reciprocity are the primary phenotypic distinctions between autism spectrum disorders (ASD) and other developmental disorders. We investigate quantitative conversational cues in child-psychologist interactions using acoustic-prosodic, turn-taking, and language features. Results indicate the conversational quality degraded for children with higher ASD severity, as the child exhibited difficulties conversing and the psychologist varied her speech and language strategies to engage the child. When interacting with children with increasing ASD severity, the psychologist exhibited higher prosodic variability, increased pausing, more speech, atypical voice quality, and less use of conventional conversational cue such as assents and non-fluencies. Children with increasing ASD severity spoke less, spoke slower, responded later, had more variable prosody, and used personal pronouns, affect language, and fillers less often. We also investigated the predictive power of features from interaction subtasks with varying social demands placed on the child. We found that acoustic prosodic and turn-taking features were more predictive during higher social demand tasks, and that the most predictive features vary with context of interaction. We also observed that psychologist language features may be robust to the amount of speech in a subtask, showing significance even when the child is participating in minimal-speech, low social-demand tasks. Index Terms: autism spectrum disorders, atypical prosody, social reciprocity, turn-taking, language cues

[1]  C. Baltaxe Pragmatic Deficits in the Language of Autistic Adolescents , 1977 .

[2]  Paul D. Ellsworth,et al.  Diagnostic and Statistical Manual of Mental Disorder , 1980 .

[3]  R. Jordan An experimental comparison of the understanding and use of speaker-addressee personal pronouns in autistic children. , 1989, The British journal of disorders of communication.

[4]  J. Sundberg,et al.  Acoustic measurements and perceptual evaluation of hoarseness in children's voices , 1998 .

[5]  B. Leventhal,et al.  The Autism Diagnostic Observation Schedule—Generic: A Standard Measure of Social and Communication Deficits Associated with the Spectrum of Autism , 2000, Journal of autism and developmental disorders.

[6]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .

[7]  F. Volkmar,et al.  Brief Report: Relations between Prosodic Performance and Communication and Socialization Ratings in High Functioning Speakers with Autism Spectrum Disorders , 2005, Journal of autism and developmental disorders.

[8]  S. Baron-Cohen,et al.  The ‘Reading the Mind in the Voice’ Test-Revised: A Study of Complex Emotion Recognition in Adults with and Without Autism Spectrum Conditions , 2007, Journal of autism and developmental disorders.

[9]  Sue Peppé,et al.  Receptive and expressive prosodic ability in children with high-functioning autism. , 2007, Journal of speech, language, and hearing research : JSLHR.

[10]  C. Lord,et al.  The Autism Diagnostic Observation Schedule: Revised Algorithms for Improved Diagnostic Validity , 2007, Journal of autism and developmental disorders.

[11]  James W. Pennebaker,et al.  Linguistic Inquiry and Word Count (LIWC2007) , 2007 .

[12]  Duane G. Watson,et al.  An acoustic analysis of prosody in high-functioning autism , 2009 .

[13]  Maxine Eskénazi,et al.  A Finite-State Turn-Taking Model for Spoken Dialog Systems , 2009, NAACL.

[14]  C. Rice Prevalence of autism spectrum disorders - Autism and Developmental Disabilities Monitoring Network, United States, 2006. , 2009, Morbidity and mortality weekly report. Surveillance summaries.

[15]  C. Lord,et al.  Standardizing ADOS Scores for a Measure of Severity in Autism Spectrum Disorders , 2009, Journal of autism and developmental disorders.

[16]  Jan P. H. van Santen,et al.  Autism and Interactional Aspects of Dialogue , 2010, SIGDIAL Conference.

[17]  Brian Kingsbury,et al.  The IBM Attila speech recognition toolkit , 2010, 2010 IEEE Spoken Language Technology Workshop.

[18]  Brian Roark,et al.  Classification of Atypical Language in Autism , 2011, CMCL@ACL.

[19]  Shrikanth S. Narayanan,et al.  The USC CARE Corpus: Child-Psychologist Interactions of Children with Autism Spectrum Disorders , 2011, INTERSPEECH.

[20]  J. Baio Prevalence of autism spectrum disorders--Autism and Developmental Disabilities Monitoring Network, 14 sites, United States, 2008. , 2012, Morbidity and mortality weekly report. Surveillance summaries.

[21]  Shrikanth S. Narayanan,et al.  Spontaneous-Speech Acoustic-Prosodic Features of Children with Autism and the Interacting Psychologist , 2012, INTERSPEECH.

[22]  Shrikanth S. Narayanan,et al.  A Robust Unsupervised Arousal Rating Framework using Prosody with Cross-Corpora Evaluation , 2012, INTERSPEECH.

[23]  B. T. Brown,et al.  Brief Report: Making Experience Personal: Internal States Language in the Memory Narratives of Children with and Without Asperger’s Disorder , 2012, Journal of autism and developmental disorders.

[24]  Panayiotis G. Georgiou,et al.  Behavioral Signal Processing: Deriving Human Behavioral Informatics From Speech and Language , 2013, Proceedings of the IEEE.

[25]  Shrikanth S. Narayanan,et al.  Using physiology and language cues for modeling verbal response latencies of children with ASD , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[26]  Athanasios Katsamanis,et al.  Computing vocal entrainment: A signal-derived PCA-based quantification scheme with application to affect analysis in married couple interactions , 2014, Comput. Speech Lang..