SPASHT: Semantic and Pragmatic Speech Features for Automatic Assessment of Autism

Language and communication impairments are considered one of the core features of autism spectrum disorder (ASD). Quantifying the language atypicalities in autism is a challenging task. Prior works have explored acoustic, and text-based features to assess children’s language and communicative behaviours and have shown their relevance in the diagnosis of autism. In this work, we explore the semantic and pragmatic language features in children with autism (CwA) to understand their significance in the diagnosis of autism. We use natural language processing (NLP) and machine learning (ML) techniques to automatically extract relevant features and detect the existence of speech behaviours such as echolalia, semantic coherence, repetitive language, etc. We further analyse their correlation with the clinical diagnosis of autism. We conducted validation experiments on the transcripts of 76 children (35 ASD and 41 TD) extracted from the CHILDES databank. Our analysis shows that the semantic and pragmatic language features are representative candidates for autism diagnosis and are found to complement the syntactic and lexical features in the classification of CwA with an accuracy of 94%. Further, these features being more coherent and relatable to the standard diagnostic tools improves the interpretability of the diagnostic predictions made using speech signals.

[1]  S. Curtin,et al.  Trajectories of Vocabulary Development in Children with Autism Spectrum Disorder Across Multiple Measures , 2021, Journal of Autism and Developmental Disorders.

[2]  Jill K. Dolata,et al.  A Pseudo-Value Approach to Analyze the Semantic Similarity of the Speech of Children With and Without Autism Spectrum Disorder , 2021, Frontiers in Psychology.

[3]  Jill K. Dolata,et al.  Evaluating atypical language in autism using automated language measures , 2021, Scientific Reports.

[4]  Robert T. Schultz,et al.  Automatic Detection of Autism Spectrum Disorder in Children Using Acoustic and Text Features from Brief Natural Conversations , 2019, INTERSPEECH.

[5]  I. Tsimpli,et al.  Syntactic and Story Structure Complexity in the Narratives of High- and Low-Language Ability Children with Autism Spectrum Disorder , 2017, Front. Psychol..

[6]  N. Katsos,et al.  The Contribution of Grammar, Vocabulary and Theory of Mind in Pragmatic Language Competence in Children with Autistic Spectrum Disorders , 2017, Front. Psychol..

[7]  Elena E. Lyakso,et al.  A Comparison of Acoustic Features of Speech of Typically Developing Children and Children with Autism Spectrum Disorders , 2016, SPECOM.

[8]  Janet Y. Bang,et al.  Learning Language in Autism: Maternal Linguistic Input Contributes to Later Vocabulary , 2015, Autism research : official journal of the International Society for Autism Research.

[9]  E. Walker,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[10]  Helen Tager-Flusberg,et al.  Language Assessment and Development in Toddlers with Autism Spectrum Disorders , 2008, Journal of autism and developmental disorders.

[11]  Catherine Lord,et al.  Characterizing communicative development in children referred for Autism Spectrum Disorders using the MacArthur-Bates Communicative Development Inventory (CDI)* , 2007, Journal of Child Language.

[12]  L. Bennetto,et al.  Beyond Pragmatics: Morphosyntactic Development in Autism , 2007, Journal of autism and developmental disorders.

[13]  S Baron-Cohen,et al.  Linguistic processing in high-functioning adults with autism or Asperger's syndrome. Is global coherence impaired? , 2000, Psychological Medicine.

[14]  E. Leinonen,et al.  Relevance theory and pragmatic impairment. , 1999, International journal of language & communication disorders.

[15]  Ann Chadwick-Dias,et al.  A longitudinal study of language acquisition in autistic and down syndrome children , 1990, Journal of autism and developmental disorders.

[16]  R. Jordan An experimental comparison of the understanding and use of speaker-addressee personal pronouns in autistic children. , 1989, The British journal of disorders of communication.

[17]  Shrikanth S. Narayanan,et al.  Spontaneous-Speech Acoustic-Prosodic Features of Children with Autism and the Interacting Psychologist , 2012, INTERSPEECH.

[18]  Xiaofei Lu,et al.  Automatic analysis of syntactic complexity in second language writing , 2010 .