Oral-Motor and Lexical Diversity During Naturalistic Conversations in Adults with Autism Spectrum Disorder

Autism spectrum disorder (ASD) is a neurodevelopmental condition characterized by impaired social communication and the presence of restricted, repetitive patterns of behaviors and interests. Prior research suggests that restricted patterns of behavior in ASD may be cross-domain phenomena that are evident in a variety of modalities. Computational studies of language in ASD provide support for the existence of an underlying dimension of restriction that emerges during a conversation. Similar evidence exists for restricted patterns of facial movement. Using tools from computational linguistics, computer vision, and information theory, this study tests whether cognitive-motor restriction can be detected across multiple behavioral domains in adults with ASD during a naturalistic conversation. Our methods identify restricted behavioral patterns, as measured by entropy in word use and mouth movement. Results suggest that adults with ASD produce significantly less diverse mouth movements and words than neurotypical adults, with an increased reliance on repeated patterns in both domains. The diversity values of the two domains are not significantly correlated, suggesting that they provide complementary information.

[1]  Andrea Cavallaro,et al.  Automatic Analysis of Facial Affect: A Survey of Registration, Representation, and Recognition , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  P. Winkielman,et al.  When the social mirror breaks: deficits in automatic, but not voluntary, mimicry of emotional facial expressions in autism. , 2006, Developmental science.

[3]  R. Schultz,et al.  Linguistic camouflage in girls with autism spectrum disorder , 2017, Molecular Autism.

[4]  Andrew Pickles,et al.  Heterogeneity and plasticity in the development of language: a 17-year follow-up of children referred early for possible autism. , 2014, Journal of child psychology and psychiatry, and allied disciplines.

[5]  Claude E. Shannon,et al.  Prediction and Entropy of Printed English , 1951 .

[6]  D. Beversdorf Phenotyping, Etiological Factors, and Biomarkers: Toward Precision Medicine in Autism Spectrum Disorders , 2016, Journal of developmental and behavioral pediatrics : JDBP.

[7]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[8]  A. Miranda,et al.  Narratives of children with high-functioning autism spectrum disorder: A meta-analysis. , 2016, Research in developmental disabilities.

[9]  Robert T. Schultz,et al.  Exploring Autism Spectrum Disorders Using HLT , 2016, CLPsych@HLT-NAACL.

[10]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[11]  M. Gernsbacher,et al.  Infant and toddler oral- and manual-motor skills predict later speech fluency in autism. , 2008, Journal of child psychology and psychiatry, and allied disciplines.

[12]  Emily A. Kuhl,et al.  DSM-5 field trials in the United States and Canada, Part II: test-retest reliability of selected categorical diagnoses. , 2013, The American journal of psychiatry.

[13]  Jan P. H. van Santen,et al.  Autism and Interactional Aspects of Dialogue , 2010, SIGDIAL Conference.

[14]  K. Loveland,et al.  Imitation and expression of facial affect in autism , 1994, Development and Psychopathology.

[15]  Matthew S. Goodwin,et al.  Applying Machine Learning to Facilitate Autism Diagnostics: Pitfalls and Promises , 2014, Journal of Autism and Developmental Disorders.

[16]  E. Walker,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[17]  P. Mundy,et al.  Facial expressions of affect in autistic, mentally retarded and normal children. , 1989, Journal of child psychology and psychiatry, and allied disciplines.

[18]  M. Losh,et al.  “The Frog Ate the Bug and Made his Mouth Sad”: Narrative Competence in Children with Autism , 2000, Journal of abnormal child psychology.

[19]  Richard Sproat,et al.  Similarity Measures for Quantifying Restrictive and Repetitive Behavior in Conversations of Autistic Children , 2015, CLPsych@HLT-NAACL.

[20]  D. Penn,et al.  Development of the Contextual Assessment of Social Skills (CASS): A Role Play Measure of Social Skill for Individuals with High-Functioning Autism , 2011, Journal of autism and developmental disorders.

[21]  Shrikanth S. Narayanan,et al.  Acoustic-prosodic, turn-taking, and language cues in child-psychologist interactions for varying social demand , 2013, INTERSPEECH.

[22]  Emily Tucker Prud'hommeaux,et al.  Computational prosodic markers for autism. , 2010, Autism : the international journal of research and practice.

[23]  Zachary Warren,et al.  A multisite study of the clinical diagnosis of different autism spectrum disorders. , 2012, Archives of general psychiatry.

[24]  R. Schultz,et al.  Measuring social attention and motivation in autism spectrum disorder using eye‐tracking: Stimulus type matters , 2015, Autism research : official journal of the International Society for Autism Research.

[25]  Miklos Gyori,et al.  Can Automated Facial Expression Analysis Show Differences Between Autism and Typical Functioning? , 2017, AAATE Conf..

[26]  Bryan King,et al.  Competent users and standards of use for Autism Diagnostic Interview – Revised (ADI-R) and Autism Diagnostic Observation Schedule, Second Edition (ADOS-2) , 2018, Psychiatria i Psychologia Kliniczna.

[27]  Hidenori Yamasue,et al.  Computer-analyzed facial expression as a surrogate marker for autism spectrum social core symptoms , 2018, PloS one.

[28]  Andrea Cavallaro,et al.  Learning Bases of Activity for Facial Expression Recognition , 2017, IEEE Transactions on Image Processing.

[29]  Ian H. Witten,et al.  Source Models for Natural Language Text , 1990, Int. J. Man Mach. Stud..

[30]  Shrikanth S. Narayanan,et al.  The psychologist as an interlocutor in autism spectrum disorder assessment: insights from a study of spontaneous prosody. , 2014, Journal of speech, language, and hearing research : JSLHR.

[31]  John Makhoul,et al.  Using quick transcriptions to improve conversational speech models , 2004, INTERSPEECH.

[32]  Wataru Sato,et al.  Impaired Overt Facial Mimicry in Response to Dynamic Facial Expressions in High-Functioning Autism Spectrum Disorders , 2014, Journal of Autism and Developmental Disorders.

[33]  Geoffrey Bird,et al.  Can Neurotypical Individuals Read Autistic Facial Expressions? Atypical Production of Emotional Facial Expressions in Autism Spectrum Disorders , 2015, Autism research : official journal of the International Society for Autism Research.

[34]  Peter Robinson,et al.  OpenFace: An open source facial behavior analysis toolkit , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[35]  L. Adams Oral-Motor and Motor-Speech Characteristics of Children with Autism , 1998 .

[36]  M. Dorahy Diagnostic and Statistical Manual of Mental Disorders, 5th Edition (DSM-5) , 2014 .

[37]  D. Wechsler Wechsler Abbreviated Scale of Intelligence--Second Edition , 2018 .

[38]  Carlos Busso,et al.  Interrelation Between Speech and Facial Gestures in Emotional Utterances: A Single Subject Study , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[39]  Robert T. Schultz,et al.  Building Language Resources for Exploring Autism Spectrum Disorders , 2016, LREC.

[40]  R. Sproat,et al.  Quantifying Repetitive Speech in Autism Spectrum Disorders and Language Impairment , 2013, Autism research : official journal of the International Society for Autism Research.

[41]  Matthew S. Goodwin,et al.  Moving towards a real-time system for automatically recognizing stereotypical motor movements in individuals on the autism spectrum using wireless accelerometry , 2014, UbiComp.

[42]  Tomoki Toda,et al.  Linguistic and Acoustic Features for Automatic Identification of Autism Spectrum Disorders in Children’s Narrative , 2014, CLPsych@ACL.

[43]  Maureen S. Durkin,et al.  Prevalence and Characteristics of Autism Spectrum Disorder Among Children Aged 8 Years — Autism and Developmental Disabilities Monitoring Network, 11 Sites, United States, 2012 , 2018, Morbidity and mortality weekly report. Surveillance summaries.

[44]  Adam W. McCrimmon,et al.  Review of the Wechsler Abbreviated Scale of Intelligence, Second Edition (WASI-II) , 2013 .

[45]  Meghan Lammie Glenn,et al.  XTrans: a speech annotation and transcription tool , 2009, INTERSPEECH.

[46]  K. Bicknell,et al.  Detecting Language Impairments in Autism: A Computational Analysis of Semi-structured Conversations with Vector Semantics , 2018 .

[47]  Tanaya Guha,et al.  A Computational Study of Expressive Facial Dynamics in Children with Autism , 2018, IEEE Transactions on Affective Computing.

[48]  Manar D. Samad,et al.  A Feasibility Study of Autism Behavioral Markers in Spontaneous Facial, Visual, and Hand Movement Response Data , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.