Identifying predictive features of autism spectrum disorders in a clinical sample of adolescents and adults using machine learning

Diagnosing autism spectrum disorders (ASD) is a complicated, time-consuming process which is particularly challenging in older individuals. One of the most widely used behavioral diagnostic tools is the Autism Diagnostic Observation Schedule (ADOS). Previous work using machine learning techniques suggested that ASD detection in children can be achieved with substantially fewer items than the original ADOS. Here, we expand on this work with a specific focus on adolescents and adults as assessed with the ADOS Module 4. We used a machine learning algorithm (support vector machine) to examine whether ASD detection can be improved by identifying a subset of behavioral features from the ADOS Module 4 in a routine clinical sample of N = 673 high-functioning adolescents and adults with ASD (n = 385) and individuals with suspected ASD but other best-estimate or no psychiatric diagnoses (n = 288). We identified reduced subsets of 5 behavioral features for the whole sample as well as age subgroups (adolescents vs. adults) that showed good specificity and sensitivity and reached performance close to that of the existing ADOS algorithm and the full ADOS, with no significant differences in overall performance. These results may help to improve the complicated diagnostic process of ASD by encouraging future efforts to develop novel diagnostic instruments for ASD detection based on the identified constructs as well as aiding clinicians in the difficult question of differential diagnosis.

[1]  J. Sengupta The Nonparametric Approach , 1989 .

[2]  P. Marik,et al.  Narrative Review , 2012, Journal of intensive care medicine.

[3]  Fadi Thabtah,et al.  A new machine learning model based on induction of rules for autism detection , 2020, Health Informatics J..

[4]  Max Kuhn,et al.  Building Predictive Models in R Using the caret Package , 2008 .

[5]  F. Happé,et al.  Demographic and Cognitive Profile of Individuals Seeking a Diagnosis of Autism Spectrum Disorder in Adulthood , 2016, Journal of autism and developmental disorders.

[6]  E. DeLong,et al.  Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. , 1988, Biometrics.

[7]  J Carpenter,et al.  Bootstrap confidence intervals: when, which, what? A practical guide for medical statisticians. , 2000, Statistics in medicine.

[8]  The Autism Diagnostic Observation Schedule, Module 4: Application of the Revised Algorithms in an Independent, Well-Defined, Dutch Sample (n = 93) , 2015, Journal of autism and developmental disorders.

[9]  V. Roessner,et al.  Diagnostic accuracy of the ADOS and ADOS-2 in clinical practice , 2018, European Child & Adolescent Psychiatry.

[10]  Kim Van Naarden Braun,et al.  Development of a Machine Learning Algorithm for the Surveillance of Autism Spectrum Disorder , 2016, PloS one.

[11]  Teresa Foo,et al.  : SYSTEMATIC LITERATURE REVIEW , 2004 .

[12]  Nabila Shahnaz Khan,et al.  A Machine Learning Approach to Predict Autism Spectrum Disorder , 2019, 2019 International Conference on Electrical, Computer and Communication Engineering (ECCE).

[13]  E. Torres,et al.  Autism Research: An Objective Quantitative Review of Progress and Focus Between 1994 and 2015 , 2018, Front. Psychol..

[14]  C. Lord,et al.  Subdimensions of social-communication impairment in autism spectrum disorder. , 2016, Journal of child psychology and psychiatry, and allied disciplines.

[15]  Michael V. Lombardo,et al.  Sex/Gender Differences and Autism: Setting the Scene for Future Research , 2015, Journal of the American Academy of Child and Adolescent Psychiatry.

[16]  Stephannie L. Furtak,et al.  Psychiatric Comorbidity and Functioning in a Clinically Referred Population of Adults with Autism Spectrum Disorders: A Comparative Study , 2013, Journal of autism and developmental disorders.

[17]  Sebastien Levy,et al.  Sparsifying machine learning models identify stable subsets of predictive features for behavioral detection of autism , 2017, Molecular Autism.

[18]  Dennis P. Wall,et al.  Machine learning approach for early detection of autism by combining questionnaire and home video screening , 2017, J. Am. Medical Informatics Assoc..

[19]  Peter Washington,et al.  Mobile detection of autism through machine learning on home video: A development and prospective validation study , 2018, PLoS medicine.

[20]  Tobias Scheffer,et al.  Detecting Autism by Analyzing a Simulated Social Interaction , 2018, ECML/PKDD.

[21]  Scott H. Lee,et al.  A comparison of machine learning algorithms for the surveillance of autism spectrum disorder , 2018, PloS one.

[22]  Janet B W Williams,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[23]  L. Poustka,et al.  Diagnostic utility of the autism diagnostic observation schedule in a clinical sample of adolescents and adults , 2017 .

[24]  Evon M. O. Abu-Taieh,et al.  Comparative Study , 2020, Definitions.

[25]  Helen McConachie,et al.  Diagnosing Autism Spectrum Disorders in Pre-school Children Using Two Standardised Assessment Instruments: The ADI-R and the ADOS , 2008, Journal of autism and developmental disorders.

[26]  E. Walker,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[27]  M. Rietschel,et al.  Study protocol of the ASD-Net, the German research consortium for the study of Autism Spectrum Disorder across the lifespan: from a better etiological understanding, through valid diagnosis, to more effective health care , 2017, BMC Psychiatry.

[28]  Shahadat Uddin,et al.  Machine Learning-Based Models for Early Stage Detection of Autism Spectrum Disorders , 2019, IEEE Access.

[29]  A. Zeileis Econometric Computing with HC and HAC Covariance Matrix Estimators , 2004 .

[30]  Simon Baron-Cohen,et al.  Quantifying and exploring camouflaging in men and women with autism , 2016, Autism : the international journal of research and practice.

[31]  M. Falkmer,et al.  Diagnostic procedures in autism spectrum disorders: a systematic literature review , 2013, European Child & Adolescent Psychiatry.

[32]  Todd F. DeLuca,et al.  Use of machine learning to shorten observation-based screening and diagnosis of autism , 2012, Translational Psychiatry.

[33]  Patricia Howlin,et al.  Social outcomes in mid- to later adulthood among individuals diagnosed with autism and average nonverbal IQ as children. , 2013, Journal of the American Academy of Child and Adolescent Psychiatry.

[34]  Dennis P. Wall,et al.  The Potential of Accelerating Early Detection of Autism through Content Analysis of YouTube Videos , 2014, PloS one.

[35]  T. Brugha,et al.  The Prevalence of Autism Spectrum Disorders in Adult Psychiatric Inpatients: A Systematic Review , 2018, Clinical practice and epidemiology in mental health : CP & EMH.

[36]  D. Wall,et al.  Use of Artificial Intelligence to Shorten the Behavioral Diagnosis of Autism , 2012, PloS one.

[37]  R. Hastings,et al.  Outcomes of Behavioral Intervention for Children with Autism in Mainstream Pre-School Settings , 2011, Journal of autism and developmental disorders.

[38]  S. Baron-Cohen,et al.  Identifying the lost generation of adults with autism spectrum conditions. , 2015, The lancet. Psychiatry.

[39]  D. Wall,et al.  Searching for a minimal set of behaviors for autism detection through feature selection-based machine learning , 2015, Translational Psychiatry.

[40]  Simon Baron-Cohen,et al.  Autism , 2008, The Lancet.

[41]  C. Molloy,et al.  Use of the Autism Diagnostic Observation Schedule (ADOS) in a clinical setting , 2011, Autism : the international journal of research and practice.

[42]  B. Leventhal,et al.  The Autism Diagnostic Observation Schedule—Generic: A Standard Measure of Social and Communication Deficits Associated with the Spectrum of Autism , 2000, Journal of autism and developmental disorders.

[43]  Judith S Miller,et al.  The Accuracy of the ADOS-2 in Identifying Autism among Adults with Complex Psychiatric Conditions , 2017, Journal of autism and developmental disorders.

[44]  D. Wall,et al.  Use of machine learning for behavioral distinction of autism and ADHD , 2016, Translational Psychiatry.

[45]  Matthew S. Goodwin,et al.  Use of machine learning to improve autism screening and diagnostic instruments: effectiveness, efficiency, and multi-instrument fusion. , 2016, Journal of child psychology and psychiatry, and allied disciplines.

[46]  Max Kuhn,et al.  The caret Package , 2007 .

[47]  Gary Longton,et al.  Estimation and Comparison of Receiver Operating Characteristic Curves , 2009, The Stata journal.

[48]  Christian Keysers,et al.  Diagnosing Autism Spectrum Disorders in Adults: the Use of Autism Diagnostic Observation Schedule (ADOS) Module 4 , 2010, Journal of autism and developmental disorders.

[49]  Sjoerd Sytema,et al.  Interrelationship Between Autism Diagnostic Observation Schedule-Generic (ADOS-G), Autism Diagnostic Interview-Revised (ADI-R), and the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV-TR) Classification in Children and Adolescents with Mental Retardation , 2004, Journal of autism and developmental disorders.

[50]  Kurt Hornik,et al.  kernlab - An S4 Package for Kernel Methods in R , 2004 .

[51]  Helen Haessner Pitfalls and Promises. , 1972 .

[52]  E. Mohammadi,et al.  Barriers and facilitators related to the implementation of a physiological track and trigger system: A systematic review of the qualitative evidence , 2017, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[53]  C. Lord,et al.  The Autism Diagnostic Observation Schedule: Revised Algorithms for Improved Diagnostic Validity , 2007, Journal of autism and developmental disorders.

[54]  Tony Charman,et al.  Measurement Issues: Screening and diagnostic instruments for autism spectrum disorders - lessons from research and practice. , 2013, Child and adolescent mental health.

[55]  T. Berney,et al.  Psychometric properties of questionnaires and diagnostic measures for autism spectrum disorders in adults: A systematic review , 2019, Autism : the international journal of research and practice.

[56]  C. Mazefsky,et al.  The discriminative ability and diagnostic utility of the ADOS-G, ADI-R, and GARS for children in a clinical setting , 2006, Autism : the international journal of research and practice.

[57]  Sven Bölte,et al.  The objectivity of the Autism Diagnostic Observation Schedule (ADOS) in naturalistic clinical settings , 2016, European Child & Adolescent Psychiatry.

[58]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[59]  D. Wall,et al.  Testing the accuracy of an observation-based classifier for rapid detection of autism risk , 2014, Translational Psychiatry.

[60]  F. Thabtah Machine learning in autistic spectrum disorder behavioral research: A review and ways forward , 2019, Informatics for health & social care.

[61]  Matthew S. Goodwin,et al.  Applying Machine Learning to Facilitate Autism Diagnostics: Pitfalls and Promises , 2014, Journal of Autism and Developmental Disorders.

[62]  L. Fusar-Poli,et al.  Diagnosing ASD in Adults Without ID: Accuracy of the ADOS-2 and the ADI-R , 2017, Journal of autism and developmental disorders.

[63]  T. Ford,et al.  Clinical practice guidelines for diagnosis of autism spectrum disorder in adults and children in the UK: a narrative review , 2018, BMC Psychiatry.

[64]  Xavier Robin,et al.  pROC: an open-source package for R and S+ to analyze and compare ROC curves , 2011, BMC Bioinformatics.

[65]  Patricia Howlin,et al.  Adults with Autism Spectrum Disorders , 2012, Canadian journal of psychiatry. Revue canadienne de psychiatrie.

[66]  Catherine Lord,et al.  The Autism Diagnostic Observation Schedule, Module 4: Revised Algorithm and Standardized Severity Scores , 2014, Journal of autism and developmental disorders.

[67]  S. Baron-Cohen,et al.  Self-Referential Cognition and Empathy in Autism , 2007, PloS one.