Gaze-based classification of autism spectrum disorder

Abstract People with autism spectrum disorder (ASD) display impairments in social interaction and communication skills, as well as restricted interests and repetitive behaviors, which greatly affect daily life functioning. Current identification of ASD involves a lengthy process that requires an experienced clinician to assess multiple domains of functioning. Considering this, we propose a method for classifying multiple levels of risk of ASD using eye gaze and demographic feature descriptors such as a subject's age and gender. We construct feature descriptors that incorporate the subject's age and gender, as well as features based on eye gaze patterns. We also present an analysis of eye gaze patterns validating the use of the selected hand-crafted features. We assess the efficacy of our descriptors to classify ASD on a National Database for Autism Research dataset, using multiple classifiers including a random forest, C4.5 decision tree, PART, and a deep feedforward neural network.

[1]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[2]  A. Brereton,et al.  A review of evidence-based early intervention for behavioural problems in children with autism spectrum disorder: the core components of effective programs, child-focused interventions and comprehensive treatment models , 2014, Current opinion in psychiatry.

[3]  V. Roessner,et al.  Diagnostic accuracy of the ADOS and ADOS-2 in clinical practice , 2018, European Child & Adolescent Psychiatry.

[4]  B. Rogé,et al.  The Importance of Networking in Autism Gaze Analysis , 2015, PloS one.

[5]  D. Ballard,et al.  Eye movements in natural behavior , 2005, Trends in Cognitive Sciences.

[6]  G. Dawson,et al.  Long-Term Outcomes of Early Intervention in 6-Year-Old Children With Autism Spectrum Disorder. , 2015, Journal of the American Academy of Child and Adolescent Psychiatry.

[7]  Ian H. Witten,et al.  Generating Accurate Rule Sets Without Global Optimization , 1998, ICML.

[8]  U Rosenhall,et al.  Oculomotor findings in autistic children , 1988, The Journal of Laryngology & Otology.

[9]  L. Zwaigenbaum,et al.  Factors influencing autism spectrum disorder screening by community paediatricians. , 2015, Paediatrics & child health.

[10]  Daniel S. Messinger,et al.  Analysis of eye gaze pattern of infants at risk of autism spectrum disorder using Markov models , 2011, 2011 IEEE Workshop on Applications of Computer Vision (WACV).

[11]  Antonia F. de C. Hamilton,et al.  Gazing at me: the importance of social meaning in understanding direct-gaze cues. , 2016, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[12]  K. Pierce,et al.  Preference for geometric patterns early in life as a risk factor for autism. , 2011, Archives of general psychiatry.

[13]  Antonia F. de C. Hamilton,et al.  Gazing at me: the importance of social meaning in understanding direct-gaze cues , 2016, Philosophical Transactions of the Royal Society B: Biological Sciences.

[14]  Kelly M. Schieltz,et al.  Conducting Functional Communication Training via Telehealth to Reduce the Problem Behavior of Young Children with Autism , 2013, Journal of developmental and physical disabilities.

[15]  Wojciech Matusik,et al.  Eye Tracking for Everyone , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  James M. Rehg,et al.  Behavioral Imaging and Autism , 2014, IEEE Pervasive Computing.

[17]  Luc Van Gool,et al.  Real time head pose estimation with random regression forests , 2011, CVPR 2011.

[18]  Z. Warren,et al.  Prevalence of autism spectrum disorder among children aged 8 years - autism and developmental disabilities monitoring network, 11 sites, United States, 2010. , 2014, Morbidity and mortality weekly report. Surveillance summaries.

[19]  S. Ozonoff,et al.  Gaze to faces across interactive contexts in infants at heightened risk for autism , 2018, Autism : the international journal of research and practice.

[20]  M. Macias,et al.  Implementing Developmental Screening and Referrals: Lessons Learned From a National Project , 2010, Pediatrics.

[21]  Nilanjan Sarkar,et al.  Understanding How Adolescents with Autism Respond to Facial Expressions in Virtual Reality Environments , 2013, IEEE Transactions on Visualization and Computer Graphics.

[22]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[23]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[24]  Yi Pan,et al.  Classification of autism spectrum disorder by combining brain connectivity and deep neural network classifier , 2019, Neurocomputing.

[25]  D. Wall,et al.  Crowdsourced validation of a machine-learning classification system for autism and ADHD , 2017, Translational Psychiatry.

[26]  Tetsuya Takiguchi,et al.  Detecting Abnormal Word Utterances in Children With Autism Spectrum Disorders , 2017, Perceptual and motor skills.

[27]  Shaun J. Canavan,et al.  Combining gaze and demographic feature descriptors for autism classification , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[28]  P. Hagerman The fragile X prevalence paradox , 2008, Journal of Medical Genetics.

[29]  Li Yi,et al.  Identifying children with autism spectrum disorder based on their face processing abnormality: A machine learning framework , 2016, Autism research : official journal of the International Society for Autism Research.

[30]  James M. Rehg,et al.  Detecting eye contact using wearable eye-tracking glasses , 2012, UbiComp.

[31]  Minh Tran,et al.  Are you really looking at me? A Framework for Extracting Interpersonal Eye Gaze from Conventional Video , 2019, ArXiv.

[32]  Sven Bölte,et al.  Eye tracking in early autism research , 2013, Journal of Neurodevelopmental Disorders.

[33]  J. Hietanen,et al.  Atypical physiological orienting to direct gaze in low‐functioning children with autism spectrum disorder , 2017, Autism research : official journal of the International Society for Autism Research.

[34]  A. Franco,et al.  NeuroImage: Clinical , 2022 .

[35]  James M. Rehg,et al.  Decoding Children's Social Behavior , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Noah J. Sasson,et al.  Children with autism demonstrate circumscribed attention during passive viewing of complex social and nonsocial picture arrays , 2008, Autism research : official journal of the International Society for Autism Research.