Autism detection based on eye movement sequences on the web: a scanpath trend analysis approach

Autism diagnostic procedure is a subjective, challenging and expensive procedure and relies on behavioral, historical and parental report information. In our previous, we proposed a machine learning classifier to be used as a potential screening tool or used in conjunction with other diagnostic methods, thus aiding established diagnostic methods. The classifier uses eye movements of people on web pages but it only considers non-sequential data. It achieves the best accuracy by combining data from several web pages and it has varying levels of accuracy on different web pages. In this present paper, we investigate whether it is possible to detect autism based on eye-movement sequences and achieve stable accuracy across different web pages to be not dependent on specific web pages. We used Scanpath Trend Analysis (STA) which is designed for identifying a trending path of a group of users on a web page based on their eye movements. We first identify trending paths of people with autism and neurotypical people. To detect whether or not a person has autism, we calculate the similarity of his/her path to the trending paths of people with autism and neurotypical people. If the path is more similar to the trending path of neurotypical people, we classify the person as a neurotypical person. Otherwise, we classify her/him as a person with autism. We systematically evaluate our approach with an eye-tracking dataset of 15 verbal and highly-independent people with autism and 15 neurotypical people on six web pages. Our evaluation shows that the STA approach performs better on individual web pages and provides more stable accuracy across different pages.

[1]  Sven Bölte,et al.  Eye tracking in early autism research , 2013, Journal of Neurodevelopmental Disorders.

[2]  Andres Sanoja,et al.  Block-o-Matic: A web page segmentation framework , 2014, 2014 International Conference on Multimedia Computing and Systems (ICMCS).

[3]  Daniel P. Kennedy,et al.  Atypical Visual Saliency in Autism Spectrum Disorder Quantified through Model-Based Eye Tracking , 2015, Neuron.

[4]  Thomas Pellegrini,et al.  Automatic Assessment of Speech Capability Loss in Disordered Speech , 2015, ACM Trans. Access. Comput..

[5]  Roy McConkey,et al.  Autism in Developing Countries: Lessons from Iran , 2011, Autism research and treatment.

[6]  I. Hooge,et al.  Is There a Limit to the Superiority of Individuals with ASD in Visual Search? , 2014, Journal of autism and developmental disorders.

[7]  Yeliz Yesilada,et al.  Patterns in Eyetracking Scanpaths and the Affecting Factors , 2015, J. Web Eng..

[8]  Christine Lourrine TABLATIN,et al.  Identifying Common Code Reading Patterns using Scanpath Trend Analysis with a Tolerance , 2018 .

[9]  Mark Tomlinson,et al.  Autism screening and diagnosis in low resource settings: Challenges and opportunities to enhance research and services worldwide: Enhancing Autism Research and Services Worldwide , 2015 .

[10]  Yeliz Yesilada,et al.  Do Web Users with Autism Experience Barriers When Searching for Information Within Web Pages? , 2017, W4A.

[11]  Gabriel A. Devenyi,et al.  Cerebellar anatomical alterations and attention to eyes in autism , 2017, Scientific Reports.

[12]  Svitlana Zinger,et al.  Wavelet coherence-based classifier: A resting-state functional MRI study on neurodynamics in adolescents with high-functioning autism , 2018, Comput. Methods Programs Biomed..

[13]  Beatrice Sbriscia-Fioretti,et al.  An integrated EEG and eye-tracking approach for the study of responding and initiating joint attention in Autism Spectrum Disorders , 2017, Scientific Reports.

[14]  Jared A. Nielsen,et al.  Functional connectivity magnetic resonance imaging classification of autism. , 2011, Brain : a journal of neurology.

[15]  Yeliz Yesilada,et al.  Detecting Autism Based on Eye-Tracking Data from Web Searching Tasks , 2018, W4A.

[16]  Marita Falkmer,et al.  The Cost of Autism Spectrum Disorders , 2014, PloS one.

[17]  Andrew Sears,et al.  The Development and Evaluation of Performance-Based Functional Assessment: A Methodology for the Measurement of Physical Capabilities , 2009, TACC.

[18]  U. Frith,et al.  The Weak Coherence Account: Detail-focused Cognitive Style in Autism Spectrum Disorders , 2006, Journal of autism and developmental disorders.

[19]  N. Hari Narayanan,et al.  Visual attention patterns during program debugging with an IDE , 2012, ETRA '12.

[20]  Yeliz Yesilada,et al.  Eye tracking scanpath analysis techniques on web pages: A survey, evaluation and comparison , 2015 .

[21]  Ridha Djemal,et al.  Electroencephalography (EEG) signal processing for epilepsy and autism spectrum disorder diagnosis , 2017 .

[22]  Yiheng Tu,et al.  Applying Eye Tracking to Identify Autism Spectrum Disorder in Children , 2018, Journal of autism and developmental disorders.

[23]  M. Falkmer,et al.  Diagnostic procedures in autism spectrum disorders: a systematic literature review , 2013, European Child & Adolescent Psychiatry.

[24]  Irina P. Temnikova,et al.  Accessible Texts for Autism: An Eye-Tracking Study , 2015, ASSETS.

[25]  S. Baron-Cohen,et al.  The Autism-Spectrum Quotient (AQ): Evidence from Asperger Syndrome/High-Functioning Autism, Malesand Females, Scientists and Mathematicians , 2001, Journal of autism and developmental disorders.

[26]  Yeliz Yesilada,et al.  Engineering web-based interactive systems: trend analysis in eye tracking scanpaths with a tolerance , 2017, EICS.

[27]  Jeffrey P. Bigham,et al.  Dytective: towards detecting dyslexia across languages using an online game , 2016, W4A.

[28]  Karrie Karahalios,et al.  Skin Conductance as an InSitu Marker for Emotional Arousal in Children with Neurodevelopmental Communication Impairments: Methodological Considerations and Clinical Implications , 2022 .

[29]  Yeliz Yesilada,et al.  It's All About the Message: Visual Experience is a Precursor to Accurate Auditory Interaction , 2019, W4A.

[30]  Yeliz Yesilada,et al.  Identifying Patterns in Eyetracking Scanpaths in Terms of Visual Elements of Web Pages , 2014, ICWE.

[31]  Charles J. Lynch,et al.  Salience network-based classification and prediction of symptom severity in children with autism. , 2013, JAMA psychiatry.

[32]  I. Hooge,et al.  Consequences of eye color, positioning, and head movement for eye-tracking data quality in infant research , 2015 .

[33]  Nikolaos M. Avouris,et al.  A cognition-centered personalization framework for cultural-heritage content , 2019, User Modeling and User-Adapted Interaction.

[34]  Sylvain Arlot,et al.  A survey of cross-validation procedures for model selection , 2009, 0907.4728.

[35]  Anne R. Haake,et al.  eyePatterns: software for identifying patterns and similarities across fixation sequences , 2006, ETRA.

[36]  Yeliz Yesilada,et al.  Web users with autism: eye tracking evidence for differences , 2018, Behav. Inf. Technol..

[37]  Irina P. Temnikova,et al.  A Corpus of Text Data and Gaze Fixations from Autistic and Non-Autistic Adults , 2016, LREC.

[38]  Meysam Asgari,et al.  Robust and accurate features for detecting and diagnosing autism spectrum disorders , 2013, INTERSPEECH.

[39]  D. Murphy,et al.  Autism in adults. New biologicial findings and their translational implications to the cost of clinical services , 2011, Brain Research.

[40]  M. Elgin Akpinar,et al.  Vision Based Page Segmentation Algorithm: Extended and Perceived Success , 2013, ICWE Workshops.

[41]  Mostafa I. Waly,et al.  Brief Report: Prevalence of Autistic Spectrum Disorders in the Sultanate of Oman , 2011, Journal of autism and developmental disorders.

[42]  Li Yi,et al.  Identifying children with autism spectrum disorder based on their face processing abnormality: A machine learning framework , 2016, Autism research : official journal of the International Society for Autism Research.

[43]  Luz Rello,et al.  Detecting readers with dyslexia using machine learning with eye tracking measures , 2015, W4A.

[44]  E. Walker,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[45]  M. Knapp,et al.  Costs of autism spectrum disorders in the United Kingdom and the United States. , 2014, JAMA pediatrics.

[46]  Sean Bechhofer,et al.  Visual complexity and aesthetic perception of web pages , 2008, SIGDOC '08.

[47]  Yeliz Yesilada,et al.  Scanpath Trend Analysis on Web Pages , 2016, ACM Trans. Web.