An Ecological Visual Exploration Tool to Support the Analysis of Visual Processing Pathways in Children with Autism Spectrum Disorders

Recent improvements in the field of assistive technologies have led to innovative solutions aiming at increasing the capabilities of people with disability, helping them in daily activities with applications that span from cognitive impairments to developmental disabilities. In particular, in the case of Autism Spectrum Disorder (ASD), the need to obtain active feedback in order to extract subsequently meaningful data becomes of fundamental importance. In this work, a study about the possibility of understanding the visual exploration in children with ASD is presented. In order to obtain an automatic evaluation, an algorithm for free (i.e., without constraints, nor using additional hardware, infrared (IR) light sources or other intrusive methods) gaze estimation is employed. Furthermore, no initial calibration is required. It allows the user to freely rotate the head in the field of view of the sensor, and it is insensitive to the presence of eyeglasses, hats or particular hairstyles. These relaxations of the constraints make this technique particularly suitable to be used in the critical context of autism, where the child is certainly not inclined to employ invasive devices, nor to collaborate during calibration procedures.The evaluation of children’s gaze trajectories through the proposed solution is presented for the purpose of an Early Start Denver Model (ESDM) program built on the child’s spontaneous interests and game choice delivered in a natural setting.

[1]  S Baron-Cohen,et al.  Psychological markers in the detection of autism in infancy in a large population. , 1996, The British journal of psychiatry : the journal of mental science.

[2]  Takeo Kanade,et al.  Computer Vision and Image Understanding Computer Vision for Assistive Technologies , 2022 .

[3]  Marc Langheinrich,et al.  Privacy by Design - Principles of Privacy-Aware Ubiquitous Systems , 2001, UbiComp.

[4]  Noah J. Sasson,et al.  Children with autism demonstrate circumscribed attention during passive viewing of complex social and nonsocial picture arrays , 2008, Autism research : official journal of the International Society for Autism Research.

[5]  Sally J. Rogers,et al.  The Early Start Denver Model , 2008 .

[6]  Giovanni Pioggia,et al.  Implementation of the Early Start Denver Model in an Italian community , 2018, Autism : the international journal of research and practice.

[7]  Jun-Hai Yong,et al.  Real-Time 3D Eye Performance Reconstruction for RGBD Cameras , 2017, IEEE Transactions on Visualization and Computer Graphics.

[8]  C. Foxcroft,et al.  The construct validity of the Griffiths Scales of Mental Development. , 2001, Child: care, health and development.

[9]  Amy L. Donaldson,et al.  Randomized, Controlled Trial of an Intervention for Toddlers With Autism: The Early Start Denver Model , 2010, Pediatrics.

[10]  A. Billard,et al.  Investigating Gaze of Children with ASD in Naturalistic Settings , 2012, PloS one.

[11]  Marc M. Sebrechts,et al.  Atypical Face Gaze in Autism , 2002, Cyberpsychology Behav. Soc. Netw..

[12]  Timothy J Heaton,et al.  Reduced visual exploration when viewing photographic scenes in individuals with autism spectrum disorder. , 2016, Journal of abnormal psychology.

[13]  Aude Billard,et al.  A wearable gaze tracking system for children in unconstrained environments , 2011, Comput. Vis. Image Underst..

[14]  B. Rogé,et al.  Visual social attention in autism spectrum disorder: Insights from eye tracking studies , 2014, Neuroscience & Biobehavioral Reviews.

[15]  B. Scassellati,et al.  Limited activity monitoring in toddlers with autism spectrum disorder , 2011, Brain Research.

[16]  Alex Pentland,et al.  Motion regularization for model-based head tracking , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[17]  Анастасия Сергеевна Кудрявцева Адаптация опросника Modified Checklist for Autism in Toddlers, Revised with Follow-Up (M-CHAT-R/F) для ранней диагностики РАС , 2017 .

[18]  Kasey C. Soska,et al.  Head-mounted eye tracking: a new method to describe infant looking. , 2011, Child development.

[19]  B. Scassellati,et al.  Autism, eye-tracking, entropy , 2008, 2008 7th IEEE International Conference on Development and Learning.

[20]  C. Hofsten,et al.  How children with autism look at events , 2009 .

[21]  Narcís Parés,et al.  Promotion of creative activity in children with severe autism through visuals in an interactive multisensory environment , 2005, IDC '05.

[22]  K. Pierce,et al.  Preference for geometric patterns early in life as a risk factor for autism. , 2011, Archives of general psychiatry.

[23]  Ouriel Grynszpan,et al.  Methods Investigating How Individuals with Autism Spectrum Disorder Spontaneously Attend to Social Events , 2017 .

[24]  Stijn De Beugher,et al.  Automatic analysis of in-the-wild mobile eye-tracking experiments using object, face and person detection , 2014, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[25]  G. Kircaali-Iftar,et al.  A comparison of the effects of providing activity and material choice to children with autism spectrum disorders. , 2010, Journal of applied behavior analysis.

[26]  J. Piven,et al.  Visual Scanning of Faces in Autism , 2002, Journal of autism and developmental disorders.

[27]  W. Stone,et al.  Predicting Social Impairment and ASD Diagnosis in Younger Siblings of Children with Autism Spectrum Disorder , 2009, Journal of autism and developmental disorders.

[28]  S. Blakemore,et al.  The application of eye‐tracking technology in the study of autism , 2007, The Journal of physiology.

[29]  G. Csibra,et al.  Gaze Following in Human Infants Depends on Communicative Signals , 2008, Current Biology.

[30]  Mark H. Johnson,et al.  Shorter spontaneous fixation durations in infants with later emerging autism , 2015, Scientific Reports.

[31]  Pierluigi Carcagnì,et al.  A low-cost and calibration-free gaze estimator for soft biometrics: An explorative study , 2016, Pattern Recognit. Lett..

[32]  Jörgen Ahlberg,et al.  CANDIDE-3 - An Updated Parameterised Face , 2001 .

[33]  P. Hancock,et al.  Looking at movies and cartoons: eye-tracking evidence from Williams syndrome and autism. , 2009, Journal of intellectual disability research : JIDR.

[34]  Ed Duncan,et al.  Effectiveness and Feasibility of the Early Start Denver Model Implemented in a Group-Based Community Childcare Setting , 2014, Journal of Autism and Developmental Disorders.

[35]  Kristen Gillespie-Lynch,et al.  Selective Visual Attention at Twelve Months: Signs of Autism in Early Social Interactions , 2011, Journal of Autism and Developmental Disorders.

[36]  Geraldine Dawson,et al.  Early Start Denver Model for Young Children with Autism: Promoting Language, Learning, and Engagement , 2009 .

[37]  Nobumasa Kato,et al.  Atypical gaze patterns in children and adults with autism spectrum disorders dissociated from developmental changes in gaze behaviour , 2010, Proceedings of the Royal Society B: Biological Sciences.

[38]  J. Elison,et al.  Eye tracking young children with autism. , 2012, Journal of visualized experiments : JoVE.

[39]  Jean-Philippe Thiran,et al.  Analysis of Head-Mounted Wireless Camera Videos for Early Diagnosis of Autism , 2008, Computer Recognition Systems 2.

[40]  Kim M. Dalton,et al.  Gaze fixation and the neural circuitry of face processing in autism , 2005, Nature Neuroscience.

[41]  P. P. Rickham HUMAN EXPERIMENTATION. CODE OF ETHICS OF THE WORLD MEDICAL ASSOCIATION. DECLARATION OF HELSINKI. , 1964, British medical journal.

[42]  Zicheng Liu,et al.  Eye gaze tracking using an RGBD camera: a comparison with a RGB solution , 2014, UbiComp Adjunct.

[43]  Simon Baron-Cohen,et al.  Perceptual role taking and protodeclarative pointing in autism , 1989 .

[44]  A. Distante,et al.  Eye detection in face images for a driver vigilance system , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[45]  Peter J. B. Hancock,et al.  Viewing it differently: Social scene perception in Williams syndrome and Autism , 2008, Neuropsychologia.

[46]  F. Volkmar,et al.  Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. , 2002, Archives of general psychiatry.

[47]  Charles A. Nelson,et al.  Eye-Tracking, Autonomic, and Electrophysiological Correlates of Emotional Face Processing in Adolescents with Autism Spectrum Disorder , 2013, Journal of autism and developmental disorders.

[48]  Christopher Gillberg,et al.  Face scanning distinguishes social from communication impairments in autism. , 2010, Developmental science.

[49]  Marcus Nyström,et al.  Pupil size influences the eye-tracker signal during saccades , 2016, Vision Research.

[50]  Joëlle Martineau,et al.  Family home movies: identification of early autistic signs in infants later diagnosed as austistics , 1991 .

[51]  Gillian R. Hayes,et al.  Designing for interaction immediacy to enhance social skills of children with autism , 2010, UbiComp.

[52]  Jing Xiao,et al.  Robust full‐motion recovery of head by dynamic templates and re‐registration techniques , 2003 .

[53]  Paul J. Besl,et al.  Method for registration of 3-D shapes , 1992, Other Conferences.

[54]  Silvia Wen-Yu Lee,et al.  A review of using eye-tracking technology in exploring learning from 2000 to 2012 , 2013 .

[55]  G. Dichter,et al.  Age Trends in Visual Exploration of Social and Nonsocial Information in Children with Autism. , 2012, Research in autism spectrum disorders.

[56]  John E Richards,et al.  The development of attention to simple and complex visual stimuli in infants: Behavioral and psychophysiological measures. , 2010, Developmental review : DR.

[57]  Meia Chita-Tegmark,et al.  Social attention in ASD: A review and meta-analysis of eye-tracking studies. , 2016, Research in developmental disabilities.

[58]  F. Curcio Sensorimotor functioning and communication in mute autistic children , 1978, Journal of autism and childhood schizophrenia.

[59]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[60]  Vassilios Morellas,et al.  A multi-sensor visual tracking system for behavior monitoring of at-risk children , 2012, 2012 IEEE International Conference on Robotics and Automation.

[61]  R. Young,et al.  Assessing the Early Characteristics of Autistic Disorder using Video Analysis , 2007, Journal of autism and developmental disorders.

[62]  James M. Rehg Behavior Imaging: Using Computer Vision to Study Autism , 2011, MVA.

[63]  Philip Brey,et al.  Freedom and Privacy in Ambient Intelligence , 2005, Ethics and Information Technology.

[64]  Enkelejda Kasneci,et al.  Pupil detection for head-mounted eye tracking in the wild: an evaluation of the state of the art , 2016, Machine Vision and Applications.

[65]  Sally Ozonoff,et al.  Atypical object exploration at 12 months of age is associated with autism in a prospective sample , 2008, Autism : the international journal of research and practice.

[66]  J. Bodfish,et al.  Evidence-Based Behavioral Interventions for Repetitive Behaviors in Autism , 2011, Journal of Autism and Developmental Disorders.

[67]  S. Nagarajan,et al.  Sensory Processing in Autism: A Review of Neurophysiologic Findings , 2011, Pediatric Research.

[68]  G. Dawson,et al.  Early social attention impairments in autism: social orienting, joint attention, and attention to distress. , 2004, Developmental psychology.

[69]  Jie Zhu,et al.  Head orientation and gaze direction in meetings , 2002, CHI Extended Abstracts.

[70]  Zicheng Liu,et al.  Real time gaze estimation with a consumer depth camera , 2015, Inf. Sci..

[71]  Rickham Pp Human Experimentation: Code of Ethics of the World Medical Association (Declaration of Helsinki). , 1964, Canadian Medical Association journal.

[72]  S Baron-Cohen,et al.  Elevated fetal steroidogenic activity in autism , 2014, Molecular Psychiatry.