Towards Computer Aided Diagnosis of Autism Spectrum Disorder Using Virtual Environments

Autism Spectrum Disorders (ASD) are neurodevelopmental disorders that are associated with characteristic difficulties to express and interpret nonverbal behavior, such as social gaze behavior. The state of the art in diagnosis is the clinical interview that is time intensive for the clinicians and does not take into account any objective measures of behavior. We herewith propose an empirical approach that can potentially support diagnosis based on the assessment of nonverbal behavior in avatar-mediated interactions in virtual environments. In a first study, ASD individuals and a typically developed control group were interacting in dyads. Head motion, and eye gaze of both interlocutors were recorded, replicated to the avatars and displayed to the partner through a distributed virtual environment. The nonverbal behavior of both interaction partners was recorded, and resulting preprocessed data was classified with up to 92.9parcent classification accuracy, with the amount of eye area focus and the average horizontal gaze change being the most relevant features. We expect that such systems could improve the diagnostic assessment on the basis of objective measures of nonverbal behavior.

[1]  Marc Erich Latoschik,et al.  Construction of the Virtual Embodiment Questionnaire (VEQ) , 2020, IEEE Transactions on Visualization and Computer Graphics.

[2]  Z. Warren,et al.  Prevalence of Autism Spectrum Disorder Among Children Aged 8 Years — Autism and Developmental Disabilities Monitoring Network, 11 Sites, United States, 2016 , 2020, Morbidity and mortality weekly report. Surveillance summaries.

[3]  T. Scheffer,et al.  Towards the automatic detection of social biomarkers in autism spectrum disorder: introducing the simulated interaction task (SIT) , 2020, npj Digital Medicine.

[4]  Kai Vogeley,et al.  Machine Learning to Study Social Interaction Difficulties in ASD , 2019, Front. Robot. AI.

[5]  Marc Erich Latoschik,et al.  Technologies for Social Augmentations in User-Embodied Virtual Reality , 2019, VRST.

[6]  Gary Bente,et al.  Introducing ACASS: An Annotated Character Animation Stimulus Set for Controlled (e)Motion Perception Studies , 2019, Front. Robot. AI.

[7]  G. Bente,et al.  Ambiguous Bodies: The Role of Displayed Arousal in Emotion [Mis]Perception , 2019, Journal of Nonverbal Behavior.

[8]  J. McGonigle,et al.  Examining the Diagnostic Validity of Autism Measures Among Adults in an Outpatient Clinic Sample. , 2019, Autism in adulthood : challenges and management.

[9]  Marc Erich Latoschik,et al.  Effects of Hybrid and Synthetic Social Gaze in Avatar-Mediated Interactions , 2018, 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct).

[10]  T. Brugha,et al.  Anxiety and depression in adults with autism spectrum disorder: a systematic review and meta-analysis , 2018, Psychological Medicine.

[11]  Carol Schall,et al.  Employees with Autism Spectrum Disorder Achieving Long-Term Employment Success: A Retrospective Review of Employment Retention and Intervention , 2018, Research and Practice for Persons with Severe Disabilities.

[12]  Z. Warren,et al.  Prevalence of autism spectrum disorder among children aged 8 years - autism and developmental disabilities monitoring network, 11 sites, United States, 2010. , 2014, Morbidity and mortality weekly report. Surveillance summaries.

[13]  Yeliz Yesilada,et al.  Detecting Autism Based on Eye-Tracking Data from Web Searching Tasks , 2018, W4A.

[14]  Qi Zhao,et al.  Learning Visual Attention to Identify People with Autism Spectrum Disorder , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[15]  Eric W. Klingemier,et al.  A Meta-Analysis of Gaze Differences to Social and Nonsocial Information Between Individuals With and Without Autism. , 2017, Journal of the American Academy of Child and Adolescent Psychiatry.

[16]  Marc Erich Latoschik,et al.  Socially immersive avatar-based communication , 2017, 2017 IEEE Virtual Reality (VR).

[17]  Marc Erich Latoschik,et al.  Breaking bad behavior: immersive training of class room management , 2016, VRST.

[18]  Soo Youn Oh,et al.  Let the Avatar Brighten Your Smile: Effects of Enhancing Facial Expressions in Virtual Environments , 2016, PloS one.

[19]  Meia Chita-Tegmark,et al.  Social attention in ASD: A review and meta-analysis of eye-tracking studies. , 2016, Research in developmental disabilities.

[20]  Marc Erich Latoschik,et al.  Hybrid Avatar-Agent Technology – A Conceptual Step Towards Mediated “Social” Virtual Reality and its Respective Challenges , 2015, i-com.

[21]  Paolo Perego,et al.  Use of Machine Learning to Identify Children with Autism and Their Motor Abnormalities , 2015, Journal of autism and developmental disorders.

[22]  K. Vogeley,et al.  The Use of Virtual Characters to Assess and Train Non-Verbal Communication in High-Functioning Autism , 2014, Front. Hum. Neurosci..

[23]  B. Rogé,et al.  Visual social attention in autism spectrum disorder: Insights from eye tracking studies , 2014, Neuroscience & Biobehavioral Reviews.

[24]  Katherine E Henson,et al.  Risk of Suicide After Cancer Diagnosis in England , 2018, JAMA psychiatry.

[25]  Patricia Howlin,et al.  Social disadvantage and exclusion: adults with autism lag far behind in employment prospects. , 2013, Journal of the American Academy of Child and Adolescent Psychiatry.

[26]  K. Vogeley,et al.  Toward a second-person neuroscience 1 , 2013, Behavioral and Brain Sciences.

[27]  A. Billard,et al.  Investigating Gaze of Children with ASD in Naturalistic Settings , 2012, PloS one.

[28]  Erik Steinmetz,et al.  Processing of Eye/Head-Tracking Data in Large-Scale Naturalistic Driving Data Sets , 2012, IEEE Transactions on Intelligent Transportation Systems.

[29]  Kenneth Holmqvist,et al.  Eye tracking: a comprehensive guide to methods and measures , 2011 .

[30]  Daniel C. Richardson,et al.  The Role of Alexithymia in Reduced Eye-Fixation in Autism Spectrum Conditions , 2011, Journal of autism and developmental disorders.

[31]  Claes von Hofsten,et al.  How special is social looking in ASD: a review. , 2011, Progress in brain research.

[32]  Inge-Marie Eigsti,et al.  Conversational gestures in autism spectrum disorders: Asynchrony but not decreased frequency , 2010, Autism research : official journal of the International Society for Autism Research.

[33]  Kai Vogeley,et al.  "Artificial humans": Psychology and neuroscience perspectives on embodiment and nonverbal communication , 2010, Neural Networks.

[34]  Peter J. B. Hancock,et al.  Viewing it differently: Social scene perception in Williams syndrome and Autism , 2008, Neuropsychologia.

[35]  G. Bente,et al.  Avatar-Mediated Networking: Increasing Social Presence and Interpersonal Trust in Net-Based Collaborations , 2008 .

[36]  J. Piven,et al.  Looking you in the mouth: abnormal gaze in autism resulting from impaired top-down modulation of visual attention. , 2006, Social cognitive and affective neuroscience.

[37]  Jon Baio,et al.  Examination of the Time Between First Evaluation and First Autism Spectrum Diagnosis in a Population-based Sample , 2006, Journal of developmental and behavioral pediatrics : JDBP.

[38]  A. Senju,et al.  Does perceived direct gaze boost detection in adults and children with and without autism? The stare-in-the-crowd effect revisited , 2005 .

[39]  C. Corsello,et al.  Early Intervention in Autism , 2005 .

[40]  Nalini Ambady,et al.  The Glimpsed World: Unintended Communication and Unintended Perception , 2005 .

[41]  M. Smith.  Reading people. , 2003, Emergency medical services.

[42]  F. Volkmar,et al.  Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. , 2002, Archives of general psychiatry.

[43]  J. Piven,et al.  Visual Scanning of Faces in Autism , 2002, Journal of autism and developmental disorders.

[44]  P. Bolton,et al.  The CAST (Childhood Asperger Syndrome Test) , 2002, Autism : the international journal of research and practice.

[45]  S. Baron-Cohen,et al.  The Autism-Spectrum Quotient (AQ): Evidence from Asperger Syndrome/High-Functioning Autism, Malesand Females, Scientists and Mathematicians , 2001, Journal of autism and developmental disorders.

[46]  S. Baron-Cohen,et al.  Is There a "Language of the Eyes"? Evidence from Normal Adults, and Adults with Autism or Asperger Syndrome , 1997 .

[47]  J. Burgoon,et al.  Nonverbal Communication: The Unspoken Dialogue , 1988 .