Feasibility of an Autism-Focused Augmented Reality Smartglasses System for Social Communication and Behavioral Coaching

Background Autism spectrum disorder (ASD) is a childhood-onset neurodevelopmental disorder with a rapidly rising prevalence, currently affecting 1 in 68 children, and over 3.5 million people in the United States. Current ASD interventions are primarily based on in-person behavioral therapies that are both costly and difficult to access. These interventions aim to address some of the fundamental deficits that clinically characterize ASD, including deficits in social communication, and the presence of stereotypies, and other autism-related behaviors. Current diagnostic and therapeutic approaches seldom rely on quantitative data measures of symptomatology, severity, or condition trajectory. Methods Given the current situation, we report on the Brain Power System (BPS), a digital behavioral aid with quantitative data gathering and reporting features. The BPS includes customized smartglasses, providing targeted personalized coaching experiences through a family of gamified augmented-reality applications utilizing artificial intelligence. These applications provide children and adults with coaching for emotion recognition, face directed gaze, eye contact, and behavioral self-regulation. This preliminary case report, part of a larger set of upcoming research reports, explores the feasibility of the BPS to provide coaching in two boys with clinically diagnosed ASD, aged 8 and 9 years. Results The coaching intervention was found to be well tolerated and rated as being both engaging and fun. Both males could easily use the system, and no technical problems were noted. During the intervention, caregivers reported improved non-verbal communication, eye contact, and social engagement during the intervention. Both boys demonstrated decreased symptoms of ASD, as measured by the aberrant behavior checklist at 24-h post-intervention. Specifically, both cases demonstrated improvements in irritability, lethargy, stereotypy, hyperactivity/non-compliance, and inappropriate speech. Conclusion Smartglasses using augmented reality may have an important future role in helping address the therapeutic needs of children with ASD. Quantitative data gathering from such sensor-rich systems may allow for digital phenotyping and the refinement of social communication constructs of the research domain criteria. This report provides evidence for the feasibility, usability, and tolerability of one such specialized smartglasses system.

[1]  Angel Fettig,et al.  Evidence-Based Practices for Children, Youth, and Young Adults with Autism Spectrum Disorder: A Comprehensive Review , 2015, Journal of autism and developmental disorders.

[2]  H. Shane,et al.  Electronic Screen Media for Persons with Autism Spectrum Disorders: Results of a Survey , 2008, Journal of autism and developmental disorders.

[3]  Catherine Lord,et al.  The Social Communication Questionnaire Manual , 2003 .

[4]  R. Forsyth More than a name change , 2007 .

[5]  H. Faras,et al.  Autism spectrum disorders , 2010, Annals of Saudi medicine.

[6]  Nim Tottenham,et al.  Elevated amygdala response to faces and gaze aversion in autism spectrum disorder. , 2014, Social cognitive and affective neuroscience.

[7]  S. Calhoun,et al.  Analysis of WISC-III, Stanford-Binet:IV, and Academic Achievement Test Scores in Children with Autism , 2003, Journal of autism and developmental disorders.

[8]  Cristián Zegers Ariztía,et al.  Manual , 2002 .

[9]  James W Tanaka,et al.  Using computerized games to teach face recognition skills to children with autism spectrum disorder: the Let's Face It! program. , 2010, Journal of child psychology and psychiatry, and allied disciplines.

[10]  K. Puura,et al.  Autonomic Arousal to Direct Gaze Correlates with Social Impairments Among Children with ASD , 2012, Journal of Autism and Developmental Disorders.

[11]  M. Weinstein,et al.  Economic Burden of Childhood Autism Spectrum Disorders , 2012, Pediatrics.

[12]  Lizbeth Escobedo,et al.  MOSOCO: a mobile assistive tool to support children with autism practicing social skills in real-life situations , 2012, CHI.

[13]  Elina Birmingham,et al.  Are emotion recognition abilities related to everyday social functioning in ASD? A meta-analysis , 2016 .

[14]  D. Skuse,et al.  Avoidance of emotionally arousing stimuli predicts social–perceptual impairment in Asperger's syndrome , 2008, Neuropsychologia.

[15]  Melissa A. Thomeczek,et al.  iPad® use in children and young adults with Autism Spectrum Disorder: An observational study , 2014 .

[16]  K. D. Allen,et al.  Evaluation of two instruction methods to increase employment options for young adults with autism spectrum disorders. , 2010, Research in developmental disabilities.

[17]  Kevin M. Ayres,et al.  Acquisition and Generalization of Chained Tasks Taught with Computer Based Video Instruction to Children with Autism. , 2009 .

[18]  Geraint Rees,et al.  Perception and Processing of Faces in the Human Brain Is Tuned to Typical Feature Locations , 2016, The Journal of Neuroscience.

[19]  Somer Bishop,et al.  Sex and gender differences in autism spectrum disorder: summarizing evidence gaps and identifying emerging areas of priority , 2015, Molecular Autism.

[20]  F. Volkmar,et al.  Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. , 2002, Archives of general psychiatry.

[21]  B. Ingersoll,et al.  The use of innovative computer technology for teaching social communication to individuals with autism spectrum disorders , 2011 .

[22]  Sven Bölte,et al.  Emotion recognition training in autism spectrum disorder: A systematic review of challenges related to generalizability , 2018, Developmental neurorehabilitation.

[23]  J. Tanaka,et al.  The “Eye Avoidance” Hypothesis of Autism Face Processing , 2016, Journal of autism and developmental disorders.

[24]  M. O'Reilly,et al.  Use of Computer-Based Interventions to Teach Communication Skills to Children with Autism Spectrum Disorders: A Systematic Review , 2011 .

[25]  Peter J. B. Hancock,et al.  Viewing it differently: Social scene perception in Williams syndrome and Autism , 2008, Neuropsychologia.

[26]  anonymous,et al.  Comprehensive review , 2019 .

[27]  G. Baird,et al.  Validation of the social communication questionnaire in a population cohort of children with autism spectrum disorders. , 2007, Journal of the American Academy of Child and Adolescent Psychiatry.

[28]  T. Colibazzi,et al.  Journal Watch review of Research domain criteria (RDoC) , 2014, Journal of the American Psychoanalytic Association.

[29]  Daniel McDuff,et al.  AFFDEX SDK: A Cross-Platform Real-Time Multi-Face Expression Recognition Toolkit , 2016, CHI Extended Abstracts.

[30]  Julie L. Thompson,et al.  Technology-Aided Interventions and Instruction for Adolescents with Autism Spectrum Disorder , 2014, Journal of Autism and Developmental Disorders.

[31]  M. Aman,et al.  The aberrant behavior checklist: a behavior rating scale for the assessment of treatment effects. , 1985, American journal of mental deficiency.

[32]  A. R.,et al.  Review of literature , 1969, American Potato Journal.

[33]  C. Rice,et al.  Service and Treatment Use Among Children Diagnosed With Autism Spectrum Disorders , 2015, Journal of developmental and behavioral pediatrics : JDBP.

[34]  M. O'Reilly,et al.  Computer-based interventions to improve social and emotional skills in individuals with autism spectrum disorders: A systematic review , 2012, Developmental neurorehabilitation.

[35]  R. Pennington Computer-Assisted Instruction for Teaching Academic Skills to Students With Autism Spectrum Disorders: A Review of Literature , 2010 .

[36]  Warren Jones,et al.  Mechanisms of Diminished Attention to Eyes in Autism. , 2017, The American journal of psychiatry.

[37]  António Ramires Fernandes,et al.  STAR: Speech Therapy with Augmented Reality for Children with Autism Spectrum Disorders , 2014, ICEIS.

[38]  Ralf W. Schlosser,et al.  Is There a Role for Speech Output in Interventions for Persons with Autism? , 2001 .

[39]  A POMBAL,et al.  [Results of a survey]. , 1955, Jornal do medico.

[40]  Lizbeth Escobedo,et al.  Using Augmented Reality to Help Children with Autism Stay Focused , 2014, IEEE Pervasive Computing.

[41]  M. Knapp,et al.  Costs of autism spectrum disorders in the United Kingdom and the United States. , 2014, JAMA pediatrics.

[42]  M. O'Reilly,et al.  Use of Computer-Based Interventions to Promote Daily Living Skills in Individuals with Intellectual Disabilities: A Systematic Review , 2011, Journal of Developmental and Physical Disabilities.

[43]  P. Ekman Facial expressions of emotion: an old controversy and new findings. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[44]  Z. Warren,et al.  Prevalence of Autism Spectrum Disorder Among Children Aged 8 Years — Autism and Developmental Disabilities Monitoring Network, 11 Sites, United States, 2014 , 2018, Morbidity and mortality weekly report. Surveillance summaries.

[45]  E. Mohammadi,et al.  Barriers and facilitators related to the implementation of a physiological track and trigger system: A systematic review of the qualitative evidence , 2017, International journal for quality in health care : journal of the International Society for Quality in Health Care.