A Wearable Social Interaction Aid for Children with Autism

Over 1 million children under the age of 17 in the US have been identified with Autism Spectrum Disorder (ASD). These children struggle to recognize facial expressions, make eye contact, and engage in social interactions. Gaining these skills requires intensive behavioral interventions that are often expensive, difficult to access, and inconsistently administered.nWe have developed a system to automate facial expression recognition that runs on wearable glasses and delivers real time social cues, with the goal of creating a behavioral aid for children with ASD that maximizes behavioral feedback while minimizing the distractions to the child. This paper describes the design of our system and interface decisions resulting from initial observations gathered during multiple preliminary trials.

[1]  Z. Warren,et al.  Prevalence of autism spectrum disorder among children aged 8 years - autism and developmental disabilities monitoring network, 11 sites, United States, 2010. , 2014, Morbidity and mortality weekly report. Surveillance summaries.

[2]  Vanessa Lobue,et al.  The Child Affective Facial Expression (CAFE) set: validity and reliability from untrained adults , 2014, Front. Psychol..

[3]  Z. Warren,et al.  Prevalence of Autism Spectrum Disorder Among Children Aged 8 Years — Autism and Developmental Disabilities Monitoring Network, 11 Sites, United States, 2014 , 2018, Morbidity and mortality weekly report. Surveillance summaries.

[4]  Brenda Smith Myles,et al.  Sensory Issues in Children with Asperger Syndrome and Autism , 2004 .

[5]  O. I. Lovaas,et al.  Teaching Individuals With Developmental Delays: Basic Intervention Techniques , 2002 .

[6]  Jennifer C. Sarrett,et al.  Commentary: Attention to Eyes Is Present but in Decline in 2–6-Month-Old Infants Later Diagnosed with Autism , 2015, Front. Public Health.

[7]  J. Elison,et al.  Eye tracking young children with autism. , 2012, Journal of visualized experiments : JoVE.

[8]  Peter Washington,et al.  Superpower glass: delivering unobtrusive real-time social cues in wearable systems , 2016, UbiComp Adjunct.

[9]  Peter Washington,et al.  SuperpowerGlass , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[10]  G. Dawson Early behavioral intervention, brain plasticity, and the prevention of autism spectrum disorder , 2008, Development and Psychopathology.

[11]  Maureen S. Durkin,et al.  Prevalence and Characteristics of Autism Spectrum Disorder Among 4-Year-Old Children in the Autism and Developmental Disabilities Monitoring Network , 2016, Journal of developmental and behavioral pediatrics : JDBP.

[12]  Terry Winograd,et al.  A practical approach to real-time neutral feature subtraction for facial expression recognition , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[13]  Takeo Kanade,et al.  The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[14]  Laura Addison,et al.  A rapid assessment of skills in young children with autism. , 2004, Journal of applied behavior analysis.

[15]  M. Silver,et al.  Evaluation of a New Computer Intervention to Teach People with Autism or Asperger Syndrome to Recognize and Predict Emotions in Others , 2001, Autism : the international journal of research and practice.

[16]  Haber Nick,et al.  Well-being Computing: A Wearable Social Interaction Aid for Children with Autism , 2017 .

[17]  P. Valdez,et al.  Effects of color on emotions. , 1994, Journal of experimental psychology. General.

[18]  O. Hetzroni,et al.  Effects of a Computer-Based Intervention Program on the Communicative Functions of Children with Autism , 2004, Journal of autism and developmental disorders.

[19]  Aubyn C. Stahmer,et al.  Naturalistic Developmental Behavioral Interventions: Empirically Validated Treatments for Autism Spectrum Disorder , 2015, Journal of Autism and Developmental Disorders.

[20]  D. Massaro,et al.  Development and Evaluation of a Computer-Animated Tutor for Vocabulary and Language Learning in Children with Autism , 2003, Journal of autism and developmental disorders.

[21]  Elizabeth Garrett-Mayer,et al.  Social and communication development in toddlers with early and later diagnosis of autism spectrum disorders. , 2007, Archives of general psychiatry.

[22]  Matthew S. Goodwin,et al.  Technology for just-in-time in-situ learning of facial affect for persons diagnosed with an autism spectrum disorder , 2008, Assets '08.

[23]  Peter Washington,et al.  5.13 Design and Efficacy of a Wearable Device for Social Affective Learning in Children With Autism , 2017 .