A Robotic Framework to Facilitate Sensory Experiences for Children with Autism Spectrum Disorder

The diagnosis of Autism Spectrum Disorder (ASD) in children is commonly accompanied by a diagnosis of sensory processing disorders. Abnormalities are usually reported in multiple sensory processing domains, showing a higher prevalence of unusual responses, particularly to tactile, auditory, and visual stimuli. This article discusses a novel robot-based framework designed to target sensory difficulties faced by children with ASD in a controlled setting. The setup consists of a number of sensory stations, together with two different robotic agents that navigate the stations and interact with the stimuli. These stimuli are designed to resemble real-world scenarios that form a common part of one's everyday experiences. Given the strong interest of children with ASD in technology in general and robots in particular, we attempt to utilize our robotic platform to demonstrate socially acceptable responses to the stimuli in an interactive, pedagogical setting that encourages the child's social, motor, and vocal skills, while providing a diverse sensory experience. A preliminary user study was conducted to evaluate the efficacy of the proposed framework, with a total of 18 participants (5 with ASD and 13 typically developing) between the ages of 4 and 12 years. We derive a measure of social engagement, based on which we evaluate the effectiveness of the robots and sensory stations to identify key design features that can improve social engagement in children.

[1]  Judith Gould,et al.  Describing the Sensory Abnormalities of Children and Adults with Autism , 2007, Journal of autism and developmental disorders.

[2]  V. Slaughter,et al.  Social Behaviors Increase More When Children With ASD Are Imitated by Their Mother vs. an Unfamiliar Adult , 2014, Autism research : official journal of the International Society for Autism Research.

[3]  Marcelo H. Ang,et al.  Why Robots? A Survey on the Roles and Benefits of Social Robots in the Therapy of Children with Autism , 2013, International Journal of Social Robotics.

[4]  Yoko Kamio,et al.  Mirroring Effect in 2- and 3-Year-Olds with Autism Spectrum Disorder. , 2010 .

[5]  Florence D. DiGennaro Reed,et al.  Applications of technology to teach social skills to children with autism , 2011 .

[6]  Myounghoon Jeon,et al.  Development and Evaluation of Emotional Robots for Children with Autism Spectrum Disorders , 2015, HCI.

[7]  F. Muratori,et al.  The Social Effect of “Being Imitated” in Children with Autism Spectrum Disorder , 2016, Front. Psychol..

[8]  Christos K. Nikopoulos,et al.  Effects of video modeling on social initiations by children with autism. , 2004, Journal of applied behavior analysis.

[9]  Jennifer Twachtman-Reilly,et al.  Addressing feeding disorders in children on the autism spectrum in school-based settings: physiological and behavioral issues. , 2008, Language, speech, and hearing services in schools.

[10]  Paul Newland,et al.  MEDIATE: Key Sonic Developments in an Interactive Installation for Children with Autism , 2004, ICMC.

[11]  B. A. Taylor,et al.  Activity Schedules, Computer Technology, and Teaching Children With Autism Spectrum Disorders , 2006 .

[12]  Myounghoon Jeon,et al.  Robotic framework with multi-modal perception for physio-musical interactive therapy for children with autism , 2015, 2015 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob).

[13]  S. Lane,et al.  A Pilot Study Examining Activity Participation, Sensory Responsiveness, and Competence in Children with High Functioning Autism Spectrum Disorder , 2011, Journal of autism and developmental disorders.

[14]  A. Ayres Sensory integration and learning disorders , 1973 .

[15]  B. Legge Can't Eat, Won't Eat: Dietary Difficulties and Autistic Spectrum Disorders , 2002 .

[16]  Madhukar H. Trivedi,et al.  The pattern of sensory processing abnormalities in autism , 2006, Autism : the international journal of research and practice.

[17]  Claire A. G. J. Huijnen,et al.  Matching Robot KASPAR to Autism Spectrum Disorder (ASD) Therapy and Educational Goals , 2016, International Journal of Social Robotics.

[18]  Winnie Dunn,et al.  Sensory Integration and Praxis Tests: SIPT: Manual , 1991 .

[19]  S. Nagarajan,et al.  Sensory Processing in Autism: A Review of Neurophysiologic Findings , 2011, Pediatric Research.

[20]  Myounghoon Jeon,et al.  Robotic Framework for Music-Based Emotional and Social Engagement with Children with Autism , 2015, AAAI Workshop: Artificial Intelligence Applied to Assistive Technologies and Smart Environments.

[21]  Giorgio Metta,et al.  Touch sensors for humanoid hands , 2010, 19th International Symposium in Robot and Human Interactive Communication.

[22]  E. Mikkelsen,et al.  Thinking in Pictures: And Other Reports From My Life With Autism , 1996 .

[23]  Paul Newland,et al.  MEDIATE: a responsive environment designed for children with autism , 2005 .

[24]  L. LeBlanc,et al.  Use of Technology in Interventions for Children with Autism , 2004 .

[25]  Chung Hyuk Park,et al.  Interactions With an Empathetic Agent: Regulating Emotions and Improving Engagement in Autism , 2019, IEEE Robotics & Automation Magazine.

[26]  J. Nadel The Imitative Mind: Imitation and imitation recognition: Functional use in preverbal infants and nonverbal children with autism , 2002 .

[27]  M. Poe,et al.  Differential associations between sensory response patterns and language, social, and communication measures in children with autism or other developmental disabilities. , 2011, Journal of speech, language, and hearing research : JSLHR.

[28]  Michael A. Goodrich,et al.  Toward Therapist-in-the-Loop Assistive Robotics for Children with Autism and Specific Language Impairment , 2009 .

[29]  E. Ornitz,et al.  The syndrome of autism: a critical review. , 1976, The American journal of psychiatry.

[30]  Narcís Parés,et al.  Achieving dialogue with children with severe autism in an adaptive multisensory interaction: the "MEDIATE" project , 2005, IEEE Transactions on Visualization and Computer Graphics.

[31]  Peter H. Kahn,et al.  Robotic animals might aid in the social development of children with autism , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[32]  Aubyn C. Stahmer,et al.  Toward a technology of treatment individualization for young children with autism spectrum disorders , 2011, Brain Research.

[33]  Rosalind W. Picard,et al.  Affective Computing and Autism , 2006, Annals of the New York Academy of Sciences.

[34]  W. Sanefuji,et al.  Imitative behaviors facilitate communicative gaze in children with autism. , 2011, Infant mental health journal.

[35]  B. J. Myers,et al.  Parental reports on the efficacy of treatments and therapies for their children with autism spectrum disorders , 2009 .

[36]  G. Baranek,et al.  Parent reports of sensory experiences of preschool children with and without autism: a qualitative study. , 2009, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[37]  P. Ekman An argument for basic emotions , 1992 .

[38]  Sandra L. Calvert,et al.  Brief Report: Vocabulary Acquisition for Children with Autism: Teacher or Computer Instruction , 2000, Journal of autism and developmental disorders.

[39]  W. Dunn,et al.  The sensations of everyday life: empirical, theoretical, and pragmatic considerations. , 2001, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[40]  S. Baron-Cohen,et al.  Enhanced olfactory sensitivity in autism spectrum conditions , 2014, Molecular Autism.

[41]  R. Schaaf,et al.  An Intervention for Sensory Difficulties in Children with Autism: A Randomized Trial , 2013, Journal of Autism and Developmental Disorders.

[42]  J. Williams,et al.  Are Infants with Autism Socially Engaged? A Study of Recent Retrospective Parental Reports , 2000, Journal of autism and developmental disorders.

[43]  Marco Gamba,et al.  BORIS: a free, versatile open‐source event‐logging software for video/audio coding and live observations , 2016 .

[44]  A. Tapus,et al.  Children with Autism Social Engagement in Interaction with Nao, an Imitative Robot - A Series of Single Case Experiments , 2012 .

[45]  José Lozada,et al.  Tactile Emotions: A Vibrotactile Tactile Gamepad for Transmitting Emotional Messages to Children with Autism , 2012, EuroHaptics.

[46]  C. Hilton,et al.  Relationship between social competence and sensory processing in children with high functioning autism spectrum disorders , 2007 .

[47]  Kerstin Dautenhahn,et al.  Investigating tactile event recognition in child-robot interaction for use in autism therapy , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[48]  W. Prinz,et al.  The imitative mind : development, evolution, and brain bases , 2002 .

[49]  L. Primavera,et al.  Object manipulation: An interactional strategy with autistic children , 1982, Journal of autism and developmental disorders.

[50]  Myounghoon Jeon,et al.  Interactive robotic framework for multi-sensory therapy for children with autism spectrum disorder , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[51]  Kerstin Dautenhahn,et al.  Using a Humanoid Robot to Elicit Body Awareness and Appropriate Physical Interaction in Children with Autism , 2015, Int. J. Soc. Robotics.

[52]  W. Dunn,et al.  A comparison of the performance of children with and without autism on the Sensory Profile. , 1997, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[53]  L. Primavera,et al.  Imitating the autistic child: Facilitating communicative gaze behavior , 1984, Journal of autism and developmental disorders.

[54]  Jeff Sigafoos,et al.  Internet survey of treatments used by parents of children with autism. , 2006, Research in developmental disabilities.

[55]  J. Russell A circumplex model of affect. , 1980 .

[56]  S. Toth-Cohen,et al.  The everyday routines of families of children with autism , 2011, Autism : the international journal of research and practice.

[57]  Claire R. Robert Breakthroughs In Autism: An Intimate Journey , 1997, CNS Spectrums.

[58]  Terry K Koo,et al.  A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. , 2016, Journal Chiropractic Medicine.

[59]  Myounghoon Jeon,et al.  Multisensory robotic therapy to promote natural emotional interaction for children with ASD , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[60]  W. Dunn,et al.  Sensory processing in children with and without autism: a comparative study using the short sensory profile. , 2007, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[61]  Kerstin Dautenhahn,et al.  Using the Humanoid Robot KASPAR to Autonomously Play Triadic Games and Facilitate Collaborative Play Among Children With Autism , 2014, IEEE Transactions on Autonomous Mental Development.

[62]  B. Leiby,et al.  Response from Authors to Comments on “An Intervention for Sensory Difficulties in Children with Autism: A Randomized Trial” , 2014, Journal of Autism and Developmental Disorders.

[63]  Hiroshi Ishii,et al.  Design of haptic interfaces for therapy , 2009, CHI.

[64]  Danielle Ropar,et al.  Measuring the value of social engagement in adults with and without autism , 2015, Molecular Autism.

[65]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[66]  B. Ingersoll,et al.  The Social Role of Imitation in Autism: Implications for the Treatment of Imitation Deficits , 2008 .