Design, Development, and Evaluation of a Noninvasive Autonomous Robot-Mediated Joint Attention Intervention System for Young Children With ASD

Research indicates that human–robot interaction can help children with autism spectrum disorder (ASD). While most early robot-mediated interaction studies were based on free interactions, recent studies have shown that robot-mediated interventions that focus on the core impairments of ASD such as joint attention deficit tend to produce better outcomes. Joint attention impairment is one of the core deficits in ASD that has an important impact in the neuropsychological development of these children. In this paper, we propose a novel joint attention intervention system for children with ASD that overcomes several existing limitations in this domain such as the need to use body-worn sensors, nonautonomous robot operation requiring human involvement and lack of a formal model for robot-mediated joint attention interaction. We present a fully autonomous robotic system, called noncontact-responsive robot-mediated intervention system, that can infer attention through a distributed noncontact gaze inference mechanism with an embedded least-to-most (LTM) robot-mediated interaction model to address the current limitations. The system was tested in a multisession user study with 14 young children with ASD. The results showed that participants’ joint attention skills improved significantly, their interest in the robot remained consistent throughout the sessions, and the LTM interaction model was effective in promoting the children's performance.

[1]  C. Lord,et al.  Autism Diagnostic Observation Schedule , 2016 .

[2]  Kerstin Dautenhahn,et al.  Developing Play Scenarios for Tactile Interaction with a Humanoid Robot: A Case Study Exploration with Children with Autism , 2010, ICSR.

[3]  N. Sarkar,et al.  A Step Towards Developing Adaptive Robot-Mediated Intervention Architecture (ARIA) for Children With Autism , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[4]  Nilanjan Sarkar,et al.  Autonomous robot-mediated imitation learning for children with autism , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Zachary Warren,et al.  Best Practices: Early Diagnosis and Psychological Assessment , 2011 .

[6]  Brian Scassellati,et al.  Robots for social skills therapy in autism: evidence and designs toward clinical utility , 2013 .

[7]  Brian Scassellati,et al.  The Oz of Wizard: Simulating the human for interaction research , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[8]  B. Leventhal,et al.  The social responsiveness scale in relation to DSM IV and DSM5 ASD in Korean children , 2016, Autism research : official journal of the International Society for Autism Research.

[9]  John O. Willis,et al.  Mullen Scales of Early Learning: Ags Edition , 2008 .

[10]  M. Chetouani,et al.  How children with autism spectrum disorder behave and explore the 4-dimensional (spatial 3D + time) environment during a joint attention induction task with a robot , 2014 .

[11]  David Harel,et al.  Statecharts: A Visual Formalism for Complex Systems , 1987, Sci. Comput. Program..

[12]  Fernando De la Torre,et al.  Supervised Descent Method for Solving Nonlinear Least Squares Problems in Computer Vision , 2014, ArXiv.

[13]  Kerstin Dautenhahn,et al.  A Pilot Study with a Novel Setup for Collaborative Play of the Humanoid Robot KASPAR with Children with Autism , 2014, Int. J. Soc. Robotics.

[14]  Maja J. Mataric,et al.  Toward Socially Assistive Robotics for Augmenting Interventions for Children with Autism Spectrum Disorders , 2008, ISER.

[15]  Marcelo H. Ang,et al.  Why Robots? A Survey on the Roles and Benefits of Social Robots in the Therapy of Children with Autism , 2013, International Journal of Social Robotics.

[16]  Marek P. Michalowski,et al.  Keepon , 2009, Int. J. Soc. Robotics.

[17]  Kerstin Dautenhahn,et al.  Using the Humanoid Robot KASPAR to Autonomously Play Triadic Games and Facilitate Collaborative Play Among Children With Autism , 2014, IEEE Transactions on Autonomous Mental Development.

[18]  Judith Gould,et al.  Describing the Sensory Abnormalities of Children and Adults with Autism , 2007, Journal of autism and developmental disorders.

[19]  N. Sarkar,et al.  Can Robotic Interaction Improve Joint Attention Skills? , 2015, Journal of autism and developmental disorders.

[20]  Maureen S. Durkin,et al.  Prevalence and Characteristics of Autism Spectrum Disorder Among Children Aged 8 Years — Autism and Developmental Disabilities Monitoring Network, 11 Sites, United States, 2012 , 2018, Morbidity and mortality weekly report. Surveillance summaries.

[21]  H. Kozima,et al.  Children-robot interaction: a pilot study in autism therapy. , 2007, Progress in brain research.

[22]  Chrystopher L. Nehaniv,et al.  Title of paper : KASPAR – A Minimally Expressive Humanoid Robot for Human-Robot Interaction Research , 2009 .

[23]  L. Billeci,et al.  Autism and social robotics: A systematic review , 2016, Autism research : official journal of the International Society for Autism Research.

[24]  Elizabeth S. Kim,et al.  Social Robots as Embedded Reinforcers of Social Behavior in Children with Autism , 2012, Journal of Autism and Developmental Disorders.

[25]  Catherine Lord,et al.  The Social Communication Questionnaire Manual , 2003 .

[26]  Qiang Fu,et al.  Design of a Computer-Assisted System for Teaching Attentional Skills to Toddlers with ASD , 2015, HCI.

[27]  Nilanjan Sarkar,et al.  Robot-Mediated Imitation Skill Training for Children With Autism , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[28]  M. Sigman,et al.  Continuity and change in the social competence of children with autism, Down syndrome, and developmental delays. , 1999, Monographs of the Society for Research in Child Development.

[29]  Maja J. Matarić,et al.  A Simon-Says Robot Providing Autonomous Imitation Feedback Using Graded Cueing , 2012 .

[30]  B. Robins,et al.  Does appearance matter in the interaction of children with autism with a humanoid robot , 2006 .

[31]  Stacie L. Bancroft,et al.  A Comparison of Most-to-Least and Least-to-Most Prompting on the Acquisition of Solitary Play Skills , 2008, Behavior analysis in practice.

[32]  E. Barakova,et al.  Promoting question-asking in school-aged children with autism spectrum disorders: Effectiveness of a robot intervention compared to a human-trainer intervention , 2013, Developmental neurorehabilitation.

[33]  Maja J. Mataric,et al.  Graded cueing feedback in robot-mediated imitation practice for children with autism spectrum disorders , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[34]  P. Mundy,et al.  A longitudinal study of joint attention and language development in autistic children , 1990, Journal of autism and developmental disorders.

[35]  Nilanjan Sarkar,et al.  Impact of robot-mediated interaction system on joint attention skills for children with autism , 2013, 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR).

[36]  Emilia I. Barakova,et al.  Designing robot-assisted Pivotal Response Training in game activity for children with autism , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[37]  Deborah F. Deckner,et al.  Joint Engagement and the Emergence of Language in Children with Autism and Down Syndrome , 2009, Journal of autism and developmental disorders.

[38]  P. Mundy,et al.  Individual differences and the development of joint attention in infancy. , 2007, Child development.

[39]  Edward A. Lee,et al.  Introduction to Embedded Systems - A Cyber-Physical Systems Approach , 2013 .