An Adaptive Multi-Robot Therapy for Improving Joint Attention and Imitation of ASD Children

Robot-mediated therapies for autism spectrum disorder (ASD) have shown promising results in the past. We have proposed a novel mathematical model based on an adaptive multi-robot therapy of ASD children focusing on two main impairments in autism: 1) joint attention and 2) imitation. Joint attention intervention is based on three different least-to-most (LTM) cues, whereas the adaptive imitation module uses joint attention for activation of the robot. The proposed model uses a multi-robot system as a therapist without any external stimuli (from the environment) to improve the skills of the ASD child. Another novel aspect of this paper is the deployment of a multi-robot system for introducing the ASD child to the concept of multi-person communication. This is particularly useful as, unlike humans, robots can be more consistent and relatively immune to fatigue. Two different therapies of human–robot interaction (i.e., with and without inter-robot communication) have been conducted. The model has been tested on 12 ASD children, eight sessions for each intervention over a period of six months. The effectiveness of the model is validated by analyzing the cognitive state of the brain before and after the intervention with electroencephalogram (EEG) neuroheadsets. Moreover, results obtained using the childhood autism rating scale (CARS) to measure the effectiveness of therapy also support the conclusions firmly. The statistical results with the p-value = 3.79E-07 < 0.05 and the F value = 23.93>3.28 show reliability and significance of the data. The results strongly indicate significant improvements in both modules, along with a notable improvement in multi-communication skills of the participating children.

[1]  Nilanjan Sarkar,et al.  Robot-Mediated Imitation Skill Training for Children With Autism , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[2]  A. Taheri,et al.  Clinical Application of Humanoid Robots in Playing Imitation Games for Autistic Children in Iran , 2015 .

[3]  Gang Chen,et al.  Control architecture design for intelligent robot assisted intervention for children with autism , 2016, 2016 IEEE 11th Conference on Industrial Electronics and Applications (ICIEA).

[4]  Beatrice Sbriscia-Fioretti,et al.  An integrated EEG and eye-tracking approach for the study of responding and initiating joint attention in Autism Spectrum Disorders , 2017, Scientific Reports.

[5]  Maureen S. Durkin,et al.  Prevalence and Characteristics of Autism Spectrum Disorder Among 4-Year-Old Children in the Autism and Developmental Disabilities Monitoring Network , 2016, Journal of developmental and behavioral pediatrics : JDBP.

[6]  Björn W. Schuller,et al.  Measuring Engagement in Robot-Assisted Autism Therapy: A Cross-Cultural Study , 2017, Front. Robot. AI.

[7]  Maja J. Mataric,et al.  Graded cueing feedback in robot-mediated imitation practice for children with autism spectrum disorders , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[8]  Zdenko Kovacic,et al.  POMDP-Based Coding of Child-Robot Interaction within a Robot-Assisted ASD Diagnostic Protocol , 2018, Int. J. Humanoid Robotics.

[9]  Brian Scassellati,et al.  Quantitative metrics of social response for autism diagnosis , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[10]  Shaun M Eack,et al.  Cognitive Enhancement Therapy for Adults with Autism Spectrum Disorder: Results of an 18-month Feasibility Study , 2013, Journal of autism and developmental disorders.

[11]  M. R. Bhutta,et al.  Classification of prefrontal and motor cortex activities for development of three-class fNIRS-BCI , 2014 .

[12]  Elizabeth S. Kim,et al.  Social Robots as Embedded Reinforcers of Social Behavior in Children with Autism , 2012, Journal of Autism and Developmental Disorders.

[13]  Yuichiro Yoshikawa,et al.  Impressions of Humanness for Android Robot may Represent an Endophenotype for Autism Spectrum Disorders , 2017, Journal of Autism and Developmental Disorders.

[14]  C. Lord,et al.  Autism Diagnostic Observation Schedule , 2016 .

[15]  Holly A. Yanco,et al.  Are Robots Ready to Deliver Autism Interventions? A Comprehensive Review , 2016, International Journal of Social Robotics.

[16]  Yukiko Kikuchi,et al.  Mind perception and moral judgment in autism , 2018, Autism research : official journal of the International Society for Autism Research.

[17]  Maja J. Matarić,et al.  A Simon-Says Robot Providing Autonomous Imitation Feedback Using Graded Cueing , 2012 .

[18]  B. Robins,et al.  Does appearance matter in the interaction of children with autism with a humanoid robot , 2006 .

[19]  P. Mundy,et al.  Individual differences in joint attention skill development in the second year , 1998 .

[20]  Stacie L. Bancroft,et al.  A Comparison of Most-to-Least and Least-to-Most Prompting on the Acquisition of Solitary Play Skills , 2008, Behavior analysis in practice.

[21]  Maja J. Matarić,et al.  Using proxemics to evaluate human-robot interaction , 2010, HRI 2010.

[22]  E. Barakova,et al.  Promoting question-asking in school-aged children with autism spectrum disorders: Effectiveness of a robot intervention compared to a human-trainer intervention , 2013, Developmental neurorehabilitation.

[23]  Nilanjan Sarkar,et al.  Design, Development, and Evaluation of a Noninvasive Autonomous Robot-Mediated Joint Attention Intervention System for Young Children With ASD , 2018, IEEE Transactions on Human-Machine Systems.

[24]  Brian Scassellati,et al.  Bridging the research gap , 2012, HRI 2012.

[25]  Jane McGillivray,et al.  Parenting a child with an autism spectrum disorder: a review of parent mental health and its relationship to a trauma-based conceptualisation , 2017 .

[26]  Marek P. Michalowski,et al.  Keepon , 2009, Int. J. Soc. Robotics.

[27]  Zdenko Kovacic,et al.  Four tasks of a robot-assisted autism spectrum disorder diagnostic protocol: First clinical tests , 2014, IEEE Global Humanitarian Technology Conference (GHTC 2014).

[28]  P. Mundy Joint attention and social-emotional approach behavior in children with autism , 1995, Development and Psychopathology.

[29]  Qingxuan Jia,et al.  Engagement Evaluation for Autism Intervention by Robots Based on Dynamic Bayesian Network and Expert Elicitation , 2017, IEEE Access.

[30]  B. Scassellati,et al.  Robots for use in autism research. , 2012, Annual review of biomedical engineering.

[31]  Goro Obinata,et al.  Which Robot Features Can Stimulate Better Responses from Children with Autism in Robot-Assisted Therapy?: , 2012 .

[32]  Dennis W. Moore,et al.  Mindfulness in Individuals with Autism Spectrum Disorder: a Systematic Review and Narrative Analysis , 2016 .

[33]  Lauren M. Schmitt,et al.  The Clinical Use of Robots for Individuals with Autism Spectrum Disorders: A Critical Review. , 2012, Research in autism spectrum disorders.

[34]  N. Sarkar,et al.  A Step Towards Developing Adaptive Robot-Mediated Intervention Architecture (ARIA) for Children With Autism , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[35]  Kerstin Dautenhahn,et al.  Using the Humanoid Robot KASPAR to Autonomously Play Triadic Games and Facilitate Collaborative Play Among Children With Autism , 2014, IEEE Transactions on Autonomous Mental Development.

[36]  Tohru Matsumoto,et al.  Mimicking and Evaluating Human Motion to Improve the Imitation Skill of Children with Autism Through a Robot , 2011, Int. J. Soc. Robotics.

[37]  P. Dumouchel,et al.  Anthropomorphism in Human–Robot Co-evolution , 2018, Front. Psychol..

[38]  Yasar Ayaz,et al.  Interactive Therapy Approach Through Collaborative Physical Play Between a Socially Assistive Humanoid Robot and Children with Autism Spectrum Disorder , 2016, ICSR.

[39]  H. Kozima,et al.  Children-robot interaction: a pilot study in autism therapy. , 2007, Progress in brain research.

[40]  Chrystopher L. Nehaniv,et al.  Title of paper : KASPAR – A Minimally Expressive Humanoid Robot for Human-Robot Interaction Research , 2009 .

[41]  L. Billeci,et al.  Autism and social robotics: A systematic review , 2016, Autism research : official journal of the International Society for Autism Research.