Personalized Robot Interventions for Autistic Children: An Automated Methodology for Attention Assessment

We propose a robot-mediated therapy and assessment system for children with autism spectrum disorder (ASD) of mild to moderate severity and minimal verbal capabilities. The objectives of the robot interaction sessions is to improve the academic capabilities of ASD patients by increasing the length and the quality of their attention. The system uses a NAO robot and an added mobile display to present emotional cues and solicit appropriate emotional responses. The interaction is semi-autonomous with minimal human intervention. Interaction occurs within an adaptive dynamic scenario composed of 13 sections. The scenario allows adaptive customization based on the attention score history of each patient. The attention score is autonomously generated by the system and depends on face attention and joint attention cues and sound responses. The scoring system allows us to prove that the customized interaction system increases the engagement and attention capabilities of ASD patients. After performing a pilot study, involving 6 ASD children, out of a total of 11 considered in the clinical setup, we conducted a long-term study. This study empirically proves that the proposed assessment system represents the attention state of the patient with 82.4% accuracy.

[1]  C. O’Neill,et al.  The economic costs and its predictors for childhood autism spectrum disorders in Ireland: How is the burden distributed? , 2018, Autism : the international journal of research and practice.

[2]  Omar Mubin,et al.  Adaptive Social Robot for Sustaining Social Engagement during Long-Term Children–Robot Interaction , 2017, Int. J. Hum. Comput. Interact..

[3]  A. Billard,et al.  Building Robota, a Mini-Humanoid Robot for the Rehabilitation of Children With Autism , 2007, Assistive technology : the official journal of RESNA.

[4]  Leyuan Liu,et al.  Assessment of Children with Autism Based on Computer Games Compared with PEP Scale , 2017, 2017 International Conference of Educational Innovation through Technology (EITT).

[5]  B. Robins,et al.  Does appearance matter in the interaction of children with autism with a humanoid robot , 2006 .

[6]  Alex Pentland,et al.  RoboChain: A Secure Data-Sharing Framework for Human-Robot Interaction , 2018, ArXiv.

[7]  Tom Foulsham,et al.  What Affects Social Attention? Social Presence, Eye Contact and Autistic Traits , 2013, PloS one.

[8]  C. Kasari,et al.  Social involvement of children with autism spectrum disorders in elementary school classrooms. , 2010, Journal of child psychology and psychiatry, and allied disciplines.

[9]  Warren Jones,et al.  Mechanisms of Diminished Attention to Eyes in Autism. , 2017, The American journal of psychiatry.

[10]  M. Chetouani,et al.  How children with autism spectrum disorder behave and explore the 4-dimensional (spatial 3D + time) environment during a joint attention induction task with a robot , 2014 .

[11]  E. Zalama,et al.  Virtual Avatar for Emotion Recognition in Patients with Schizophrenia: A Pilot Study , 2016, Front. Hum. Neurosci..

[12]  Nilanjan Sarkar,et al.  Impact of robot-mediated interaction system on joint attention skills for children with autism , 2013, 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR).

[13]  L. Billeci,et al.  Autism and social robotics: A systematic review , 2016, Autism research : official journal of the International Society for Autism Research.

[14]  Shaileen Crawford Pokress,et al.  MIT App Inventor: Enabling Personal Mobile Computing , 2013, ArXiv.

[15]  Françoise de Bel-Air Demography, migration, and the labour market in the UAE , 2015 .

[16]  Björn W. Schuller,et al.  Personalized machine learning for robot perception of affect and engagement in autism therapy , 2018, Science Robotics.

[17]  R. Paul Interventions to improve communication in autism. , 2008, Child and adolescent psychiatric clinics of North America.

[18]  Thanh-Hung Nguyen,et al.  Designing autonomous robots , 2009, IEEE Robotics & Automation Magazine.

[19]  Hideki Kozima,et al.  Interactive robots for communication-care: a case-study in autism therapy , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[20]  J. Crawley,et al.  Communication, interventions, and scientific advances in autism: A commentary , 2010, Physiology & Behavior.

[21]  Catherine Lord,et al.  Application of DSM-5 criteria for autism spectrum disorder to three samples of children with DSM-IV diagnoses of pervasive developmental disorders. , 2012, The American journal of psychiatry.

[22]  B. Garcia-Zapirain,et al.  Technologies as Support Tools for Persons with Autistic Spectrum Disorder: A Systematic Review , 2014, International journal of environmental research and public health.

[23]  F. Volkmar,et al.  Practice parameter for the assessment and treatment of children and adolescents with autism spectrum disorder. , 2014, Journal of the American Academy of Child and Adolescent Psychiatry.

[24]  Brian Scassellati,et al.  Bridging the research gap , 2012, HRI 2012.

[25]  Sandra Costa,et al.  Robots as Tools to Help Children with ASD to Identify Emotions , 2014 .

[26]  Fady Alnajjar,et al.  Avatar based interaction therapy: A potential therapeutic approach for children with Autism , 2017, 2017 IEEE International Conference on Mechatronics and Automation (ICMA).

[27]  Omar Mubin,et al.  A Low-Cost Autonomous Attention Assessment System for Robot Intervention with Autistic Children , 2019, 2019 IEEE Global Engineering Education Conference (EDUCON).