Identifying Engagement from Joint Kinematics Data for Robot Therapy Prompt Interventions for Children with Autism Spectrum Disorder

Prompts are used by therapists to help children with autism spectrum disorder learn and acquire desirable skills and behaviors. As social robots are more regularly translated into similar therapy settings, a critical part of ensuring effectiveness of these robot therapy system is providing them with the ability to detect engagement/disengagement states of the child in order to provide prompts at the right time. In this paper, we examine the various features related to body movement that can be utilized to define engagement levels and develop a model using these features for identifying engagement/disengagement states. The model was validated in a pilot study with child participants. Results show that our engagement model can achieve a recognition rate of 97 %.

[1]  Aude Billard,et al.  Robotic assistants in therapy and education of children with autism: can a small humanoid robot help encourage social interaction skills? , 2005, Universal Access in the Information Society.

[2]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[3]  Yukiko I. Nakano,et al.  Estimating user's engagement from eye-gaze behaviors in human-agent conversations , 2010, IUI '10.

[4]  C. Corsello,et al.  Early Intervention in Autism , 2005 .

[5]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[6]  Doreen Granpeesheh,et al.  The effects of age and treatment intensity on behavioral intervention outcomes for children with autism spectrum disorders. , 2009 .

[7]  Ayanna M. Howard,et al.  Using a shared tablet workspace for interactive demonstrations during human-robot learning scenarios , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[8]  Ana Paiva,et al.  Detecting user engagement with a robot companion using task and social interaction-based features , 2009, ICMI-MLMI '09.

[9]  D. Baker,et al.  Financial Issues Associated with Having a Child with Autism , 2007 .

[10]  Brian Scassellati,et al.  Comparing Models of Disengagement in Individual and Group Interactions , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[11]  Svein Eikeseth,et al.  Outcome for Children with Autism who Began Intensive Behavioral Treatment Between Ages 4 and 7 , 2007, Behavior modification.

[12]  N. Sarkar,et al.  A Step Towards Developing Adaptive Robot-Mediated Intervention Architecture (ARIA) for Children With Autism , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  Michelle N. Lumicao,et al.  EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks. , 2007, Aviation, space, and environmental medicine.

[14]  S. Porges,et al.  Emotion Recognition in Children with Autism Spectrum Disorders: Relations to Eye Gaze and Autonomic State , 2010, Journal of autism and developmental disorders.

[15]  Marek P. Michalowski,et al.  A spatial model of engagement for a social robot , 2006, 9th IEEE International Workshop on Advanced Motion Control, 2006..