Humanoid Robot Assisted Training for Facial Expressions Recognition Based on Affective Feedback

Different studies explore the use of electronic screen media to train specific social skills, since they provide visual elements which are well accepted by children with ASD. However, even if children have high levels of attention to the screen, this might also reduce the possibilities of interacting with others. The challenge lays on finding ways to encourage and motivate the child to keep learning and share the experience with others. For this reason, we propose a feasible framework composed of three technologies: a tablet to train facial expressions recognition, a humanoid robot as reinforcer, and a wearable device to quantify smiles. We did a feasibility test with adults not only to verify the machine response, but also to obtain qualitative data regarding the interaction with the robot. In this study we analyze the importance and the synergistic effect of combining screen media with the robot embodiment and affective computing technologies.

[1]  Kenji Suzuki,et al.  Design of affective robot-assisted activity for children with autism spectrum disorders , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[2]  Kenji Suzuki,et al.  Design of a Wearable Device for Reading Positive Expressions from Facial EMG Signals , 2014, IEEE Transactions on Affective Computing.

[3]  Michael A. Goodrich,et al.  Detailed requirements for robots in autism therapy , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[4]  H. Kadone,et al.  Brief Report: The Smiles of a Child with Autism Spectrum Disorder During an Animal-assisted Activity May Facilitate Social Positive Behaviors—Quantitative Analysis with Smile-detecting Interface , 2014, Journal of autism and developmental disorders.

[5]  D. Watson,et al.  Development and validation of brief measures of positive and negative affect: the PANAS scales. , 1988, Journal of personality and social psychology.

[6]  B. Scassellati,et al.  Robots for use in autism research. , 2012, Annual review of biomedical engineering.

[7]  R. Ryan,et al.  Intrinsic motivation and the effects of self-consciousness, self-awareness, and ego-involvement: An investigation of internally controlling styles , 1985 .

[8]  B. Mineo,et al.  Engagement with Electronic Screen Media Among Students with Autism Spectrum Disorders , 2009, Journal of autism and developmental disorders.

[9]  Tiago Fernandes,et al.  Interactive Technology: Teaching People with Autism to Recognize Facial Emotions , 2011 .

[10]  Soichiro Matsuda,et al.  Computer-based intervention for inferring facial expressions from the socio-emotional context in two children with autism spectrum disorders , 2014 .

[11]  Elizabeth S. Kim,et al.  Social Robots as Embedded Reinforcers of Social Behavior in Children with Autism , 2012, Journal of Autism and Developmental Disorders.

[12]  J. C. C. Gillesen,et al.  From training to robot behavior: Towards custom scenarios for robotics in training programs for ASD , 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

[13]  D. Lefeber,et al.  Using the social robot probo as a social story telling agent for children with ASD , 2012 .

[14]  Daniel J. Ricks,et al.  Trends and considerations in robot-assisted autism therapy , 2010, 2010 IEEE International Conference on Robotics and Automation.

[15]  Rubina Lal,et al.  EFFECT OF VISUAL STRATEGIES ON DEVELOPMENT OF COMMUNICATION SKILLS IN CHILDREN WITH AUTISM , 2007 .

[16]  Lauren M. Schmitt,et al.  The Clinical Use of Robots for Individuals with Autism Spectrum Disorders: A Critical Review. , 2012, Research in autism spectrum disorders.

[17]  Hanafiah Yussof,et al.  Development of Interaction Scenarios Based on Pre-school Curriculum in Robotic Intervention for Children with Autism , 2014 .