Jammo Virtual Robot Enhances the Social Skills of Children With HFA: Development and Deployment

This study investigates the impact of combining virtual environment with a social VRobot as a novel approach to train the social skills of children with high-functioning autism (HFA). A 3D social virtual robot is used in a non-immersive (desktop) virtual environment to enhance the social skills of children with HFA through a social skills training program guided by a parent or a teacher. The motivation of this research is to provide a tool that can be widely accessible, cheap, and easily used by parents and teachers either at home or school. The training program targets three social skills: imitation, emotion recognition, and expression, and intransitive gestures skills. Experimental sessions were conducted with 15 children with HFA (4-12 years) both online and on-site. The participants were taught to recognize six basic emotions and 11 intransitive gestures (Phase I), to imitate these emotions and gestures (Phase II), and to produce them inappropriate social contexts (Phase III). Across all the three phases for each skill, significant differences were found between the pre-test, post-test, and follow-up test results.

[1]  Moojan Ghafurian,et al.  Design and Evaluation of Affective Expressions of a Zoomorphic Robot , 2020, ICSR.

[2]  Johan Vanderfaeillie,et al.  Robot-Assisted Joint Attention: A Comparative Study Between Children With Autism Spectrum Disorder and Typically Developing Children in Interaction With NAO , 2020, IEEE Access.

[3]  Alessandro G. Di Nuovo,et al.  An Explorative Study on Robotics for Supporting Children with Autism Spectrum Disorder during Clinical Procedures , 2020, HRI.

[4]  Abdul Rahman Omar,et al.  Humanoid robot NAO as a teaching tool of emotion recognition for children with autism using the Android app , 2014, 2014 International Symposium on Micro-NanoMechatronics and Human Science (MHS).

[5]  L. D. de Witte,et al.  How to Implement Robots in Interventions for Children with Autism? A Co-creation Study Involving People with Autism, Parents and Professionals , 2017, Journal of Autism and Developmental Disorders.

[6]  Daniel C. Krawczyk,et al.  Virtual Reality Social Cognition Training for children with high functioning autism , 2016, Comput. Hum. Behav..

[7]  N. Minshew,et al.  The development of emotion recognition in individuals with autism. , 2009, Child development.

[8]  L. Desideri,et al.  Assistive Technology for Cognition to Support Executive Functions in Autism: a Scoping Review , 2020, Advances in Neurodevelopmental Disorders.

[9]  Hui Yu,et al.  Robot-Enhanced Therapy: Development and Validation of Supervised Autonomous Robotic System for Autism Spectrum Disorders Therapy , 2019, IEEE Robotics & Automation Magazine.

[10]  Yasmine Arafa,et al.  Training Social Skills of Children with ASD Through Social Virtual Robot , 2021, 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW).

[11]  Jewoong Moon,et al.  Virtual Reality–Based Social Skills Training for Children With Autism Spectrum Disorder , 2020, Journal of Special Education Technology.

[12]  M. Wiznitzer,et al.  AIDS and the Nervous System , 1988, Neurology.

[13]  Miranda Kit-Yi Wong,et al.  Robot-based intervention may reduce delay in the production of intransitive gestures in Chinese-speaking preschoolers with autism spectrum disorder , 2018, Molecular Autism.

[14]  A. Guastella,et al.  An Overview of Autism Spectrum Disorder, Heterogeneity and Treatment Options , 2017, Neuroscience Bulletin.

[15]  Cristina P. Santos,et al.  A pilot study using imitation and storytelling scenarios as activities for labelling emotions by children with autism using a humanoid robot , 2014, 4th International Conference on Development and Learning and on Epigenetic Robotics.

[16]  Deborah C. Beidel,et al.  Social Skills Interventions for Children with Asperger’s Syndrome or High-Functioning Autism: A Review and Recommendations , 2008, Journal of autism and developmental disorders.

[17]  Vicky Charisi,et al.  Educators' Views on Using Humanoid Robots With Autistic Learners in Special Education Settings in England , 2019, Front. Robot. AI.

[18]  Hanafiah Yussof,et al.  Humanoid Robot NAO as HRI Mediator to Teach Emotions using Game-centered Approach for Children with Autism , 2013 .

[19]  Farzaneh Askari Studying Facial Expression Recognition and Imitation Ability of Children with Autism Spectrum Disorder in Interaction with a Social Robot , 2018 .

[20]  Adriana Tapus,et al.  Exploratory Study: Children's with Autism Awareness of being Imitated by Nao Robot , 2012, ArXiv.

[21]  Keith C. Radley,et al.  The relative effects of social stories and video modeling toward increasing eye contact of adolescents with autism spectrum disorder , 2015 .

[22]  J. Duby,et al.  Social and Emotional Development , 2010, Developmental and Behavioral Pediatrics.