On Measuring Engagement Level During Child-Robot Interaction in Education

The introduction of social robots in education has been a major theme in robotics research in recent years. Various studies have been conducted that demonstrate the merits of using robots as teachers or teacher assistants. These studies are mainly focused on activities where the child interacts with the robot to achieve a certain educational or therapeutic goal. The principal reason that robots in education are observed to have a positive effect, is that children appear to be more engaged during the educational process when a robot is involved. This paper reviews the current literature on the subject of using social robots in education for the purposes of identifying the most appropriate methodologies in measuring the engagement levels of children during child-robot interactions, specifically focusing on interactions occurring in an educational or therapeutic setting.

[1]  Fabiane Barreto Vavassori Benitti,et al.  Exploring the educational potential of robotics in schools: A systematic review , 2012, Comput. Educ..

[2]  Dimitris Alimisis,et al.  Educational robotics: Open questions and new challenges , 2013 .

[3]  Brian Scassellati,et al.  Speech and Gaze Conflicts in Collaborative Human-Robot Interactions , 2014, CogSci.

[4]  Kerstin Dautenhahn,et al.  From Isolation to Communication: A Case Study Evaluation of Robot Assisted Play for Children with Autism with a Minimally Expressive Humanoid Robot , 2009, 2009 Second International Conferences on Advances in Computer-Human Interactions.

[5]  Agnieszka Wykowska,et al.  Robot-Assisted Training of Joint Attention Skills in Children Diagnosed with Autism , 2015, ICSR.

[6]  Myounghoon Jeon,et al.  Interactive robotic framework for multi-sensory therapy for children with autism spectrum disorder , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[7]  Cynthia Breazeal,et al.  Can Children Catch Curiosity from a Social Robot? , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[8]  Fumihide Tanaka,et al.  The implementation of care-receiving robot at an English learning school for children , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[9]  Chen Yu,et al.  See You See Me , 2016, ACM Trans. Interact. Intell. Syst..

[10]  Robin R. Murphy,et al.  Survey of metrics for human-robot interaction , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[11]  Jean Scholtz,et al.  Common metrics for human-robot interaction , 2006, HRI '06.

[12]  Anke Huckauf,et al.  A view to a click: Pupil size changes as input command in eyes-only human-computer interaction , 2018, Int. J. Hum. Comput. Stud..

[13]  Daniel J. Ricks,et al.  Trends and considerations in robot-assisted autism therapy , 2010, 2010 IEEE International Conference on Robotics and Automation.

[14]  Ayanna M. Howard,et al.  Recognition of Gestural Behaviors Expressed by Humanoid Robotic Platforms for Teaching Affect Recognition to Children with Autism - A Healthy Subjects Pilot Study , 2017, ICSR.

[15]  V. Kaburlasos,et al.  Emotional Speech Recognition toward Modulating the Behavior of a Social Robot , 2018 .

[16]  Gerard Jounghyun Kim,et al.  Projector robot for augmented children's play , 2011, HRI '11.

[17]  Jeong-Hye Han,et al.  Teaching assistant robot, ROBOSEM, in English class and practical issues for its diffusion , 2011, Advanced Robotics and its Social Impacts.

[18]  Eleni Vrochidou,et al.  Social Robots for Pedagogical Rehabilitation , 2019, Advances in Systems Analysis, Software Engineering, and High Performance Computing.

[19]  Kerstin Dautenhahn,et al.  Using a Humanoid Robot to Elicit Body Awareness and Appropriate Physical Interaction in Children with Autism , 2015, Int. J. Soc. Robotics.

[20]  Eleni Vrochidou,et al.  Social Engagement Interaction Games Between Children with Autism and Humanoid Robot NAO , 2018, SOCO-CISIS-ICEUTE.

[21]  Zdenko Kovacic,et al.  POMDP-Based Coding of Child-Robot Interaction within a Robot-Assisted ASD Diagnostic Protocol , 2018, Int. J. Humanoid Robotics.

[22]  Jukka Lekkala,et al.  Wireless Face Interface: Using voluntary gaze direction and facial muscle activations for human-computer interaction , 2012, Interact. Comput..

[23]  BenittiFabiane Barreto Vavassori.  Exploring the educational potential of robotics in schools , 2012 .

[24]  Hatice Kose-Bagci,et al.  Humanoid robots communication with participants using sign language: An interaction based sign language game , 2013, 2013 IEEE Workshop on Advanced Robotics and its Social Impacts.

[25]  Maja J. Mataric,et al.  Month-long, In-home Case Study of a Socially Assistive Robot for Children with Autism Spectrum Disorder , 2018, HRI.

[26]  Mohammad Nasser Saadatzi,et al.  Small-Group Technology-Assisted Instruction: Virtual Teacher and Robot Peer for Individuals with Autism Spectrum Disorder , 2018, Journal of autism and developmental disorders.

[27]  Maja J. Mataric,et al.  Graded cueing feedback in robot-mediated imitation practice for children with autism spectrum disorders , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[28]  Andy Burton,et al.  A Comparison of Humanoid and Non-humanoid Robots in Supporting the Learning of Pupils with Severe Intellectual Disabilities , 2016, 2016 International Conference on Interactive Technologies and Games (ITAG).

[29]  Igor M. Verner,et al.  Science Class with RoboThespian: Using a Robot Teacher to Make Science Fun and Engage Students , 2016, IEEE Robotics & Automation Magazine.

[30]  B. Vanderborght,et al.  Children with Autism Spectrum Disorders Make a Fruit Salad with Probo, the Social Robot: An Interaction Study , 2015, Journal of Autism and Developmental Disorders.

[31]  T. Lourens,et al.  Improving Collaborative Play Between Children with Autism Spectrum Disorders and Their Siblings: The Effectiveness of a Robot-Mediated Intervention Based on Lego® Therapy , 2014, Journal of Autism and Developmental Disorders.

[32]  Eunja Hyun,et al.  Characteristics of young children's utilization of a robot during play time : A case study , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[33]  Matthias Scheutz,et al.  Investigating multimodal real-time patterns of joint attention in an hri word learning task , 2010, HRI 2010.

[34]  Eleni Vrochidou,et al.  Social Robot NAO as a Self-Regulating Didactic Mediator: a Case Study of Teaching/Learning Numeracy , 2018, 2018 26th International Conference on Software, Telecommunications and Computer Networks (SoftCOM).

[35]  S. Shamsuddin,et al.  Initial response of autistic children in human-robot interaction therapy with humanoid robot NAO , 2012, 2012 IEEE 8th International Colloquium on Signal Processing and its Applications.

[36]  Scott E. Hudson,et al.  Spatial and Other Social Engagement Cues in a Child-Robot Interaction: Effects of a Sidekick , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[37]  Thierry Karsenti,et al.  Learning to Program a Humanoid Robot: Impact on Special Education Students , 2018 .

[38]  Kenji Suzuki,et al.  Design of a robotic agent that measures smile and facing behavior of children with Autism Spectrum Disorder , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[39]  Francisco Herrera,et al.  Hesitant Fuzzy Sets: State of the Art and Future Directions , 2014, Int. J. Intell. Syst..

[40]  Ana Paiva,et al.  Building successful long child-robot interactions in a learning context , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[41]  Brian Scassellati,et al.  Comparing Models of Disengagement in Individual and Group Interactions , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[42]  A. Tapus,et al.  Children with Autism Social Engagement in Interaction with Nao, an Imitative Robot - A Series of Single Case Experiments , 2012 .

[43]  Scott E. Hudson,et al.  Combining body pose, gaze, and gesture to determine intention to interact in vision-based interfaces , 2014, CHI.

[44]  Bilge Mutlu,et al.  Pay attention!: designing adaptive agents that monitor and improve user engagement , 2012, CHI.

[45]  Jaeryoung Lee,et al.  NAO-Dance Therapy for Children with ASD , 2017, HRI.

[46]  Emilia I. Barakova,et al.  From spreading of behavior to dyadic interaction—A robot learns what to imitate , 2011, Int. J. Intell. Syst..

[47]  George A. Papakostas,et al.  Social Robot Selection: A Case Study in Education , 2018, 2018 26th International Conference on Software, Telecommunications and Computer Networks (SoftCOM).

[48]  N. Sarkar,et al.  Can Robotic Interaction Improve Joint Attention Skills? , 2015, Journal of autism and developmental disorders.

[49]  Myounghoon Jeon,et al.  Robot Opera: A modularized afterschool program for STEAM education at local elementary school , 2017, 2017 14th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[50]  Maya Dimitrova,et al.  Designing Humanoid Robots with Novel Roles and Social Abilities , 2015 .

[51]  B. Scassellati,et al.  Robots for use in autism research. , 2012, Annual review of biomedical engineering.

[52]  Hanafiah Yussof,et al.  Human Robot Interaction (HRI) between a humanoid robot and children with Cerebral Palsy: Experimental framework and measure of engagement , 2014, 2014 IEEE Conference on Biomedical Engineering and Sciences (IECBES).

[53]  Anibal Gutierrez,et al.  Robot-based therapeutic protocol for training children with Autism , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[54]  Lundy Lewis,et al.  Soft systems methodology as a tool to aid a pilot study in robot-assisted therapy , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[55]  Jordi Albo-Canals,et al.  Engagement based on a Customization of an iPod-LEGO Robot for a Long-term Interaction for an Educational Purpose , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[56]  Erkki Sutinen,et al.  Can Robots Teach? Preliminary Results on Educational Robotics in Special Education , 2006 .

[57]  Kerstin Dautenhahn,et al.  Robots as social mediators for children with Autism - A preliminary analysis comparing two different robotic platforms , 2011, 2011 IEEE International Conference on Development and Learning (ICDL).

[58]  Emilia I. Barakova,et al.  Effects of robots’ intonation and bodily appearance on robot-mediated communicative treatment outcomes for children with autism spectrum disorder , 2018, Personal and Ubiquitous Computing.

[59]  I-Ming Chen,et al.  A Review on the Use of Robots in Education and Young Children , 2016, J. Educ. Technol. Soc..