Adaptive Social Robot for Sustaining Social Engagement during Long-Term Children–Robot Interaction

ABSTRACT One of the known challenges in Children–Robot Interaction (cHRI) is to sustain children’s engagement during long-term interactions with robots. Researchers have hypothesized that robots that can adapt to children’s affective states and can also learn from the environment can result in sustaining engagement during cHRI. Recently, researchers have conducted a range of studies where robots portray different social capabilities and have shown that it has positively influenced children’s engagement. However, despite an immense body of research on implementation of different adaptive social robots, a pivotal question remains unanswered: Which adaptations portrayed by a robot can result in maintaining long-term social engagement during cHRI? In other words, what are the appropriate and effective adaptations portrayed by a robot that will sustain social engagement for an extended number of interactions? In this article, we report on a study conducted with three groups of children who played a snakes and ladders game with the NAO robot to address the aforementioned question. The NAO performed 1) game-based adaptations, 2) emotion-based adaptations, and 3) memory-based adaptation. Our results showed that emotion-based adaptations were found out to be most effective, followed by memory-based adaptations. Game adaptation didn’t result in sustaining long-term social engagement.

[1]  Kerstin Dautenhahn,et al.  A quantitative technique for analysing robot-human interactions , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  M. Wittrock Learning as a Generative Process , 1974 .

[3]  Ana Paiva,et al.  Social Robots for Long-Term Interaction: A Survey , 2013, International Journal of Social Robotics.

[4]  Haizhou Li,et al.  Facial emotion recognition , 2017, 2017 IEEE 2nd International Conference on Signal and Image Processing (ICSIP).

[5]  Marco Pasch Improving children's self-report in user-centered evaluations , 2010, IDC.

[6]  Vaughan Prain,et al.  Personalised learning: lessons to be learnt , 2012 .

[7]  Po-Yao Chao,et al.  Exploring the Possibility of Using Humanoid Robots as Instructional Tools for Teaching a Second Language in Primary School , 2010, J. Educ. Technol. Soc..

[8]  Cássia Trojahn dos Santos,et al.  An intelligent and adaptive virtual environment and its application in distance learning , 2004, AVI.

[9]  Agata Rozga,et al.  Play with me — Measuring a child's engagement in a social interaction , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[10]  Mike Y. Chen,et al.  iGrasp: grasp-based adaptive keyboard for mobile devices , 2013, CHI Extended Abstracts.

[11]  Wolmet Barendregt,et al.  Robots Tutoring Children: Longitudinal Evaluation of Social Engagement in Child-Robot Interaction , 2016, NordiCHI.

[12]  M. A. King,et al.  Suggestibility and the Child Witness , 1987 .

[13]  Tomohiro Yoshikawa,et al.  An Emotional Expression Model for Educational-Support Robots , 2015, J. Artif. Intell. Soft Comput. Res..

[14]  Takayuki Kanda,et al.  The perception of animacy and intelligence based on a robot's embodiment , 2007, 2007 7th IEEE-RAS International Conference on Humanoid Robots.

[15]  Nuno Jardim Nunes,et al.  Engaging children in longitudinal behavioral studies through playful technologies , 2013, IDC.

[16]  Candace L. Sidner,et al.  Explorations in engagement for humans and robots , 2005, Artif. Intell..

[17]  Elisabeth André,et al.  Creation and Evaluation of emotion expression with body movement, sound and eye color for humanoid robots , 2011, 2011 RO-MAN.

[18]  Cristina Conati,et al.  Probabilistic assessment of user's emotions in educational games , 2002, Appl. Artif. Intell..

[19]  Illah R. Nourbakhsh,et al.  A survey of socially interactive robots , 2003, Robotics Auton. Syst..

[20]  Ronan Querrec,et al.  MASCARET: pedagogical multi-agents systems for virtual environment for training , 2003, Proceedings. 2003 International Conference on Cyberworlds.

[21]  Takayuki Kanda,et al.  Interactive Robots as Social Partners and Peer Tutors for Children: A Field Trial , 2004, Hum. Comput. Interact..

[22]  Allison Druin,et al.  The role of children in the design of new technology , 2002 .

[23]  Omar Mubin,et al.  Understanding Behaviours and Roles for Social and Adaptive Robots In Education: Teacher's Perspective , 2016, HAI.

[24]  Ali Nahvi,et al.  Design and implementation of an intelligent virtual environment for improving speaking and listening skills , 2016, Interact. Learn. Environ..

[25]  Rajiv Khosla,et al.  Human Robot Engagement and Acceptability in Residential Aged Care , 2017, Int. J. Hum. Comput. Interact..

[26]  K. Dautenhahn,et al.  Robots moving out of the laboratory - detecting interaction levels and human contact in noisy school environments , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[27]  Emiel Krahmer,et al.  Child-robot interaction across cultures: How does playing a game with a social robot compare to playing a game alone or with a friend? , 2014, Comput. Hum. Behav..

[28]  Marek P. Michalowski,et al.  Keepon : A Playful Robot for Research, Therapy, and Entertainment (Original Paper) , 2009 .

[29]  Helen F. Hastie,et al.  I Remember You!: Interaction with Memory for an Empathic Virtual Robotic Tutor , 2016, AAMAS.

[30]  Ana Paiva,et al.  Detecting user engagement with a robot companion using task and social interaction-based features , 2009, ICMI-MLMI '09.

[31]  Christian Vollmer,et al.  Morningness is associated with better gradings and higher attention in class , 2013 .

[32]  Takayuki Kanda,et al.  Can a social robot help children's understanding of science in classrooms? , 2014, HAI.

[33]  John-Jules Ch. Meyer,et al.  Adaptive Emotional Expression in Robot-Child Interaction , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[34]  Fabio Tesser,et al.  Towards long-term social child-robot interaction , 2016 .

[35]  Candace L. Sidner,et al.  Where to look: a study of human-robot engagement , 2004, IUI '04.

[36]  François Michaud,et al.  What are the benefits of adaptation when applied in the domain of child-robot interaction? , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[37]  Antonija Mitrovic,et al.  Interactive reconstructive student modeling: A machine-learning approach , 1995, Int. J. Hum. Comput. Interact..

[38]  Nikolaos G. Tsagarakis,et al.  A passivity based admittance control for stabilizing the compliant humanoid COMAN , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[39]  Chi-Wing Fu,et al.  Using Social Media Platforms for Human-Robot Interaction in Domestic Environment , 2014, Int. J. Hum. Comput. Interact..

[40]  Suleman Shahid,et al.  Design and Evaluation of Mobile Learning Applications for Autistic Children in Pakistan , 2015, INTERACT.

[41]  Félix de la Paz,et al.  ARTIE: An Integrated Environment for the Development of Affective Robot Tutors , 2016, Front. Comput. Neurosci..

[42]  Catherine J. Stevens,et al.  A review of the applicability of robots in education , 2013 .

[43]  Laura K. Guerrero,et al.  Principles of communication and emotion in social interaction , 1996 .

[44]  Takayuki Nagai,et al.  Toward playmate robots that can play with children considering personality , 2014, HAI.

[45]  M. Argyle,et al.  EYE-CONTACT, DISTANCE AND AFFILIATION. , 1965, Sociometry.

[46]  Ana Paiva,et al.  Empathic Robots for Long-term Interaction , 2014, Int. J. Soc. Robotics.

[47]  Takayuki Kanda,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < 2 , 2022 .

[48]  Evangelos Karapanos,et al.  Modeling Users' Experiences with Interactive Systems , 2012, Studies in Computational Intelligence.

[49]  Rajiv Khosla,et al.  Socially Assistive Robots in Elderly Care: A Mixed-Method Systematic Literature Review , 2014, Int. J. Hum. Comput. Interact..

[50]  Candace L. Sidner,et al.  Human-robot interaction: engagement between humans and robots for hosting activities , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[51]  Emily C. Collins,et al.  Presence of Life-Like Robot Expressions Influences Children’s Enjoyment of Human-Robot Interactions in the Field , 2015 .

[52]  Seong-Yong Koo,et al.  Telepresence robot system for English tutoring , 2010, 2010 IEEE Workshop on Advanced Robotics and its Social Impacts.

[53]  Ravi Kiran Sarvadevabhatla,et al.  Multimodal approach to affective human-robot interaction design with children , 2011, ACM Trans. Interact. Intell. Syst..

[54]  Tony Belpaeme,et al.  Pervasive Memory: the Future of Long-Term Social HRI Lies in the Past , 2014, HRI 2014.