Effects of a Listener Robot with Children in Storytelling

This paper investigates the effects of a listener robot that joins a storytelling situation for children as a side-participant. For this purpose, we develop a storytelling-robot system that consists of both reader and listener robots. Our semi-autonomous system involves a human operator who makes correct responses and provides easily understandable answers to the children's questions during storytelling. We develop a gaze model for the natural and autonomous gaze behaviors of a reader robot by considering multiple listeners and a storytelling object (a display that shows images). We conducted an experiment with 16 children to investigate whether they preferred storytelling with/without the listener robot and the changes of speech activities during the storytelling. Children preferred storytelling with the listener robot to storytelling without it. Their speech activities decreased when the listener robot was involved in the storytelling.

[1]  Cynthia Breazeal,et al.  Storytelling with robots: Learning companions for preschool children's language development , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[2]  Sara Bernardini,et al.  ECHOES: An intelligent serious game for fostering social communication in children with autism , 2014, Inf. Sci..

[3]  F. Collins,et al.  The Use of Traditional Storytelling in Education to the Learning of Literacy Skills , 1999 .

[4]  Tetsuo Ono,et al.  Multi-robot cooperation for human-robot communication , 2002, Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication.

[5]  Marina Fridin,et al.  Storytelling by a kindergarten social assistive robot: A tool for constructive learning in preschool education , 2014, Comput. Educ..

[6]  Takayuki Kanda,et al.  Conversational gaze mechanisms for humanlike robots , 2012, TIIS.

[7]  Tony Belpaeme,et al.  Child Speech Recognition in Human-Robot Interaction: Evaluations and Recommendations , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[8]  E. Goffman,et al.  Forms of talk , 1982 .

[9]  Allison Druin,et al.  Interactive storytelling: interacting with people, environment, and technology , 2014, Int. J. Arts Technol..

[10]  Mirko Gelsomini,et al.  Telling Stories to Robots: The Effect of Backchanneling on a Child's Storytelling * , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[11]  Takayuki Kanda,et al.  Field Trial of a Networked Robot at a Train Station , 2011, Int. J. Soc. Robotics.

[12]  James A. Hendler,et al.  Designing StoryRooms: interactive storytelling spaces for children , 2000, DIS '00.

[13]  Nadia Magnenat-Thalmann,et al.  Modelling Multi-Party Interactions among Virtual Characters, Robots, and Humans , 2014, PRESENCE: Teleoperators and Virtual Environments.

[14]  Cynthia Breazeal,et al.  Affective Personalization of a Social Robot Tutor for Children's Second Language Skills , 2016, AAAI.

[15]  Arne Jönsson,et al.  Wizard of Oz studies: why and how , 1993, IUI '93.

[16]  Michio Okada,et al.  NAMIDA: Multiparty Conversation Based Driving Agents in Futuristic Vehicle , 2015, HCI.

[17]  Takayuki Kanda,et al.  Can a Social Robot Stimulate Science Curiosity in Classrooms? , 2015, International Journal of Social Robotics.

[18]  Jean-Claude Martin,et al.  Facial Expressions of Appraisals Displayed by a Virtual Storyteller for Children , 2016, IVA.

[19]  R. Isbell,et al.  The Effects of Storytelling and Story Reading on the Oral Language Complexity and Story Comprehension of Young Children , 2004 .

[20]  Marina Umaschi Bers,et al.  Interactive storytelling systems for children: using technology to explore language and identity , 1999 .

[21]  I-Ming Chen,et al.  A Review on the Use of Robots in Education and Young Children , 2016, J. Educ. Technol. Soc..

[22]  付伶俐 打磨Using Language,倡导新理念 , 2014 .

[23]  Norihiro Hagita,et al.  Social acceptance toward a childcare support robot system: web-based cultural differences investigation and a field study in Japan , 2017, Adv. Robotics.

[24]  Takayuki Kanda,et al.  Can a social robot help children's understanding of science in classrooms? , 2014, HAI.

[25]  Brian Scassellati,et al.  Emotional Storytelling in the Classroom: Individual versus Group Interaction between Children and Robots , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[26]  Takayuki Kanda,et al.  Field trial of networked social robots in a shopping mall , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Takayuki Kanda,et al.  Field trial for simultaneous teleoperation of mobile social robots , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[28]  Bilge Mutlu,et al.  A Storytelling Robot: Modeling and Evaluation of Human-like Gaze Behavior , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[29]  Takayuki Kanda,et al.  Humanoid Robots as a Broadcasting Communication Medium in Open Public Spaces , 2009, Int. J. Soc. Robotics.