There Once Was a Robot Storyteller: Measuring the Effects of Emotion and Non-verbal Behaviour

Social Robots bear great potential to tell stories to human listeners. Through their embodiment and ability to display non-verbal and emotional behaviour, additional modalities can be used to transport the user into the story compared to traditional media such as books or audio books. Based on theoretical knowledge about the design of social robot storytellers and the analysis of human storytellers, we designed the behaviour of an emotional social robot storyteller and compared it to a neutral version of the robotic storyteller and the voice of a human storyteller represented by an audio book. Results suggest that the emotional robot is able to transport the participants equally well as the traditional audio book, while the neutral robot performed worse. We therefore claim, that emotional behaviour in the domain of robotic storytelling should be carefully designed to support the story rather then preventing a good transportation.

[1]  Ana Paiva,et al.  Persuasion Based on Personality Traits: Using a Social Robot as Storyteller , 2017, HRI.

[2]  Rossana Damiano,et al.  Emotions in Drama Characters and Virtual Agents , 2008, AAAI Spring Symposium: Emotion, Personality, and Social Behavior.

[3]  Valerie Rohy,et al.  On Fairy Stories , 2005 .

[4]  Mirko Gelsomini,et al.  Telling Stories to Robots: The Effect of Backchanneling on a Child's Storytelling * , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[5]  Rosalind W. Picard.  Affective Computing , 1997 .

[6]  Cynthia Breazeal,et al.  Designing sociable robots , 2002 .

[7]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[8]  Ko de Ruyter,et al.  The Extended Transportation-Imagery Model: A Meta-Analysis of the Antecedents and Consequences of Consumers' Narrative Transportation , 2014 .

[9]  Gerhard Sagerer,et al.  Understanding Social Robots , 2009, 2009 Second International Conferences on Advances in Computer-Human Interactions.

[10]  Iben Have,et al.  Digital Audiobooks: New Media, Users, and Experiences , 2015 .

[11]  J. Zipes.  Fairy Tales and the Art of Subversion , 1983 .

[12]  Clark Elliott,et al.  Story-morphing in the affective reasoning paradigm: generating stories semi-automatically for use with “emotionally intelligent” multimedia agents , 1998, AGENTS '98.

[13]  Jodi Forlizzi,et al.  All robots are not created equal: the design and perception of humanoid robot heads , 2002, DIS '02.

[14]  Bilge Mutlu,et al.  A Storytelling Robot: Modeling and Evaluation of Human-like Gaze Behavior , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[15]  Cynthia Breazeal,et al.  Lessons from teachers on performing HRI studies with young children in schools , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[16]  Markus Appel,et al.  The Transportation Scale–Short Form (TS–SF) , 2015 .

[17]  D. McNeill,et al.  Gesture and the Poetics of Prose , 1991 .

[18]  Raquel Hervás,et al.  EmoTales: creating a corpus of folk tales with emotional annotations , 2012, Lang. Resour. Evaluation.

[19]  Vincenzo Lombardo,et al.  Semantic annotation of narrative media objects , 2011, Multimedia Tools and Applications.

[20]  Cynthia Breazeal,et al.  Storytelling with robots: Learning companions for preschool children's language development , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[21]  Timothy C. Brock,et al.  The role of transportation in the persuasiveness of public narratives. , 2000, Journal of personality and social psychology.

[22]  P. Ekman,et al.  Unmasking the face : a guide to recognizing emotions from facial clues , 1975 .

[23]  Koen V. Hindriks,et al.  Effects of a robotic storyteller's moody gestures on storytelling perception , 2015, 2015 International Conference on Affective Computing and Intelligent Interaction (ACII).