StoryFaces: pretend-play with ebooks to support social-emotional storytelling

We introduce StoryFaces, a new composition and storytelling tool for children to explore the role of emotional expressions in children's narrative. StoryFaces invites children to record emotional expressions that become part of storybook illustrations. As children watch the story being told, they see their faces bring the story to life; then they can "go backstage" to play with the story by rearranging the videos and altering the story text. More experienced children can build an interactive ebook from the ground up, creating scenes, characters and expressive faces to craft personalized narratives. Our design rationale focuses on supporting children's exploration of emotional expression through their narrative play. Results with eighteen children ages 4-10 indicate that emotional expressions are inviting and motivating for children across this broad age range to engage in both reading and creating narrative. StoryFaces gave children's ephemeral facial expressions concrete forms with which they could manipulate, discuss, and think about the role of emotion in narratives. Our goal is to provoke new ideas about how pretend play with digital tools can empower young children in social-emotional narrative activities.

[1]  J. Russell,et al.  A closer look at preschoolers' freely produced labels for facial expressions. , 2003, Developmental psychology.

[2]  Ellen Yi-Luen Do,et al.  Facial expression wonderland (FEW): a novel design prototype of information and computer technology (ICT) for children with autism spectrum disorder (ASD) , 2010, IHI.

[3]  Sean Follmer,et al.  Family story play: reading with young children (and elmo) over a distance , 2010, CHI.

[4]  Hiroshi Ishii,et al.  Picture this!: film assembly using toy gestures , 2008, UbiComp.

[5]  Hayes Raffle,et al.  StoryFaces: children exploring emotional expressions in storytelling with video , 2011, CHI EA '11.

[6]  Nalini Ambady,et al.  Accurate identification of fear facial expressions predicts prosocial behavior. , 2007, Emotion.

[7]  Allison Druin,et al.  KidPad: collaborative storytelling for children , 2002, CHI Extended Abstracts.

[8]  Discrimination of facial expressions by preschool children. , 1982 .

[9]  Doris Bergen,et al.  The Role of Pretend Play in Children's Cognitive Development. , 2002 .

[10]  Hiroshi Ishii,et al.  People in books: using a FlashCam to become part of an interactive book for connected reading , 2012, CSCW.

[11]  Hiroshi Ishii,et al.  Jabberstamp: embedding sound and voice in traditional drawings , 2007, SIGGRAPH '07.

[12]  Elizabeth Sulzby,et al.  Emergent Literacy: Writing and Reading. Writing Research: Multidisciplinary Inquiries into the Nature of Writing Series. , 1986 .

[13]  Sharon McDonald,et al.  Emotion faces: the design and evaluation of a game for preschool children , 2011, CHI EA '11.

[14]  Rafael Ballagas,et al.  Pop goes the cell phone: asynchronous messaging for preschoolers , 2011, IDC.

[15]  Hiroshi Ishii,et al.  Sculpting behavior: a tangible language for hands-on play and learning , 2008 .

[16]  H. Borke,et al.  The Development of Empathy in Chinese and American Children Between Three and Six Years of Age: A Cross-Cultural Study. , 1973 .

[17]  S. Nowicki,et al.  Improving the Ability of Elementary School-Age Children to Identify Emotion in Facial Expression , 2003, The Journal of genetic psychology.

[18]  Sandy Bogaert,et al.  Social Value Orientation: Related to Empathy and the Ability to Read the Mind in the Eyes , 2008, The Journal of social psychology.

[19]  C. Whissell,et al.  Children's Understanding of Facial Expression of Emotion: I. Voluntary Creation of Emotion-Faces , 1991, Perceptual and motor skills.