A Mobile Mixed-Reality Environment for Children's Storytelling Using a Handheld Projector and a Robot

This paper describes a system called GENTORO that uses a robot and a handheld projector for supporting children's storytelling activities. GENTORO differs from many existing systems in that children can make a robot play their own story in a physical space augmented by mixed-reality technologies. Pilot studies have been conducted to clarify the design requirements of GENTORO from both technological and practical viewpoints. A user study indicates that GENTORO's ability to enable manipulation of a robot using a handheld projector in a physical space can enhance children's embodied participation in, and their level of engagement with, their storytelling activities, and can support children in designing and expressing creative and original stories.

[1]  Greg Welch,et al.  Shader Lamps: Animating Real Objects With Image-Based Illumination , 2001, Rendering Techniques.

[2]  Fusako Kusunoki,et al.  Fostering Students' Participation in Face-to-Face Interactions and Deepening Their Understanding by Integrating Personal and Shared Spaces , 2009, Trans. Edutainment.

[3]  Allison Druin,et al.  Tools for children to create physical interactive storyrooms , 2004, CIE.

[4]  Justine Cassell,et al.  StoryMat: a play space for collaborative storytelling , 1999, CHI Extended Abstracts.

[5]  Atsushi Konno,et al.  U-Tsu-Shi-O-Mi: the virtual humanoid you can reach , 2006, SIGGRAPH '06.

[6]  Allison Druin,et al.  KidPad: collaborative storytelling for children , 2002, CHI Extended Abstracts.

[7]  Xiang Cao,et al.  Interacting with dynamically defined information spaces using a handheld projector and a pen , 2006, UIST.

[8]  Ehud Sharlin,et al.  Robot expressionism through cartooning , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[9]  Franca Garzotto,et al.  Hyperstories and social interaction in 2D and 3D edutainment spaces for children , 2006, HYPERTEXT '06.

[10]  A. Wright.  Creating Stories with Children , 1997 .

[11]  James W. Davis,et al.  The KidsRoom: A Perceptually-Based Interactive and Immersive Story Environment , 1999, Presence.

[12]  Shigenori Inagaki,et al.  GENTORO: a system for supporting children's storytelling using handheld projectors and a robot , 2009, IDC.

[13]  Bruce A. MacDonald,et al.  Developer oriented visualisation of a robot program , 2006, HRI '06.

[14]  Judith Good,et al.  A learner-centred design approach to developing a visual language for interactive storytelling , 2007, IDC.

[15]  Yu Li,et al.  An interactive 3D exploration narrative interface for storytelling , 2004, IDC '04.

[16]  T. M. Amabile.  Social psychology of creativity: A consensual assessment technique. , 1982 .

[17]  Allison Druin,et al.  Child's play: a comparison of desktop and physical interactive environments , 2005, IDC '05.

[18]  Alisa E White,et al.  Assessing Advertising Creativity Using the Creative Product Semantic Scale , 2001, Journal of Advertising Research.

[19]  James A. Hendler,et al.  Designing StoryRooms: interactive storytelling spaces for children , 2000, DIS '00.

[20]  Masahiko Inami,et al.  Augmented coliseum: display-based computing for augmented reality inspiration computing robot , 2005, SIGGRAPH '05.

[21]  K. Hosoi.  Cogame : Manipulation by projection , 2007, SIGGRAPH 2007.

[22]  John R. Wilson,et al.  Mixed reality storytelling environments , 2003, Virtual Reality.

[23]  Susan P. Besemer.  Creative Product Analysis Matrix: Testing the Model Structure and a Comparison Among Products--Three Novel Chairs , 1998 .

[24]  Huib de Ridder,et al.  Comparing the creativity of children's design solutions based on expert assessment , 2008, IDC.

[25]  B. A. MacDonald,et al.  Developer Oriented Visualisation of a Robot Program An Augmented Reality Approach , 2006 .

[26]  Paul A. Beardsley,et al.  Zoom-and-pick: facilitating visual zooming and precision pointing with interactive handheld projectors , 2005, UIST.

[27]  Tristan Jehan,et al.  Dolltalk: a computational toy to enhance children's creativity , 2002, CHI Extended Abstracts.

[28]  M. J. Allen.  Introduction to Measurement Theory , 1979 .

[29]  James A. Hendler,et al.  Designing PETS: a personal electronic teller of stories , 1999, CHI '99.

[30]  Marina Umaschi.  Soft toys with computer hearts: building personal storytelling environments , 1997, CHI Extended Abstracts.

[31]  Roy Want,et al.  Bridging physical and virtual worlds with electronic tags , 1999, CHI '99.

[32]  Hiroshi Ishii,et al.  Jabberstamp: embedding sound and voice in traditional drawings , 2007, SIGGRAPH '07.

[33]  Masanori Sugimoto,et al.  Caretta: a system for supporting face-to-face collaboration by integrating personal and shared spaces , 2004, CHI.

[34]  Masanori Sugimoto,et al.  A storytelling support system using robots and handheld projectors , 2008, IDC.