Tangible viewpoints: a physical approach to multimedia stories

We present a multimedia storytelling system that couples a tangible interface with a multiple viewpoint approach to interactive narratives. Over the centuries, stories have moved from the physical environment (around campfires and on the stage), to the printed page, then to movie, television and computer screens. Today, using wireless and tag sensing technologies, storytellers are able to bring digital stories back into our physical environment. The Tangible Viewpoints system explores how physical objects and augmented surfaces can be used as tangible embodiments of different character perspectives in an interactive tale. These graspable surrogates provide a direct mode of navigation to the story world, a means of bridging the gap between cyberspace and our physical environment as we engage with digital stories. The system supports stories told in a range of media, including audio, video, still image and text.In this paper, we first provide a context for Tangible Viewpoints based on research in the areas of tangible interfaces and interactive narratives. We then offer an overview of the Tangible Viewpoints functionality, and explain the design and implementation of the system. The current system has been used in two storytelling projects. We discuss each one, and look at how user feedback has affected or will affect further development. We conclude by suggesting several future applications for the Tangible Viewpoints interface.

[1]  Justine Cassell,et al.  StoryMat: a play space with narrative memories , 1998, IUI '99.

[2]  Kevin Brooks Agent Stories , 2001 .

[3]  Marcelle A. Stienstra,et al.  Creating an immersive broadcast experience , 2001, MULTIMEDIA '01.

[4]  Kevin M. Brooks Do story agents use rocking chairs? The theory and implementation of one model for computational narrative , 1997, MULTIMEDIA '96.

[5]  Hiroshi Ishii,et al.  Triangles: tangible interface for manipulation and exploration of digital information topography , 1998, CHI.

[6]  J. Bruner Actual minds, possible worlds , 1985 .

[7]  Carol Strohecker,et al.  Tired of Giving In: An Experiment in Narrative Unfolding , 1999 .

[8]  Glorianna Davenport,et al.  ConText towards the evolving documentary , 1995, MULTIMEDIA '95.

[9]  Glorianna Davenport,et al.  Automatist Storyteller Systems and the Shifting Sands of Story , 1997, IBM Syst. J..

[10]  Alexandra Mazalek,et al.  Tangible interfaces for interactive point-of-view narratives , 2001 .

[11]  Matthew G. Gorbet,et al.  Beyond input devices : a new conceptual framework for the design of physical-digital objects , 1998 .

[12]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[13]  Tony P. Pridmore,et al.  Classroom collaboration in the design of tangible interfaces for storytelling , 2001, CHI.

[14]  C. Strohecker The Greek Chorus as a Model for Interaction with Stories , 1996 .

[15]  Ali Mazalek,et al.  genieBottles: An Interactive Narrative in Bottles , 2001, SIGGRAPH 2001.

[16]  G. Davenport NEW ORLEANS IN TRANSITION , 1983-1986 : The Interactive Delivery of a Cinematic Case Study , .

[17]  Carol Strohecker,et al.  Electronic collage : the videodisc and interactive narrative , 1986 .

[18]  James A. Hendler,et al.  Designing PETS: a personal electronic teller of stories , 1999, CHI '99.

[19]  B. Bederson,et al.  Designing storytelling technologies to encouraging collaboration between young children , 2000, CHI.

[20]  Michael Luke Murtaugh The Automatist Storytelling System : putting the editor's knowledge in software , 1996 .