Creating and using interactive narratives: reading and writing branching comics

In this paper we describe the design and development of a multi-touch surface and software that challenges current approaches to the production and consumption of comics. Authorship of the comics involves drawing the 'top level' of the story directly onto paper and projecting lower-level narrative elements, such as objects, characters, dialogue, descriptions and/or events onto the paper via a multi-touch interface. In terms of the impact this has upon the experience of reading and writing, the implementation of paper is intended to facilitate the creation of high-level overviews of stories, while the touch surface allows users to generate branches through the addition of artifacts in accordance with certain theories about interactive narratives. This provides the opportunity to participate in the reading and authoring of both traditional, paper-based texts and interactive, digital scenarios. Prototype comics are used to demonstrate this approach to reading and writing top-level and low-level narratives.

[1]  P. Johnson-Laird,et al.  Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness , 1985 .

[2]  W. Eisner Comics and Sequential Art , 1985 .

[3]  T. Trabasso,et al.  Constructing inferences during narrative text comprehension. , 1994, Psychological review.

[4]  Pierre David Wellner,et al.  Interacting with paper on the DigitalDesk , 1993, CACM.

[5]  Carolyn Miller,et al.  Digital Storytelling: A Creator's Guide to Interactive Entertainment , 2004 .

[6]  Henry Jenkins Confronting the Challenges of Participatory Culture: Media Education for the 21st Century , 2006 .

[7]  Herre van Oostendorp,et al.  The role of Game Discourse Analysis and curiosity in creating engaging and effective serious games by implementing a back story and foreshadowing , 2011, Interact. Comput..

[8]  T. Krzywinska,et al.  Screenplay: Cinema/Videogames/Interfaces , 2002 .

[9]  Ali Mazalek,et al.  Tangible comics: a performance space with full-body interaction , 2007, ACE '07.

[10]  Hiroshi Ishii,et al.  Triangles: tangible interface for manipulation and exploration of digital information topography , 1998, CHI.

[11]  Bill Buxton,et al.  Sketching User Experiences: Getting the Design Right and the Right Design , 2007 .

[12]  J. Bruner The Narrative Construction of Reality , 1991, Critical Inquiry.

[13]  Richard Rouse,et al.  Game design : theory and practice , 2001 .

[14]  Rungtai Lin,et al.  Usability evaluation of E-books , 2009, Displays.