Interactive Storytelling in a Mixed Reality Environment: The Effects of Interactivity on User Experiences

Interactive storytelling in a mixed reality environment merges digital and physical information and features. It usually uses an augmentation of the real-world and physically-based interaction to create an immersive experience that corresponds to the dramatic storyline of the interactive narrative influenced by the actions of the user. Immersiveness is a crucial aspect of such an installation, and can be influenced by multiple factors such as video, sounds, interaction and, finally, the density of all combined stimuli. We used one of the stages from our interactive ALICE installation to investigate immersiveness and its contributing factors in a between-group design with a special focus on the effects of interactivity, and the feedback and feedforward stimuli of the environment on the users’ experiences. The study was carried out with 41 participants and the results showed that immersiveness not necessarily depends on the modality of stimuli, but instead on their time-density.

[1]  Jônatas Manzolli,et al.  The Effects of Explicit and Implicit Interaction on User Experiences in a Mixed Reality Installation: The Synthetic Oracle , 2009, PRESENCE: Teleoperators and Virtual Environments.

[2]  Marc Cavazza,et al.  User interaction in mixed reality interactive storytelling , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[3]  Jonathan Freeman,et al.  A Cross-Media Presence Questionnaire: The ITC-Sense of Presence Inventory , 2001, Presence: Teleoperators & Virtual Environments.

[4]  Hirokazu Kato,et al.  Touch-Space: Mixed Reality Game Space Based on Ubiquitous, Tangible, and Social Computing , 2002, Personal and Ubiquitous Computing.

[5]  Eva Hornecker,et al.  Challenges for Creating and Staging Interactive Costumes for the Theatre Stage , 2015, Creativity & Cognition.

[6]  A. B. Loyall,et al.  Integrating Reactivity, Goals, and Emotion in a Broad Agent , 1992 .

[7]  Eva Hornecker,et al.  Castle-Sized Interfaces: An Interactive Façade Mapping , 2015, PerDis.

[8]  Joseph Bates,et al.  Guiding interactive drama , 1997 .

[9]  Giuseppe Riva,et al.  Being there : the experience of presence in mediated environments , 2003 .

[10]  Wayne G. Lutters,et al.  Mixed reality games , 2012, CSCW.

[11]  P. Maes,et al.  Old tricks, new dogs: ethology and interactive creatures , 1997 .

[12]  Bruce Blumberg,et al.  Physically interactive story environments , 2000, IBM Syst. J..

[13]  L. Carroll,et al.  Alice's Adventures in Wonderland , 2019 .

[14]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[15]  Andrew Stern,et al.  Integrating Plot, Character and Natural Language Processing in the Interactive Drama Façade , 2003 .

[16]  Anselm Grundhöfer,et al.  Projection-Based Augmented Reality in Disney Theme Parks , 2012, Computer.

[17]  Michael Mateas,et al.  Agency Reconsidered , 2009, DiGRA Conference.

[18]  G.W.M. Rauterberg,et al.  Entertainment , Culture , and Media Art , 2015 .

[19]  Blair MacIntyre,et al.  RoomAlive: magical experiences enabled by scalable, adaptive projector-camera units , 2014, UIST.

[20]  Ivo Swartjes,et al.  A Tabletop Board Game Interface for Multi-user Interaction with a Storytelling System , 2011, INTETAIN.

[21]  Blair MacIntyre,et al.  Presence and engagement in an interactive drama , 2007, CHI.

[22]  Jun Hu,et al.  Applying Virtual and Augmented Reality in Cultural Computing , 2008, Int. J. Virtual Real..

[23]  R. Aylett.  Narrative in Virtual Environments - Towards Emergent Narrative , 1999 .

[24]  G. Riva,et al.  Being There: Concepts, Effects and Measurements of User Presence in Synthetic Environments , 2003 .

[25]  Blair MacIntyre,et al.  Initial lessons from AR Façade, an interactive augmented reality drama , 2006, ACE '06.

[26]  Charles E. Hughes,et al.  Applying Mixed Reality to Entertainment , 2002, Computer.

[27]  Gwm Matthias Rauterberg,et al.  Advice from a Caterpillar : an application for cultural computing about the self , 2006 .

[28]  Brenda Kay Laurel,et al.  Toward the design of a computer-based interactive fantasy system / , 1986 .

[29]  Arnav Jhala,et al.  Branching Storylines in Virtual Reality Environments for Leadership Development , 2004, AAAI.

[30]  Jun Hu,et al.  How to behave as Alice in Wonderland-about boredom and curiosity , 2010, Entertain. Comput..

[31]  Andrew Stern,et al.  Façade: An Experiment in Building a Fully-Realized Interactive Drama , 2003 .

[32]  Charles E. Hughes,et al.  Mixed reality in education, entertainment, and training , 2005, IEEE Computer Graphics and Applications.

[33]  Ana Paiva,et al.  FearNot! - An Experiment in Emergent Narrative , 2005, IVA.

[34]  Dirk Heylen,et al.  The Virtual Storyteller: story creation by intelligent agents , 2003 .

[35]  Matthias Rauterberg,et al.  Cultural Computing and the Self Concept: Towards Unconscious Metamorphosis , 2007, International Conference on Evolutionary Computation.

[36]  Barbara Hayes-Roth,et al.  Acting in Character , 2019, Creating Personalities for Synthetic Actors.

[37]  Steven P. Dow,et al.  Understanding user engagement in immersive and interactive stories , 2008 .