Interactive storytelling in a mixed reality environment: The effects of interactivity on user experiences

Interactive storytelling in a mixed reality environment merges digital and physical information and features. It usually uses an augmentation of the real-world and physically-based interaction to create an immersive experience that corresponds to the dramatic storyline of the interactive narrative influenced by the actions of the user. Immersiveness is a crucial aspect of such an installation, and can be influenced by multiple factors such as video, sounds, interaction and, finally, the density of all combined stimuli. We used one of the stages from our interactive ALICE installation to investigate immersiveness and its contributing factors in a between-group design with a special focus on the effects of interactivity, and the feedback and feedforward stimuli of the environment on the users’ experiences. The study was carried out with 41 participants and the results showed that immersiveness not necessarily depends on the modality of stimuli, but instead on their time-density.

[1]  Jun Hu,et al.  Interactive Storytelling in a Mixed Reality Environment: The Effects of Interactivity on User Experiences , 2014, ICEC.

[2]  M. Haller.  Mixed Reality @ Education , 2005 .

[3]  A. B. Loyall,et al.  Integrating Reactivity, Goals, and Emotion in a Broad Agent , 1992 .

[4]  Eva Hornecker,et al.  Castle-Sized Interfaces: An Interactive Façade Mapping , 2015, PerDis.

[5]  Jônatas Manzolli,et al.  The Effects of Explicit and Implicit Interaction on User Experiences in a Mixed Reality Installation: The Synthetic Oracle , 2009, PRESENCE: Teleoperators and Virtual Environments.

[6]  Andrew Stern,et al.  Integrating Plot, Character and Natural Language Processing in the Interactive Drama Façade , 2003 .

[7]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[8]  Blair MacIntyre,et al.  RoomAlive: magical experiences enabled by scalable, adaptive projector-camera units , 2014, UIST.

[9]  Anselm Grundhöfer,et al.  Projection-Based Augmented Reality in Disney Theme Parks , 2012, Computer.

[10]  Marc Cavazza,et al.  User interaction in mixed reality interactive storytelling , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[11]  Joseph Bates,et al.  Guiding interactive drama , 1997 .

[12]  Brenda Kay Laurel,et al.  Toward the design of a computer-based interactive fantasy system / , 1986 .

[13]  Arnav Jhala,et al.  Branching Storylines in Virtual Reality Environments for Leadership Development , 2004, AAAI.

[14]  P. Maes,et al.  Old tricks, new dogs: ethology and interactive creatures , 1997 .

[15]  L. Carroll,et al.  Alice's Adventures in Wonderland: Princeton University Press , 2015 .

[16]  Jean-Charles Marty,et al.  Mixed Reality Games , 2015, Int. J. Game Based Learn..

[17]  Jun Hu,et al.  How to behave as Alice in Wonderland-about boredom and curiosity , 2010, Entertain. Comput..

[18]  Ana Paiva,et al.  FearNot! - An Experiment in Emergent Narrative , 2005, IVA.

[19]  Dirk Heylen,et al.  The Virtual Storyteller: story creation by intelligent agents , 2003 .

[20]  Andrew Stern,et al.  Façade: An Experiment in Building a Fully-Realized Interactive Drama , 2003 .

[21]  Jun Hu,et al.  Applying Virtual and Augmented Reality in Cultural Computing , 2008, Int. J. Virtual Real..

[22]  Eva Hornecker,et al.  Challenges for Creating and Staging Interactive Costumes for the Theatre Stage , 2015, Creativity & Cognition.

[23]  Blair MacIntyre,et al.  Presence and engagement in an interactive drama , 2007, CHI.

[24]  R. Aylett.  Narrative in Virtual Environments - Towards Emergent Narrative , 1999 .

[25]  Matthias Rauterberg,et al.  Cultural Computing and the Self Concept: Towards Unconscious Metamorphosis , 2007, International Conference on Evolutionary Computation.

[26]  Barbara Hayes-Roth,et al.  Acting in Character , 2019, Creating Personalities for Synthetic Actors.

[27]  Steven P. Dow,et al.  Understanding user engagement in immersive and interactive stories , 2008 .

[28]  Ivo Swartjes,et al.  A Tabletop Board Game Interface for Multi-user Interaction with a Storytelling System , 2011, INTETAIN.

[29]  Charles E. Hughes,et al.  Applying Mixed Reality to Entertainment , 2002, Computer.

[30]  Charles E. Hughes,et al.  Mixed reality in education, entertainment, and training , 2005, IEEE Computer Graphics and Applications.

[31]  Gwm Matthias Rauterberg,et al.  Advice from a Caterpillar : an application for cultural computing about the self , 2006 .

[32]  Blair MacIntyre,et al.  Initial lessons from AR Façade, an interactive augmented reality drama , 2006, ACE '06.

[33]  Giuseppe Riva,et al.  Being there : the experience of presence in mediated environments , 2003 .

[34]  G. Riva,et al.  Being There: Concepts, Effects and Measurements of User Presence in Synthetic Environments , 2003 .

[35]  Jonathan Freeman,et al.  A Cross-Media Presence Questionnaire: The ITC-Sense of Presence Inventory , 2001, Presence: Teleoperators & Virtual Environments.

[36]  Hirokazu Kato,et al.  Touch-Space: Mixed Reality Game Space Based on Ubiquitous, Tangible, and Social Computing , 2002, Personal and Ubiquitous Computing.

[37]  Michael Mateas,et al.  Agency Reconsidered , 2009, DiGRA Conference.

[38]  Bruce Blumberg,et al.  Physically interactive story environments , 2000, IBM Syst. J..

[39]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[40]  Ryohei Nakatsu,et al.  Entertainment, culture, and media art , 2016 .