nARratives of augmented worlds

This paper presents an examination of augmented reality (AR) as a rising form of interactive narrative that combines computer-generated elements with reality, fictional with non-fictional objects, in the same immersive experience. Based on contemporary theory in narratology, we propose to view this blending of reality worlds as a metalepsis, a transgression of reality and fiction boundaries, and argue that authors could benefit from using existing conventions of narration to emphasize the transgressed boundaries, as is done in other media. Our contribution is three-fold, first we analyze the inherent connection between narrative, immersion, interactivity, fictionality and AR using narrative theory, and second we comparatively survey actual works in AR narratives from the past 15 years based on these elements from the theory. Lastly, we postulate a future for AR narratives through the perspective of the advancing technologies of both interactive narratives and AR.

[1]  Hayes Raffle,et al.  Social immersive media: pursuing best practices for multi-user interactive camera/projector exhibits , 2009, CHI.

[2]  Eyal Ofek,et al.  IllumiRoom: peripheral projected illusions for interactive experiences , 2013, SIGGRAPH '13.

[3]  Marie-Laure Ryan.  Avatars Of Story , 2006 .

[4]  Ian Oakley,et al.  Hopstory: An Interactive, Location-Based Narrative Distributed in Space and Time , 2004, TIDSE.

[5]  Glorianna Davenport,et al.  M-Views: A System for Location-Based Storytelling , 2003 .

[6]  T. Liao,et al.  A framework for debating augmented futures: Classifying the visions, promises and ideographs advanced about augmented reality , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities (ISMAR-AMH).

[7]  Andrew Stern,et al.  Façade: An Experiment in Building a Fully-Realized Interactive Drama , 2003 .

[8]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera , 2011, UIST.

[9]  Rebecca Rouse,et al.  Thinking inside the box: Making meaning in a Handheld AR experience , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities.

[10]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[11]  Yun-Ta Tsai,et al.  The Westwood Experience: Connecting story to locations via Mixed Reality , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities.

[12]  M. Mateas.  Computational Subjectivity in Virtual World Avatars , 1997 .

[13]  Alex Mitchell,et al.  Limits of rereadability in procedural interactive stories , 2011, CHI.

[14]  Charles E. Hughes,et al.  Applying Mixed Reality to Entertainment , 2002, Computer.

[15]  Ivan Poupyrev,et al.  AIREAL: tactile gaming experiences in free air , 2013, SIGGRAPH '13.

[16]  Blair MacIntyre,et al.  Exploring spatial narratives and mixed reality experiences in Oakland Cemetery , 2005, ACE '05.

[17]  Liselott Brunnberg,et al.  Believable environments: generating interactive storytelling in vast location-based pervasive games , 2006, ACE '06.

[18]  Marie-Laure Ryan,et al.  Routledge encyclopedia of narrative theory , 2005 .

[19]  H. Porter Abbott,et al.  The Cambridge Introduction to Narrative: Index of authors and narratives , 2008 .

[20]  Blair MacIntyre,et al.  Augmented reality as a new media experience , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[21]  Jay David Bolter,et al.  Alice's Adventure's in New Media: An Exploration of Interactive Narratives in Augmented Reality , 2001 .

[22]  Craig Hight,et al.  Faking it , 2019 .

[23]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[24]  H. Porter Abbott.  The Cambridge Introduction to Narrative by H. Porter Abbott , 2008 .

[25]  Guillaume Moreau,et al.  A new typology of augmented reality applications , 2012, AH '12.

[26]  Jane McGonigal,et al.  'This Is Not a Game': Immersive Aesthetics and Collective Play , 2003 .

[27]  Blair MacIntyre,et al.  Three Angry Men: An Augmented-Reality Experiment in Point-of-View Drama , 2003 .

[28]  Steven K. Feiner,et al.  Exploring the Benefits of Augmented Reality Documentation for Maintenance and Repair , 2011, IEEE Transactions on Visualization and Computer Graphics.

[29]  Ursula Kretschmer,et al.  Stage-Based Augmented Edutainment , 2004, Smart Graphics.

[30]  Marc Cavazza,et al.  Compelling experiences in mixed reality interactive storytelling , 2004, ACE '04.

[31]  Alan B. Craig.  Understanding Augmented Reality: Concepts and Applications , 2013 .

[32]  Steve Mann,et al.  Cyborg: Digital Destiny and Human Possibility in the Age of the Wearable Computer , 2001 .

[33]  Jussi Holopainen,et al.  Narrative Friction in Alternate Reality Games: Design Insights from Conspiracy For Good , 2011, DiGRA Conference.

[34]  H. Abbott.  The Cambridge Introduction to Narrative , 2020 .

[35]  Blair MacIntyre,et al.  Initial lessons from AR Façade, an interactive augmented reality drama , 2006, ACE '06.

[36]  Vincent Lepetit,et al.  Turning Augmented Reality into a media: Design exploration to build a dedicated visual language , 2011, 2011 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities.