A Framework Supporting Selecting Space to Make Place in Spatial Mixed Reality Play

Studies of mixed reality systems, especially games and play, have proliferated in the human-computer interaction literature, yet little research has directly addressed how designers select physical spaces to make places. A space is a physical area, while a place is a space infused with meaning. Mixed reality games that make use of physical space make and/or alter places. Selection of a space as a setting for a mixed reality play raises questions around immersion, safety, and user experience design. The present research analyzes the mixed reality literature through grounded theory to derive guidelines for selecting space and making place in mixed reality play. We consider 71 papers and 17 games after filtering over 240 papers for how they address space. We contribute a framing for mixed reality spaces on two axes: one that reflects space continuity and one that reflects space specificity requirements. From the framework, we provide design implications for space selection.

[1]  Kiyoshi Kiyokawa,et al.  Management and manipulation of text in dynamic mixed reality workspaces , 2013, ISMAR.

[2]  Steve Benford,et al.  The augurscope: a mixed reality interface for outdoors , 2002, CHI.

[3]  Wei Liu,et al.  Human Pacman: a mobile wide-area entertainment system based on physical, social, and ubiquitous computing , 2004, ACE '04.

[4]  Martin R. Gibbs,et al.  Mixed reality stories: how creative writers integrate virtual and physical realities , 2014, OZCHI.

[5]  D. Norman The Design of Everyday Things: Revised and Expanded Edition , 2013 .

[6]  Steffen P. Walz,et al.  Toward a Ludic Architecture: The Space of Play and Games , 2010 .

[7]  Roderic Crooks Review: Mobile Interface Theory: Embodied Space and Locative Media by Jason Farman , 2013 .

[8]  Peter van der Straaten,et al.  Research on Presence in VR: a Survey , 2001 .

[9]  Carsten Röcker,et al.  Classifying Pervasive Games: On Pervasive Computing and Mixed Reality , 2007 .

[10]  W. Keith Edwards,et al.  SecSpace: prototyping usable privacy and security for mixed reality collaborative environments , 2014, EICS '14.

[11]  J. Gibson The Ecological Approach to Visual Perception , 1979 .

[12]  Matthew Chalmers,et al.  Picking Pockets on the Lawn: The Development of Tactics and Strategies in a Mobile Game , 2005, UbiComp.

[13]  Ronald Azuma,et al.  Augmented-reality visualizations guided by cognition: perceptual heuristics for combining visible and obscured information , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[14]  Wei Liu,et al.  Mixed reality classroom: learning from entertainment , 2007, DIMEA.

[15]  Craig A. Lindley Game space design foundations for trans-reality games , 2005, ACE '05.

[16]  Sus Lundgren,et al.  Designing Mobile Experiences for Collocated Interaction , 2015, CSCW.

[17]  Paul Coulton,et al.  Harnessing player creativity to broaden the appeal of location based games , 2010, BCS HCI.

[18]  Gaetano Borriello,et al.  Location Systems for Ubiquitous Computing , 2001, Computer.

[19]  Michael Haller,et al.  Mixed reality training application for an oil refinery: user requirements , 2004, VRCAI '04.

[20]  Y. Tuan,et al.  Space and Place: The Perspective of Experience. , 1978 .

[21]  Philip Henning,et al.  Mental Models: Knowledge in the Head and Knowledge in the World , 1996, ICLS.

[22]  Bruce H. Thomas,et al.  Evaluation of user satisfaction and learnability for outdoor augmented reality gaming , 2006, AUIC.

[23]  Steven K. Feiner,et al.  Situated documentaries: embedding multimedia presentations in the real world , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[24]  Ken Perlin,et al.  ClayVision: the (elastic) image of the city , 2012, CHI.

[25]  Hitesh Nidhi Sharma,et al.  Evaluating Display Modalities Using a Mixed Reality Game , 2016, CHI PLAY.

[26]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[27]  Stefan Rennick Egglestone,et al.  Performing thrill: designing telemetry systems and spectator interfaces for amusement rides , 2008, CHI.

[28]  Ann Morrison,et al.  Like bees around the hive: a comparative study of a mobile augmented reality map , 2009, CHI.

[29]  Anupriya Ankolekar,et al.  Play it by ear: a case for serendipitous discovery of places with musicons , 2013, CHI.

[30]  A. Strauss,et al.  The discovery of grounded theory: strategies for qualitative research aldine de gruyter , 1968 .

[31]  Michael Epstein,et al.  History Unwired: mobile narrative in historic cities , 2006, AVI '06.

[32]  Matthew Chalmers,et al.  Lessons from the lighthouse: collaboration in a shared mixed reality system , 2003, CHI '03.

[33]  Zoran Popovic,et al.  PhotoCity: training experts at large-scale image acquisition through a competitive game , 2011, CHI.

[34]  Stine Ejsing-Duun Participatory urbanism : Making the stranger familiar and the familiar strange , 2016 .

[35]  Dan Frankowski,et al.  An experiment in discovering personally meaningful places from location data , 2005, CHI Extended Abstracts.

[36]  Lennart E. Nacke,et al.  From game design elements to gamefulness: defining "gamification" , 2011, MindTrek.

[37]  J. Huizinga Homo Ludens: A Study of the Play-Element in Culture , 1938 .

[38]  Stéphane Natkin,et al.  User model in multiplayer mixed reality entertainment applications , 2006, ACE '06.

[39]  Bonnie MacKay,et al.  Operation Citadel: Exploring the Role of Docents in Mixed Reality , 2015, CHI PLAY.

[40]  Paul Dourish,et al.  Re-space-ing place: "place" and "space" ten years on , 2006, CSCW '06.

[41]  Rod McCall,et al.  TimeWarp: interactive time travel with a mobile mixed reality game , 2008, Mobile HCI.

[42]  Thomas Alexander,et al.  Optimal Font Size for Head-Mounted-Displays in Outdoor Applications , 2008, 2008 12th International Conference Information Visualisation.

[43]  Steve Benford,et al.  Where on-line meets on the streets: experiences with mobile mixed reality games , 2003, CHI '03.

[44]  Magnus Bång,et al.  Exploring place and direction: mobile augmented reality in the Astrid Lindgren landscape , 2012, OZCHI.

[45]  J. Agnew,et al.  Sage Handbook of Geographical Knowledge , 2011 .

[46]  L. Connelly Grounded theory. , 2013, Medsurg nursing : official journal of the Academy of Medical-Surgical Nurses.

[47]  Andy Cockburn,et al.  Directional interfaces for wearable augmented reality , 2008, CHINZ.

[48]  Jennifer Preece,et al.  Prototyping in PLACE: a scalable approach to developing location-based apps and games , 2013, CHI.

[49]  Hauke Ernst,et al.  DERIVE: a distributed platform for mixed reality interaction , 2002, CHI Extended Abstracts.

[50]  Michael G. Strintzis,et al.  Interactive mixed reality white cane simulation for the training of the blind and the visually impaired , 2007, Personal and Ubiquitous Computing.

[51]  Martijn J. Schuemie,et al.  Research on Presence in Virtual Reality: A Survey , 2001, Cyberpsychology Behav. Soc. Netw..

[52]  Ronald Azuma,et al.  The Challenge of Making Augmented Reality Work Outdoors , 1999 .

[53]  Volker Paelke,et al.  Adaptive mixed reality games , 2005, ACE '05.

[54]  Bruce H. Thomas,et al.  A survey of visual, mixed, and augmented reality gaming , 2012, CIE.

[55]  Liselott Brunnberg,et al.  Believable environments: generating interactive storytelling in vast location-based pervasive games , 2006, ACE '06.

[56]  Matthew Chalmers,et al.  Seamful interweaving: heterogeneity in the theory and design of interactive systems , 2004, DIS '04.

[57]  Mitchell Harrop,et al.  Paradigms of games research in HCI: a review of 10 years of research at CHI , 2014, CHI PLAY.

[58]  Evan Barba,et al.  A theory of meaning for Mixed Reality walking tours , 2014, 2014 IEEE International Symposium on Mixed and Augmented Reality - Media, Art, Social Science, Humanities and Design (ISMAR-MASH'D).

[59]  A. Dunser,et al.  CityViewAR: A mobile outdoor AR application for city visualization , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities (ISMAR-AMH).

[60]  Massimo Bergamasco,et al.  [Poster] Interacting with your own hands in a fully immersive MR system , 2014, 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[61]  Matthew Chalmers,et al.  Delivering real-world ubiquitous location systems , 2005, CACM.

[62]  Duncan Rowland,et al.  Uncle Roy All Around You: Implicating the City in a Location-Based Performance , 2004 .

[63]  M. Montola Exploring the Edge of the Magic Circle : Defining Pervasive Games , 2005 .

[64]  J. D. Bolter,et al.  Plants and zombies: Two use cases for on-location panorama viewing in handheld mobile AR , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities (ISMAR-AMH).

[65]  Y. Tuan,et al.  Place: An Experiential Perspective , 1975 .

[66]  Blair MacIntyre,et al.  Exploring spatial narratives and mixed reality experiences in Oakland Cemetery , 2005, ACE '05.

[67]  W. Benjamin The work of art in the age of mechanical reproduction , 2018, A Museum Studies Approach to Heritage.

[68]  Fotis Liarokapis,et al.  Personalizing Virtual and Augmented Reality for Cultural Heritage Indoor and Outdoor Experiences , 2008, VAST.

[69]  Arindam Dey,et al.  Egocentric space-distorting visualizations for rapid environment exploration in mobile mixed reality , 2009, 2010 IEEE Virtual Reality Conference (VR).

[70]  Steve Benford,et al.  Orchestrating a mixed reality performance , 2001, CHI.

[71]  O. Juhlin,et al.  Motion and Spatiality in a Gaming Situation – Enhancing Mobile Computer Games with the Highway Experience , 2003 .

[72]  Steve Benford,et al.  Performing Mixed Reality , 2011 .

[73]  Jun Hu,et al.  Alice's adventures in an immersive mixed reality environment , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[74]  A. Strauss,et al.  Grounded theory , 2017 .

[75]  Anind K. Dey,et al.  Simulated augmented reality windshield display as a cognitive mapping aid for elder driver navigation , 2009, CHI.

[76]  Steve Benford,et al.  Orchestrating a mixed reality game 'on the ground' , 2004, CHI.

[77]  Panos Markopoulos,et al.  SCORPIODROME: an exploration in mixed reality social gaming for children , 2005, ACE '05.

[78]  Marc Cavazza,et al.  Compelling experiences in mixed reality interactive storytelling , 2004, ACE '04.

[79]  Annika Waern,et al.  Pervasive Games: Theory and Design , 2009 .

[80]  Jean-Charles Marty,et al.  Mixed Reality Games , 2015, Int. J. Game Based Learn..

[81]  Jay David Bolter,et al.  Presence and the Aura of Meaningful Places , 2004 .

[82]  Erik Kristiansen,et al.  Computer games for the real world: designing a design method for site-specific computer games , 2010 .

[83]  칼빈 톰킨스,et al.  마르셀 뒤샹(Marcel Duchamp) , 2000 .

[84]  Bruce H. Thomas,et al.  ARQuake: an outdoor/indoor augmented reality first person application , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[85]  Mary Flanagan,et al.  Locating Play and Politics: Real World Games & Activism , 2007 .

[86]  Christian Reimann Kick-real, a mobile mixed reality game , 2005, ACE '05.

[87]  Steven K. Feiner,et al.  A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[88]  David Birchfield,et al.  Embodiment, Multimodality, and Composition: Convergent Themes across HCI and Education for Mixed-Reality Learning Environments , 2008, Adv. Hum. Comput. Interact..

[89]  Gudrun Klinker,et al.  User awareness of tracking uncertainties in AR navigation scenarios , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[90]  James Noble,et al.  Grounded theory for geeks , 2011, PLoP '11.

[91]  Didier Stricker,et al.  Archeoguide: An Augmented Reality Guide for Archaeological Sites , 2002, IEEE Computer Graphics and Applications.

[92]  Timo Engelke,et al.  The House of Olbrich — An Augmented Reality tour through architectural history , 2011, 2011 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities.

[93]  B. Glaser Doing grounded theory : issues and discussions , 1998 .

[94]  Paul Dourish,et al.  Where the action is , 2001 .

[95]  Bruce H. Thomas,et al.  Outdoor virtual reality , 2003, ISICT.

[96]  James J. Gibson,et al.  The Ecological Approach to Visual Perception: Classic Edition , 2014 .

[97]  Paul M. Camic,et al.  From Trashed to Treasured: A Grounded Theory Analysis of the Found Object , 2010 .

[98]  Hideyuki Tamura,et al.  MR Platform: a basic body on which mixed reality applications are built , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[99]  Frank Biocca,et al.  Attention funnel: omnidirectional 3D cursor for mobile augmented reality platforms , 2006, CHI.

[100]  Paul Coulton,et al.  PAC-LAN: the human arcade , 2006, ACE '06.

[101]  Denis Lalanne,et al.  Human Machine Interaction, Research Results of the MMI Program , 2009, Human Machine Interaction.

[102]  Emmanuel Dubois,et al.  Notational-based prototyping of mixed interactions , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[103]  Arjun Nagendran,et al.  A mixed reality system for teaching STEM content using embodied learning and whole-body metaphors , 2012, VRCAI '12.

[104]  Masayuki Takemura,et al.  Diminishing head-mounted display for shared mixed reality , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[105]  Sus Lundgren,et al.  Forces, clashes and remnants: a model for event-driven iterative multidisciplinary game design , 2005, ACE '05.

[106]  Steve Benford,et al.  Can you see me now? , 2006, TCHI.

[107]  Josephine Reid,et al.  Design for coincidence: incorporating real world artifacts in location based games , 2008, DIMEA.

[108]  K. Gwet Handbook of Inter-Rater Reliability: The Definitive Guide to Measuring the Extent of Agreement Among Raters , 2014 .

[109]  Christian Jacquemin,et al.  Bateau ivre: an artistic markerless outdoor mobile augmented reality installation on a riverboat , 2010, ACM Multimedia.

[110]  Chris Crawford,et al.  The Art of Computer Game Design , 1984 .

[111]  Rafael Ballagas,et al.  Gaming Tourism: Lessons from Evaluating REXplorer, a Pervasive Game for Tourists , 2009, Pervasive.

[112]  Bruce H. Thomas,et al.  Outdoor Augmented Reality Gaming on Five Dollars a Day , 2005, AUIC.

[113]  Jane H. Barrow,et al.  Basic Perception in Head-Worn Augmented Reality Displays , 2013 .

[114]  Matthias Böttger,et al.  Space time play : computer games, architecture and urbanism : the next level , 2007 .

[115]  Ben A. M. Schouten,et al.  A Breathtaking Journey. On the Design of an Empathy-Arousing Mixed-Reality Game , 2016, CHI PLAY.

[116]  Eric Ras,et al.  Learning Spaces , 2022, The SAGE Encyclopedia of Higher Education.

[117]  Sang Chul Ahn,et al.  Using a mobile device as an interface tool for HMD-based AR applications , 2006, ACE '06.

[118]  Katie Salen,et al.  Rules of play: game design fundamentals , 2003 .

[119]  Paul Dourish,et al.  Re-place-ing space: the roles of place and space in collaborative systems , 1996, CSCW '96.

[120]  B. Glaser Theoretical Sensitivity: Advances in the Methodology of Grounded Theory , 1978 .

[121]  R. Caillois,et al.  Man, Play and Games , 1958 .