Blocks: Collaborative and Persistent Augmented Reality Experiences

We introduce Blocks, a mobile application that enables people to co-create AR structures that persist in the physical environment. Using Blocks, end users can collaborate synchronously or asynchronously, whether they are colocated or remote. Additionally, the AR structures can be tied to a physical location or can be accessed from anywhere. We evaluated how people used Blocks through a series of lab and field deployment studies with over 160 participants, and explored the interplay between two collaborative dimensions: space and time. We found that participants preferred creating structures synchronously with colocated collaborators. Additionally, they were most active when they created structures that were not restricted by time or place. Unlike most of today's AR experiences, which focus on content consumption, this work outlines new design opportunities for persistent and collaborative AR experiences that empower anyone to collaborate and create AR content.

[1]  Kathleen M. MacQueen,et al.  Applied Thematic Analysis , 2011 .

[2]  Jessica Hammer,et al.  Brick: Toward A Model for Designing Synchronous Colocated Augmented Reality Games , 2019, CHI.

[3]  Xiang 'Anthony' Chen,et al.  Facade: Auto-generating Tactile Interfaces to Appliances , 2016, ASSETS.

[4]  Ivan Poupyrev,et al.  Mixing realities in Shared Space: an augmented reality interface for collaborative computing , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[5]  Charles T. Loop,et al.  Holoportation: Virtual 3D Teleportation in Real-time , 2016, UIST.

[6]  Melanie Grunwald,et al.  Convergence Culture Where Old And New Media Collide , 2016 .

[7]  Matthew Turk,et al.  Location-based augmented reality on mobile phones , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[8]  David Lindlbauer,et al.  Remixed Reality: Manipulating Space and Time in Augmented Reality , 2018, CHI.

[9]  Chieko Asakawa,et al.  VizLens: A Robust and Interactive Screen Reader for Interfaces in the Real World , 2016, UIST.

[10]  E. Wenger,et al.  Situated Learning: Legitimate Peripheral Participation in Communities of Practice , 1991 .

[11]  Jeha Ryu,et al.  ARtalet: Tangible User Interface Based Immersive Augmented Reality Authoring Tool for Digilog Book , 2010, 2010 International Symposium on Ubiquitous Virtual Reality.

[12]  Christina Vasilakis,et al.  Learning and Building Together in an Immersive Virtual World , 1999, Presence: Teleoperators & Virtual Environments.

[13]  Michael S. Bernstein,et al.  Crowd Research: Open and Scalable University Laboratories , 2017, UIST.

[14]  Markus H. Gross,et al.  Statistical Analysis of Player Behavior in Minecraft , 2015, FDG.

[15]  Mitchel Resnick,et al.  Some reflections on designing construction kits for kids , 2005, IDC '05.

[16]  Robert W. Lindeman,et al.  DIY World Builder: An immersive level-editing system , 2013, 2013 IEEE Symposium on 3D User Interfaces (3DUI).

[17]  A. Aron,et al.  Inclusion of Other in the Self Scale and the structure of interpersonal closeness , 1992 .

[18]  Ken Perlin,et al.  Spacetime: Enabling Fluid Individual and Collaborative Editing in Virtual Reality , 2018, UIST.

[19]  Etienne Wenger,et al.  Situated Learning: Legitimate Peripheral Participation , 1991 .

[20]  Ersin Yumer,et al.  Skippy: single view 3D curve interactive modeling , 2017, ACM Trans. Graph..

[21]  Jock Given,et al.  The wealth of networks: How social production transforms markets and freedom , 2007, Inf. Econ. Policy.

[22]  Henry Been-Lirn Duh,et al.  Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[23]  Rob Miller,et al.  Real-time crowd control of existing interfaces , 2011, UIST.

[24]  Kangsoo Kim,et al.  Revisiting Trends in Augmented Reality Research: A Review of the 2nd Decade of ISMAR (2008–2017) , 2018, IEEE Transactions on Visualization and Computer Graphics.

[25]  Scott D. Roth,et al.  Ray casting for modeling solids , 1982, Comput. Graph. Image Process..

[26]  Carolyn Penstein Rosé,et al.  Contrasting Explicit and Implicit Support for Transactive Exchange in Team Oriented Project Based Learning , 2017, CSCL.

[27]  Gerard Jounghyun Kim,et al.  Immersive authoring of tangible augmented reality applications , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[28]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[29]  Anthony Rowe,et al.  Demo Abstract: Welcome to My World: Demystifying Multi-User AR with the Cloud , 2018, 2018 17th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[30]  Kenny Mitchell,et al.  Empowerment and embodiment for collaborative mixed reality systems , 2018, Comput. Animat. Virtual Worlds.

[31]  Mark Billinghurst,et al.  Face to face collaborative AR on mobile phones , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[32]  Anoop Gupta,et al.  Communication behaviors of co-located users in collaborative AR interfaces , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[33]  Stefan Stieglitz,et al.  A Framework for Collaborative Augmented Reality Applications , 2013, AMCIS.

[34]  Gerard Jounghyun Kim,et al.  Immersive authoring: What You eXperience Is What You Get (WYXIWYG) , 2005, CACM.

[35]  Areti Damala,et al.  Bridging the gap between the digital and the physical: design and evaluation of a mobile augmented reality guide for the museum visit , 2008, DIMEA.

[36]  Mark Mabrito,et al.  A Study of Synchronous Versus Asynchronous Collaboration in an Online Business Writing Class , 2006 .

[37]  Pattie Maes,et al.  Your Place and Mine: Designing a Shared VR Experience for Remotely Located Users , 2018, Conference on Designing Interactive Systems.

[38]  Adam M. Smith,et al.  Emergent Remix Culture in an Anonymous Collaborative Art System , 2012, Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment.

[39]  Jennifer Healey,et al.  Augmented Reality through Wearable Computing , 1997, Presence: Teleoperators & Virtual Environments.

[40]  Anthony Rowe,et al.  Welcome to my world: demystifying multi-user AR with the cloud: demo abstract , 2018, IPSN.

[41]  K. Williams,et al.  Many Hands Make Light the Work: The Causes and Consequences of Social Loafing , 1979 .

[42]  Gierad Laput,et al.  VizMap: Accessible Visual Information Through Crowdsourced Map Reconstruction , 2016, ASSETS.

[43]  Xu Wang,et al.  A case study of Augmented Reality simulation system application in a chemistry course , 2014, Comput. Hum. Behav..

[44]  Dieter Schmalstieg,et al.  Location based Applications for Mobile Augmented Reality , 2003, AUIC.