You Invaded my Tracking Space! Using Augmented Virtuality for Spotting Passersby in Room-Scale Virtual Reality

With the proliferation of room-scale Virtual Reality (VR), more and more users install a VR system in their homes. When users are in VR, they are usually completely immersed in their application. However, sometimes passersby invade these tracking spaces and walk up to users that are currently immersed in VR to try and interact with them. As this either scares the user in VR or breaks the user's immersion, research has yet to find a way to seamlessly represent physical passersby in virtual worlds. In this paper, we propose and evaluate three different ways to represent physical passersby in a Virtual Environment using Augmented Virtuality. The representations encompass showing a Pointcloud, showing a 3D-Model, and showing an Image Overlay of the passerby. Our results show that while an Image Overlay and a 3D-Model are the fastest representations to spot passersby, the 3D-Model and the Pointcloud representations were the most accurate.

[1]  David A. Forsyth,et al.  Where's My Drink? Enabling Peripheral Real World Interactions While Using HMDs , 2015, ArXiv.

[2]  Patrick Baudisch,et al.  VirtualSpace - Overloading Physical Space with Multiple Virtual Reality Users , 2018, CHI.

[3]  Daniel J. Wigdor,et al.  Annexing Reality: Enabling Opportunistic Use of Everyday Objects as Tangible Proxies in Augmented Reality , 2016, CHI.

[4]  Pedro Lopes,et al.  Haptic turk: A motion platform based on people , 2014, HAPTICS.

[5]  David Lindlbauer,et al.  Remixed Reality: Manipulating Space and Time in Augmented Reality , 2018, CHI.

[6]  Martin Hachet,et al.  Towards a hybrid space combining Spatial Augmented Reality and virtual reality , 2017, 2017 IEEE Symposium on 3D User Interfaces (3DUI).

[7]  Holger Regenbrecht,et al.  An augmented virtuality approach to 3D videoconferencing , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[8]  Ivan E. Sutherland,et al.  Sketchpad a Man-Machine Graphical Communication System , 1899, Outstanding Dissertations in the Computer Sciences.

[9]  Akira Ishii,et al.  ReverseCAVE: providing reverse perspectives for sharing VR experience , 2017, SIGGRAPH Posters.

[10]  Mani Golparvar-Fard,et al.  Enhancing construction hazard recognition with high-fidelity augmented virtuality , 2014 .

[11]  Roderick Murray-Smith,et al.  A Dose of Reality: Overcoming Usability Challenges in VR Head-Mounted Displays , 2015, CHI Extended Abstracts.

[12]  Blair MacIntyre,et al.  RoomAlive: magical experiences enabled by scalable, adaptive projector-camera units , 2014, UIST.

[13]  Mohamed Khamis,et al.  TransparentHMD: revealing the HMD user's face to bystanders , 2017, MUM.

[14]  A. Bruni.  The Social Shaping of Technology (2nd ed.) , 2003 .

[15]  Pierre Jannin,et al.  Augmented virtuality based on stereoscopic reconstruction in multimodal image-guided neurosurgery: methods and performance evaluation , 2005, IEEE Transactions on Medical Imaging.

[16]  Harpreet Sareen,et al.  FaceDisplay: Enabling Multi-User Interaction for Mobile Virtual Reality , 2017, CHI Extended Abstracts.

[17]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[18]  Sebastian Günther,et al.  Slappyfications: Towards Ubiquitous Physical and Embodied Notifications , 2019, CHI Extended Abstracts.

[19]  Thijs Roumen,et al.  TurkDeck: Physical Virtual Reality Based on People , 2015, UIST.

[20]  Charles E. Hughes,et al.  The Shared Imagination: Creative Collaboration in Augmented Virtuality , 2005 .

[21]  Katashi Nagao,et al.  The world through the computer: computer augmented interaction with real world environments , 1995, UIST '95.

[22]  Nathan Rackliffe.  An Augmented Virtuality Display for Improving UAV Usability , 2005 .

[23]  Marc Aurel Schnabel,et al.  From Virtuality to Reality and Back , 2007 .

[24]  Paul Dourish,et al.  Special issue on science fiction and ubiquitous computing , 2014, Personal and Ubiquitous Computing.

[25]  Bruce H. Thomas,et al.  Implementation of god-like interaction techniques for supporting collaboration between outdoor AR and indoor tabletop users , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[26]  Kouta Minamizawa,et al.  FrontFace: facilitating communication between HMD users and outsiders using front-facing-screen HMDs , 2017, MobileHCI.

[27]  Karl-Petter Åkesson,et al.  Windows on the World: An example of Augmented Virtuality , 1997 .

[28]  Mitsunori Tada,et al.  Dollhouse VR: a multi-view, multi-user collaborative design workspace with VR technology , 2015, SIGGRAPH Asia Posters.

[29]  Holger Regenbrecht,et al.  Using Augmented Virtuality for Remote Collaboration , 2004, Presence: Teleoperators & Virtual Environments.

[30]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[31]  Julian Frommel,et al.  ShareVR: Enabling Co-Located Experiences for Virtual Reality between HMD and Non-HMD Users , 2017, CHI.

[32]  Alladi Venkatesh,et al.  The networked home: an analysis of current developments and future trends , 2003, Cognition, Technology & Work.

[33]  Vicki L. Hanson,et al.  Writing about accessibility , 2015, Interactions.

[34]  Eike Langbehn,et al.  Shadow-Avatars : A Visualization Method to Avoid Collisions of Physically Co-Located Users in Room-Scale VR , 2018 .

[35]  Ronald E. Anderson.  Social Impacts of Computing: Codes of Professional Ethics , 1992 .

[36]  Anthony Scavarelli,et al.  VR Collide! Comparing Collision-Avoidance Methods Between Co-located Virtual Reality Users , 2017, CHI Extended Abstracts.

[37]  Hannes Kaufmann,et al.  Mutual collision avoidance during walking in real and collaborative virtual environments , 2018, I3D.

[38]  Martin Hachet,et al.  One Reality: Augmenting How the Physical World is Experienced by combining Multiple Mixed Reality Modalities , 2017, UIST.

[39]  Hannes Kaufmann,et al.  Preventing Imminent Collisions between Co-Located Users in HMD-Based VR in Non-Shared Scenarios , 2017 .

[40]  Marilyn Schwartz,et al.  Guidelines for bias-free writing , 1995 .

[41]  Markus Funk,et al.  Tactile Drones - Providing Immersive Tactile Feedback in Virtual Reality through Quadcopters , 2017, CHI Extended Abstracts.

[42]  Holger Regenbrecht,et al.  Mixed Voxel Reality: Presence and Embodiment in Low Fidelity, Visually Coherent, Mixed Reality Environments , 2017, 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[43]  Wei Xie,et al.  Garden: A Mixed Reality Experience Combining Virtual Reality and 3D Reconstruction , 2016, CHI Extended Abstracts.

[44]  Martin Hachet,et al.  Towards seamless interaction between physical and virtual locations for asymmetric collaboration , 2017, VRST.

[45]  Scott R. Klemmer,et al.  Where do web sites come from?: capturing and interacting with design history , 2002, CHI.

[46]  Niels Henze,et al.  Physical Keyboards in Virtual Reality: Analysis of Typing Performance and Effects of Avatar Hands , 2018, CHI.