Floor-Projected Guidance Cues for Collaborative Exploration of Spatial Augmented Reality Setups

In this paper we present a floor-based user interface (UI) that allows multiple users to explore a spatial augmented reality (SAR) environment with both monoscopic and stereoscopic projections. Such environments are characterized by a low level of user instrumentation and the capability of providing a shared interaction space for multiple users. However, projector-based systems using stereoscopic display are usually single-user setups, since they can provide the correct perspective for only one tracked person. To address this problem, we developed a set of guidance cues, which are projected onto the floor in order to assist multiple users regarding (i) the interaction with the SAR system, (ii) the identification of regions of interest and ideal viewpoints, and (iii) the collaboration with each other. In a user study with 40 participants all cues were evaluated and a set of feedback elements, which are essential to guarantee an intuitive self-explaining interaction, was identified. The results of the study also indicate that the developed UI guides users to more favorable viewpoints and therefore is able to improve the experience in a multi-user SAR environment.

[1]  Patrick Baudisch,et al.  GravitySpace: tracking users and their poses in a smart room using a pressure-sensing floor , 2013, CHI Extended Abstracts.

[2]  Eyal Ofek,et al.  IllumiRoom: peripheral projected illusions for interactive experiences , 2013, SIGGRAPH '13.

[3]  Jeremy R. Cooperstock,et al.  Contact sensing and interaction techniques for a distributed, multimodal floor display , 2010, 2010 IEEE Symposium on 3D User Interfaces (3DUI).

[4]  Pierre David Wellner,et al.  Interacting with paper on the DigitalDesk , 1993, CACM.

[5]  Xavier Granier,et al.  The Revealing Flashlight: Interactive Spatial Augmented Reality for Detail Exploration of Cultural Heritage Artifacts , 2014, JOCCH.

[6]  Anselm Grundhöfer,et al.  Projection-Based Augmented Reality in Disney Theme Parks , 2012, Computer.

[7]  Dieter Schmalstieg,et al.  Experiences with Handheld Augmented Reality , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[8]  Luciano Gamberini,et al.  Presence in the age of social networks: augmenting mediated environments with feedback on group activity , 2009, Virtual Reality.

[9]  Jeremy R. Cooperstock,et al.  Touch Is Everywhere: Floor Surfaces as Ambient Haptic Interfaces , 2009, IEEE Transactions on Haptics.

[10]  Michael Burmester,et al.  AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität , 2003, MuC.

[11]  Michael Neff,et al.  Communication Behavior in Embodied Virtual Reality , 2018, CHI.

[12]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[13]  Volker Scholz,et al.  An Augmented Reality museum guide , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[14]  Gregory D. Abowd,et al.  Cyberguide: A mobile context‐aware tour guide , 1997, Wirel. Networks.

[15]  Blair MacIntyre,et al.  Augmented reality as a new media experience , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[16]  Greg Welch,et al.  The office of the future: a unified approach to image-based modeling and spatially immersive displays , 1998, SIGGRAPH.

[17]  Hrvoje Benko,et al.  Dyadic projected spatial augmented reality , 2014, UIST.

[18]  Jun Rekimoto,et al.  Augmented surfaces: a spatially continuous work space for hybrid computing environments , 1999, CHI '99.

[19]  Saul Greenberg,et al.  Proxemic interaction: designing for a proximity and orientation-aware environment , 2010, ITS '10.

[20]  Martin Ludvigsen,et al.  "Help Me Pull That Cursor" A Collaborative Interactive Floor Enhancing Community Interaction , 2004, Australas. J. Inf. Syst..

[21]  Bruce H. Thomas,et al.  Visualization of off-surface 3D viewpoint locations in spatial augmented reality , 2013, SUI '13.

[22]  Blair MacIntyre,et al.  RoomAlive: magical experiences enabled by scalable, adaptive projector-camera units , 2014, UIST.

[23]  Dongjun Suh,et al.  Ubi-Floor: Design and Pilot Implementation of an Interactive Floor System , 2010, 2010 Second International Conference on Intelligent Human-Machine Systems and Cybernetics.

[24]  Ralph Schroeder,et al.  Small-Group Behavior in a Virtual and Real Environment: A Comparative Study , 2000, Presence: Teleoperators & Virtual Environments.

[25]  Insook Choi,et al.  Foot-mounted gesture detection and its application in virtual environments , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[26]  Joseph J. LaViola,et al.  Hands-free multi-scale navigation in virtual environments , 2001, I3D '01.

[27]  Jeremy R. Cooperstock,et al.  Interacting with Augmented Floor Surfaces , 2013 .

[28]  Patrick Baudisch,et al.  Multitoe: high-precision interaction with back-projected floors based on high-resolution multi-touch input , 2010, UIST.

[29]  Greg Welch,et al.  Shader Lamps: Animating Real Objects With Image-Based Illumination , 2001, Rendering Techniques.

[30]  Oliver Bimber,et al.  The virtual showcase as a new platform for augmented reality digital storytelling , 2003, IPT/EGVE.

[31]  Bernd Fröhlich,et al.  C1x6: a stereoscopic six-user display for co-located collaboration in shared virtual environments , 2011, SA '11.

[32]  Patrick Baudisch,et al.  Kickables: tangibles for feet , 2014, CHI.

[33]  Gerd Bruder,et al.  A Layer-based 3D Virtual Environment for Architectural Collaboration , 2015 .

[34]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[35]  Kaj Grønbæk,et al.  IGameFloor: a platform for co-located collaborative games , 2007, ACE '07.

[36]  Frank Steinicke,et al.  A Projection-Based Augmented Reality Setup for Blended Museum Experiences , 2017, ICAT-EGVE.

[37]  Matthew Chalmers,et al.  Lessons from the lighthouse: collaboration in a shared mixed reality system , 2003, CHI '03.

[38]  Claudio S. Pinhanez The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces , 2001, UbiComp.

[39]  Ramesh Raskar,et al.  Modern approaches to augmented reality: introduction to current approaches , 2006, SIGGRAPH Courses.