Workspace Awareness in Collaborative AR using HMDs: A User Study Comparing Audio and Visual Notifications

For most professional tasks nowadays, it is necessary to work in teams. Such collaboration often requires the exchange of visual context-related information among the team members. For so-called shared workspace collaboration, awareness of other people's activities is of utmost importance. We have developed an augmented reality (AR) framework in order to support visual communication between a team of two people who are virtually co-located. We address these people as the remote user, who uses a laptop and the local user, who wears a head-mounted display (HMD) with an RGB camera. The remote user can support the local user in solving a spatial problem by providing instructions as virtual objects in the view of the local user. For placing virtual objects in the shared workspace, we use a state-of-the-art algorithm for localization and mapping without markers. In this paper, we report on a user study that explores on how automatic audio and visual notifications about the remote user's activities affect the collaboration. The results show that in our current implementation, visual notifications are preferred over audio or no notifications independent from the level of difficulty of the task.

[1]  Robert E. Kraut,et al.  Using Visual Information for Grounding and Awareness in Collaborative Tasks , 2012, Hum. Comput. Interact..

[2]  Dragos Datcu,et al.  On the Spot Information in Augmented Reality for Teams in the Security Domain , 2015, CHI Extended Abstracts.

[3]  Meera Blattner,et al.  Earcons and Icons: Their Structure and Common Design Principles , 1989, Hum. Comput. Interact..

[4]  Pedro Antunes,et al.  Reviewing the quality of awareness support in collaborative applications , 2010, J. Syst. Softw..

[5]  Hirokazu Kato,et al.  AR-based Video-Mediated Communication: A Social Presence Enhancing Experience , 2012, 2012 14th Symposium on Virtual and Augmented Reality.

[6]  Robert E. Kraut,et al.  Effects of head-mounted and scene-oriented video systems on remote collaboration on physical tasks , 2003, CHI '03.

[7]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[8]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[9]  Weidong Huang,et al.  HandsIn3D: Supporting Remote Guidance with Immersive Virtual Environments , 2013, INTERACT.

[10]  Carl Gutwin,et al.  A Descriptive Framework of Workspace Awareness for Real-Time Groupware , 2002, Computer Supported Cooperative Work (CSCW).

[11]  Dragos Datcu,et al.  On the Usability of Augmented Reality for Information Exchange in Teams from the Security Domain , 2014, 2014 IEEE Joint Intelligence and Security Informatics Conference.

[12]  Liliana Ardissono,et al.  Managing Context-Dependent Workspace Awareness in an e-Collaboration Environment , 2009, 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology.

[13]  Stuart Anderson,et al.  RemoteFusion: real time depth camera fusion for remote collaboration on physical tasks , 2013, VRCAI '13.

[14]  Hujun Bao,et al.  Robust monocular SLAM in dynamic environments , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[15]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[16]  Carl Gutwin,et al.  Workspace awareness for groupware , 1996, CHI Conference Companion.

[17]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[18]  Tobias Höllerer,et al.  Integrating the physical environment into mobile remote collaboration , 2012, Mobile HCI.

[19]  Kara A. Latorella,et al.  The Scope and Importance of Human Interruption in Human-Computer Interaction Design , 2002, Hum. Comput. Interact..

[20]  Clifton Forlines,et al.  Exploring non-speech auditory feedback at an interactive multi-user tabletop , 2005, Graphics Interface.

[21]  C. D. De Dreu,et al.  Work group diversity and group performance: an integrative model and research agenda. , 2004, The Journal of applied psychology.

[22]  Hideaki Kuzuoka,et al.  Remote collaboration using a shoulder-worn active camera/laser , 2004, Eighth International Symposium on Wearable Computers.

[23]  Paul Dourish,et al.  Awareness and coordination in shared workspaces , 1992, CSCW '92.

[24]  Kjeld Schmidt,et al.  The Problem with `Awareness': Introductory Remarks on `Awareness in CSCW' , 2002, Computer Supported Cooperative Work (CSCW).

[25]  Marco Aurélio Gerosa,et al.  AWARENESS SUPPORT IN THE AULANET LEARNING ENVIRONMENT , 2004 .

[26]  Stephan Lukosch,et al.  As if being there: mediated reality for crime scene investigation , 2012, CSCW '12.

[27]  Arne Jönsson,et al.  Using AR to support cross-organisational collaboration in dynamic tasks , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[28]  Bruce H. Thomas,et al.  Mobile Collaborative Augmented Reality , 2011 .

[29]  Robert E. Kraut,et al.  Coordination of communication: effects of shared visual context on collaborative work , 2000, CSCW '00.

[30]  Carl Gutwin,et al.  Chalk sounds: the effects of dynamic synthesized audio on workspace awareness in distributed groupware , 2011, CSCW '11.