Understanding the design space of referencing in collaborative augmented reality environments

For collaborative environments to be successful, it is critical that participants have the ability to generate effective references. Given the heterogeneity of the objects and the myriad of possible scenarios for collaborative augmented reality environments, generating meaningful references within them can be difficult. Participants in co-located physical spaces benefit from non-verbal communication, such as eye gaze, pointing and body movement; however, when geographically separated, this form of communication must be synthesized using computer-mediated techniques. We have conducted an exploratory study using a collaborative building task of constructing both physical and virtual models to better understand inter-referential awareness -- or the ability for one participant to refer to a set of objects, and for that reference to be understood. Our contributions are not necessarily in presenting novel techniques, but in narrowing the design space for referencing in collaborative augmented reality. This study suggests collaborative reference preferences are heavily dependent on the context of the workspace.

[1]  FuchsHenry,et al.  Merging virtual objects with the real world , 1992 .

[2]  Li-Te Cheng,et al.  Dealing with speed and robustness issues for video-based registration on a wearable computing platform , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[3]  Frank Biocca,et al.  Attention funnel: omnidirectional 3D cursor for mobile augmented reality platforms , 2006, CHI.

[4]  Irene T. Weber,et al.  Emphasizing the area of interest using real-time shaders , 2005, SIGGRAPH '05.

[5]  Robert E. Kraut,et al.  Coordination of communication: effects of shared visual context on collaborative work , 2000, CSCW '00.

[6]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[7]  Steve Benford,et al.  Object-focused interaction in collaborative virtual environments , 2000, TCHI.

[8]  Ryutarou Ohbuchi,et al.  Merging virtual objects with the real world: seeing ultrasound imagery within the patient , 1992, SIGGRAPH.

[9]  Robert E. Kraut,et al.  Collaboration in performance of physical tasks: effects on outcomes and communication , 1996, CSCW '96.

[10]  William W. Gaver The affordances of media spaces for collaboration , 1992, CSCW '92.

[11]  Robert E. Kraut,et al.  Effects of head-mounted and scene-oriented video systems on remote collaboration on physical tasks , 2003, CHI '03.

[12]  Abhishek Ranjan,et al.  An exploratory analysis of partner action and camera control in a video-mediated collaborative task , 2006, CSCW '06.

[13]  Gerd Kortuem,et al.  "Where are you pointing at?" A study of remote collaboration in a wearable videoconference system , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[14]  Blair MacIntyre,et al.  DART: a toolkit for rapid design exploration of augmented reality experiences , 2005, ACM Trans. Graph..

[15]  Michael Bajura,et al.  Merging Virtual Objects with the Real World , 1992 .

[16]  Xilin Chen,et al.  Gestural communication over video stream: supporting multimodal interaction for remote collaborative physical tasks , 2003, ICMI '03.

[17]  Ying Zhu,et al.  A Framework for Inter-referential Awareness in Collaborative Environments , 2006, 2006 International Conference on Collaborative Computing: Networking, Applications and Worksharing.

[18]  Bruce H. Thomas,et al.  Glove Based User Interaction Techniques for Augmented Reality in an Outdoor Environment , 2002, Virtual Reality.

[19]  Irene T. Weber,et al.  AMMP-Vis: a collaborative virtual environment for molecular modeling , 2005, VRST '05.

[20]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[21]  Hirokazu Kato,et al.  Asymmetries in collaborative wearable interfaces , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[22]  Bruce H. Thomas,et al.  Implementation of god-like interaction techniques for supporting collaboration between outdoor AR and indoor tabletop users , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[23]  Anoop Gupta,et al.  Communication behaviors of co-located users in collaborative AR interfaces , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[24]  David E. Breen,et al.  Distributed Augmented Reality for Collaborative Design Applications , 1995, Comput. Graph. Forum.