Improving awareness for 3D virtual collaboration by embedding the features of users’ physical environments and by augmenting interaction tools with cognitive feedback cues

The feeling of presence is essential for efficient interaction within Virtual Environments (VEs). When a user is fully immersed within a VE through a large immersive display system, his/her feeling of presence can be altered because of disturbing interactions with his/her physical environment, such as collision with hardware parts of the system or loss of tracking. This alteration can be avoided by taking into account the physical features of the user as well as those of the system hardware and embedding them in the VE. Moreover, the 3D abstract representation of these physical features can also be useful for collaboration between distant users because they can make a user aware of the physical limitations of the others he/she is collaborating with. In this paper we present how we use the Immersive Interactive Virtual Cabin (IIVC) model to obtain this virtual representation of the user’s physical environment and we illustrate how this representation can be used in a collaborative navigation task in a VE. We also present how we can add 3D representations of 2D interaction tools in order to cope with asymmetrical collaborative configurations, providing 3D cues for a user to understand the actions of the others even if he/she is not fully immersed in the shared VE. Last, we briefly explain how we plan to enhance 3D interaction and collaboration by embedding a symbolic 3D user representation that will give 3D information about his/her posture.

[1]  Thierry Duval,et al.  Collaborative Scientific Visualization: The COLLAVIZ Framework , 2010 .

[2]  Steve Benford,et al.  Supporting awareness and interaction through collaborative virtual interfaces , 1999, UIST '99.

[3]  Olivier Barais,et al.  Model Driven Language Engineering with Kermeta , 2009, GTTSE.

[4]  Thierry Duval,et al.  A Generic Model for Embedding Users' Physical Workspaces into Multi-Scale Collaborative Virtual Environments , 2010 .

[5]  Michael Zyda,et al.  NPSNET:A Network Software Architecture for LargeScale Virtual Environments , 1994, Presence: Teleoperators & Virtual Environments.

[6]  Michitaka Hirose,et al.  3D User Interfaces: New Directions and Perspectives , 2008, IEEE Computer Graphics and Applications.

[7]  Pavel Zahorik,et al.  Presence as Being-in-the-World , 1998, Presence.

[8]  T. Ichikawa,et al.  Egocentric Object Manipulation in Virtual Environments: Empirical Evaluation of Interaction Techniques , 1998, Comput. Graph. Forum.

[9]  Steve Benford,et al.  Managing mutual awareness in collaborative virtual environments , 1994 .

[10]  Christophe Garcia,et al.  Virtual meeting in cyberstage , 1998, VRST '98.

[11]  Marc Olano,et al.  3DM: a three dimensional modeler using a head-mounted display , 1992, I3D '92.

[12]  Anatole Lécuyer,et al.  3-Hand Manipulation of Virtual Objects , 2009, EGVE/ICAT/EuroVR.

[13]  Jurriaan D. Mulder,et al.  A modular system for collaborative desktop VR/AR with a shared workspace , 2004, IEEE Virtual Reality 2004.

[14]  Daiki Matsuda,et al.  Escape from Meadwyn 4: A cross-platform environment for collaborative navigation tasks , 2012, 2012 IEEE Symposium on 3D User Interfaces (3DUI).

[15]  Maud Marchal,et al.  The magic barrier tape: a novel metaphor for infinite navigation in virtual worlds with a restricted walking workspace , 2009, VRST '09.

[16]  Eric D. Ragan,et al.  Collaborative navigation in virtual search and rescue , 2012, 2012 IEEE Symposium on 3D User Interfaces (3DUI).

[17]  Charles Pontonnier,et al.  From motion capture to muscle forces in the human elbow aimed at improving the ergonomics of workstations , 2010 .

[18]  Sriram Subramanian,et al.  Talking about tactile experiences , 2013, CHI.

[19]  Marcelo Knörich Zuffo,et al.  Point and go: Exploring 3D virtual environments , 2012, 2012 IEEE Symposium on 3D User Interfaces (3DUI).

[20]  P. Baranyi,et al.  Definition and synergies of cognitive infocommunications , 2012 .

[21]  Sharif Razzaque,et al.  Redirected Walking , 2001, Eurographics.

[22]  Bruno Arnaldi,et al.  A General Framework for Cooperative Manipulation in Virtual Environments , 1999, EGVE.

[23]  Thierry Duval,et al.  Embedding the features of the users' physical environments to improve the feeling of presence in collaborative Virtual Environments , 2012, 2012 IEEE 3rd International Conference on Cognitive Infocommunications (CogInfoCom).

[24]  Thierry Duval,et al.  A New Adaptive Data Distribution Model for Consistency Maintenance in Collaborative Virtual Environments , 2010, EGVE/EuroVR/VEC.

[25]  Charles Pontonnier,et al.  Designing and evaluating a workstation in real and virtual environment: From digital mock-up to realization , 2012, 2012 IEEE 3rd International Conference on Cognitive Infocommunications (CogInfoCom).

[26]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[27]  Justin C. D. Savage,et al.  Symmetric and asymmetric action integration during cooperative object manipulation in virtual environments , 2002 .

[28]  Chris Hand,et al.  A Survey of 3D Interaction Techniques , 1997, Comput. Graph. Forum.

[29]  Thierry Duval,et al.  Enabling Collaboration between Heterogeneous 3D Viewers through a PAC-C3D Modeling of the Shared Virtual Environment , 2011 .

[30]  Cédric Dumas,et al.  Spin: A 3D interface for cooperative work , 1999, Virtual Reality.

[31]  Colin Ware,et al.  Selection using a one-eyed cursor in a fish tank VR environment , 1997, TCHI.

[32]  Thierry Duval,et al.  An asymmetric 2D Pointer/3D Ray for 3D interaction within collaborative virtual environments , 2009, Web3D '09.

[33]  Sofie Notelaers,et al.  HeatMeUp: A 3DUI serious game to explore collaborative wayfinding , 2012, 2012 IEEE Symposium on 3D User Interfaces (3DUI).

[34]  Emmanuel Frécon,et al.  Building distributed virtual environments to support collaborative work , 1998, VRST '98.

[35]  Jurriaan D. Mulder,et al.  Colorplate: A Modular System for Collaborative Desktop VR/AR with a Shared Workspace , 2004, VR.

[36]  Steve Benford,et al.  Collaborative virtual environments : digital places and spaces for interaction , 2001 .

[37]  Peter Galambos,et al.  VirCA as Virtual Intelligent Space for RT-Middleware , 2011, 2011 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM).

[38]  Thierry Duval,et al.  Evaluation of remote collaborative manipulation for scientific data analysis , 2012, VRST '12.

[39]  Doug A. Bowman,et al.  Testbed Evaluation of Virtual Environment Interaction Techniques , 2001, Presence Teleoperators Virtual Environ..

[40]  Christina Vasilakis,et al.  Multi-perspective collaborative design in persistent networked virtual environments , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.

[41]  Thierry Duval,et al.  Collaborative exploration in a multi-scale shared virtual environment , 2012, 2012 IEEE Symposium on 3D User Interfaces (3DUI).

[42]  Thierry Duval,et al.  Guiding Techniques for Collaborative Exploration in Multi-scale Shared Virtual Environments , 2013, GRAPP/IVAPP.

[43]  Kees Overbeeke,et al.  Designing in virtual reality: implementing perception-action coupling with affordances , 1994 .

[44]  Alan Munro,et al.  Collaborative virtual environments , 2001, CACM.

[45]  Randy Pausch,et al.  Virtual reality on a WIM: interactive worlds in miniature , 1995, CHI '95.

[46]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[47]  Andrew S. Forsberg,et al.  Aperture based selection for immersive virtual environments , 1996, UIST '96.

[48]  Timothy P. McNamara,et al.  Exploring large virtual environments with an HMD when physical space is limited , 2007, APGV.

[49]  Thierry Duval,et al.  Collaboration between Networked Heterogeneous 3D Viewers through a PAC-C3D Modeling of the Shared Virtual Environment , 2011 .

[50]  Steve Benford,et al.  Collaborative virtual environments , 2001, CACM.