A Study on the Presence of Immersive User Interface in Collaborative Virtual Environments Application

This study proposes a collaboration-based interaction as a new method for providing an improved presence and a satisfying experience to various head-mounted display (HMD) users utilized in immersive virtual reality (IVR), and analyzes the experiences (improved presence, satisfying enjoyment, and social interaction) of applying collaboration to user interfaces. The key objective of the proposed interaction is to provide an environment where HMD users are able to collaborate with each other, based on their differentiated roles and behaviors. To this end, a collaboration-based interaction structured in three parts was designed, including a synchronization procedure and a communication interface that enable users to swiftly execute common goals with precision, based on immersive interactions that allow users to directly exchange information and provide feedback with their hands and feet. Moreover, experimental VR applications were built to systematically analyze the improved presence, enjoyment, and social interaction experienced by users through collaboration. Finally, by conducting a survey on the participants of the experiment, this study confirmed that the proposed interface indeed provided users with an improved presence and a satisfying experience, based on collaboration.

[1]  Thijs Roumen,et al.  TurkDeck: Physical Virtual Reality Based on People , 2015, UIST.

[2]  Jinmo Kim,et al.  MAVE: Maze‐based immersive virtual environment for new presence and experience , 2017, Comput. Animat. Virtual Worlds.

[3]  Vincent Hayward,et al.  Preliminary Experiment Combining Virtual Reality Haptic Shoes and Audio Synthesis , 2010, EuroHaptics.

[4]  Jinxiang Chai,et al.  Combining marker-based mocap and RGB-D camera for acquiring high-fidelity hand motion data , 2012, SCA '12.

[5]  Andrea Tagliasacchi,et al.  Low-Dimensionality Calibration through Local Anisotropic Scaling for Robust Hand Model Personalization , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[6]  Olga De Troyer,et al.  Maze commander: a collaborative asynchronous game using the oculus rift & the sifteo cubes , 2014, CHI PLAY.

[7]  Christer Carlsson,et al.  DIVE A multi-user virtual reality system , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[8]  Ravish Mehra,et al.  Efficient HRTF-based Spatial Audio for Area and Volumetric Sources , 2016, IEEE Transactions on Visualization and Computer Graphics.

[9]  Julian Frommel,et al.  ShareVR: Enabling Co-Located Experiences for Virtual Reality between HMD and Non-HMD Users , 2017, CHI.

[10]  Zhichao Dong,et al.  Smooth assembled mappings for large-scale real walking , 2017, ACM Trans. Graph..

[11]  Patrick Baudisch,et al.  VirtualSpace - Overloading Physical Space with Multiple Virtual Reality Users , 2018, CHI.

[12]  Hannes Kaufmann,et al.  Flexible spaces: Dynamic layout generation for infinite walking in virtual environments , 2013, 2013 IEEE Symposium on 3D User Interfaces (3DUI).

[13]  Ivan E. Sutherland,et al.  A head-mounted three dimensional display , 1968, AFIPS Fall Joint Computing Conference.

[14]  Mohamad Bilal Ali,et al.  Collaborative Augmented Reality in Education: A Review , 2014, 2014 International Conference on Teaching and Learning in Computing and Engineering.

[15]  Vincent Hayward,et al.  Haptic interfaces and devices , 2004 .

[16]  Mark Billinghurst,et al.  Exploring enhancements for remote mixed reality collaboration , 2017, SIGGRAPH ASIA Mobile Graphics and Interactive Applications.

[17]  Mingyu Kim,et al.  A Study on Immersion and VR Sickness in Walking Interaction for Immersive Virtual Reality Applications , 2017, Symmetry.

[18]  D. Kort,et al.  The Game Experience Questionnaire , 2013 .

[19]  Dinesh Manocha,et al.  Interactive Sound Propagation and Rendering for Large Multi-Source Scenes , 2016, ACM Trans. Graph..

[20]  Pedro Lopes,et al.  Haptic turk: A motion platform based on people , 2014, HAPTICS.

[21]  Michael J. Singer,et al.  The Factor Structure of the Presence Questionnaire , 2005, Presence: Teleoperators & Virtual Environments.

[22]  Jérôme Royan,et al.  Collaborators awareness for user cohabitation in co-located collaborative virtual environments , 2017, VRST.

[23]  Morten Fjeld,et al.  Immersive environment for distributed creative collaboration , 2017, VRST.

[24]  Jinmo Kim,et al.  A Study on Immersion of Hand Interaction for Mobile Platform Virtual Reality Contents , 2017, Symmetry.

[25]  Antonio Frisoli,et al.  A 3-RSR Haptic Wearable Device for Rendering Fingertip Contact Forces , 2017, IEEE Transactions on Haptics.

[26]  Yaser Sheikh,et al.  Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodies , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[27]  Mingyu Kim,et al.  A Study on Interaction of Gaze Pointer-Based User Interface in Mobile Virtual Reality Environment , 2017, Symmetry.

[28]  Mingyu Kim,et al.  A Study on Immersion and Presence of a Portable Hand Haptic System for Immersive Virtual Reality , 2017, Sensors.

[29]  Claudio Pacchierotti,et al.  Towards Wearability in Fingertip Haptics: A 3-DoF Wearable Device for Cutaneous Force Feedback , 2013, IEEE Transactions on Haptics.

[30]  Fabio Poiesi,et al.  TOWARDS GESTURE-BASED MULTI-USER INTERACTIONSIN COLLABORATIVE VIRTUAL ENVIRONMENTS , 2017 .

[31]  Mochimaru Masaaki,et al.  Dollhouse VR: A Multi-view, Multi-user Collaborative Design Workspace with VR Technology , 2016 .

[32]  Yongwan Kim,et al.  Analysis on virtual interaction-induced fatigue and difficulty in manipulation for interactive 3D gaming console , 2011, 2011 IEEE International Conference on Consumer Electronics (ICCE).