User experience and interaction performance in 2D/3D telecollaboration

Abstract Affordable 3D cameras, mixed reality headsets, and 3D displays have recently pushed the Augmented Reality (AR) and Virtual Reality (VR) technologies into the consumer market. While these technologies have been adopted in video-game and entertainment industry, the adoption for professional use, such as in industrial and business environment, health-care, and education is still lagging behind. In light of recent advances in mobile communications, AR/VR could pave the way for novel interaction and collaboration of geographically distributed users. Despite the technology being available, majority of communication is still accomplished using traditional video conferencing technology which lacks interactivity, depth perception, and ability to convey non-verbal cues in communication. 3D systems for communication have been proposed to overcome these limitations; however, very few studies looked into the performance and interaction with such technologies. In this paper, we report on a study that examined telecollaboration scenario with three different modalities: 2D video-conferencing, 3D stereoscopic interface, and 3D stereoscopic interface with augmented visual feedback. Twenty participants worked in pairs, assuming the roles of instructor and worker, to remotely interact and perform a set of assembly tasks.

[1]  D. W. F. van Krevelen,et al.  A Survey of Augmented Reality Technologies, Applications and Limitations , 2010, Int. J. Virtual Real..

[2]  John C. Tang,et al.  What video can and cannot do for collaboration: A case study , 2005, Multimedia Systems.

[3]  Keita Higuchi,et al.  ImmerseBoard: Immersive Telepresence Experience using a Digital Whiteboard , 2015, CHI.

[4]  Wei Tsang Ooi,et al.  Mixing Tile Resolutions in Tiled Video: A Perceptual Quality Assessment , 2014, NOSSDAV 2014.

[5]  S. Tachakra Depth perception in telemedical consultations. , 2001, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[6]  Tobias Höllerer,et al.  In touch with the remote world: remote collaboration with augmented reality drawings and virtual navigation , 2014, VRST '14.

[7]  John C. Tang,et al.  3D Collaboration Method over HoloLens™ and Skype™ End Points , 2015, ImmersiveME@ACM Multimedia.

[8]  Henry Fuchs,et al.  Immersive 3D Telepresence , 2014, Computer.

[9]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[10]  Benjamin Cohen,et al.  Design and Implementation of TeleAdvisor: a Projection-Based Augmented Reality System for Remote Collaboration , 2015, Computer Supported Cooperative Work (CSCW).

[11]  Martin Schrepp,et al.  Construction and Evaluation of a User Experience Questionnaire , 2008, USAB.

[12]  John P. McIntire,et al.  Stereoscopic 3D displays and human performance: A comprehensive review , 2014, Displays.

[13]  Dieter Fox,et al.  DynamicFusion: Reconstruction and tracking of non-rigid scenes in real-time , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Dmitriy Vatolin,et al.  Temporal filtering for depth maps generated by Kinect depth camera , 2011, 2011 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON).

[15]  Gwyneth Doherty-Sneddon,et al.  Face-to-face and video mediated communication: a comparison of dialogue structure and task performance , 1997 .

[16]  Thomas S. Huang,et al.  Technologies for virtual reality/tele—immersion applications: issues of research in image display and global networking , 2001 .

[17]  Dieter Fox,et al.  DuploTrack: a real-time system for authoring and guiding duplo block assembly , 2012, UIST.

[18]  Weidong Huang,et al.  3D helping hands: a gesture based MR system for remote collaboration , 2012, VRCAI '12.

[19]  Matthias Nießner,et al.  VolumeDeform: Real-Time Volumetric Non-rigid Reconstruction , 2016, ECCV.

[20]  Ruzena Bajcsy,et al.  Real-time communication for Kinect-based telerehabilitation , 2017, Future Gener. Comput. Syst..

[21]  Ruzena Bajcsy,et al.  3D teleimmersion for collaboration and interaction of geographically distributed users , 2012, Virtual Reality.

[22]  Markus Funk,et al.  Comparing Tactile, Auditory, and Visual Assembly Error-Feedback for Workers with Cognitive Impairments , 2016, ASSETS.

[23]  Huiyang Li,et al.  Effects of HoloLens in Collaboration: A Case in Navigation Tasks , 2017 .

[24]  Yuichi Ohta,et al.  [POSTER] Remote Mixed Reality System Supporting Interactions with Virtualized Objects , 2015, 2015 IEEE International Symposium on Mixed and Augmented Reality.

[25]  Allen Y. Yang,et al.  Augmented Telemedicine Platform for Real-Time Remote Medical Consultation , 2017, MMM.

[26]  Thierry Duval,et al.  Vishnu: virtual immersive support for HelpiNg users an interaction paradigm for collaborative remote guiding in mixed reality , 2016, 2016 IEEE Third VR International Workshop on Collaborative Virtual Environments (3DCVE).

[27]  Kelvin Sung,et al.  A Framework for analyzing AR/VR Collaborations: An initial result , 2017, 2017 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA).

[28]  Daniel Robert Franklin,et al.  A Study of User Perception of the Quality of Video Content Rendered Inside a 3-D Virtual Environment , 2017, IEEE Journal of Selected Topics in Signal Processing.

[29]  Mark Burgess,et al.  Remote real-time collaboration through synchronous exchange of digitised human-workpiece interactions , 2017, Future Gener. Comput. Syst..

[30]  Shahram Izadi,et al.  3D-board: a whole-body remote collaborative whiteboard , 2014, UIST.

[31]  Judith Amores,et al.  ShowMe: A Remote Collaboration System that Supports Immersive Gestural Communication , 2015, CHI Extended Abstracts.

[32]  Sarah Sharples,et al.  Virtual reality induced symptoms and effects (VRISE): Comparison of head mounted display (HMD), desktop and projection display systems , 2008, Displays.

[33]  A. Neubauer,et al.  Two- vs. three-dimensional presentation of mental rotation tasks: Sex differences and effects of training on performance and brain activation , 2010, Intelligence.