A quality of experience evaluation system and research challenges for networked virtual reality-based teleoperation applications

Teleoperation applications are designed to assist humans in operating complex mechanical systems. Interfaces to teleoperation systems have always been challenging. Recently the potential of virtual reality (VR) has been a topic of interest, particularly with the availability of head mounted displays and interaction controller devices. As a result, research into the viability of VR as a technology to support remote operation and improved human machine interaction has emerged. It is assumed that VR will offer the user a more immersive and natural experience when operating a virtual representation of a mechanical system. To achieve this, there are a number of research challenges that need to be addressed. In this short paper, we introduce and discuss key challenges for VR-based teleoperation systems. Since the key focus of our work is understand user quality of experience (QoE) of VR-based teleoperation applications, the design and implementation of an implicit and explicit QoE Evaluation system is also presented.

[1]  Simon Davis,et al.  Comparing the onset of cybersickness using the Oculus Rift and two virtual roller coasters , 2015 .

[2]  Sean Brennan,et al.  Comparing User QoE via Physiological and Interaction Measurements of Immersive AR and VR Speech and Language Therapy Applications , 2017, ACM Multimedia.

[3]  Alexander Raake,et al.  Quality of Experience: Advanced Concepts, Applications and Methods , 2014 .

[4]  Fernando Boronat,et al.  Inter-destination multimedia synchronization: schemes, use cases and standardization , 2012, Multimedia Systems.

[5]  Sebastian Möller,et al.  Using eye-tracking and correlates of brain activity to predict quality scores , 2014, 2014 Sixth International Workshop on Quality of Multimedia Experience (QoMEX).

[6]  ITU-T Rec. P.910 (04/2008) Subjective video quality assessment methods for multimedia applications , 2009 .

[7]  Thomas B. Sheridan,et al.  Space teleoperation through time delay: review and prognosis , 1993, IEEE Trans. Robotics Autom..

[8]  M. Arditti Unity , 1957, Journal of the Irish Medical Association.

[9]  Tobias Hoßfeld,et al.  SOS: The MOS is not enough! , 2011, 2011 Third International Workshop on Quality of Multimedia Experience.

[10]  Martijn J. Schuemie,et al.  Research on Presence in Virtual Reality: A Survey , 2001, Cyberpsychology Behav. Soc. Netw..

[11]  M. Rupp,et al.  Empirical study of subjective quality for Massive Multiplayer Games , 2008, 2008 15th International Conference on Systems, Signals and Image Processing.

[12]  Kasia Muldner,et al.  Controlling VR games: control schemes and the player experience , 2017, Entertain. Comput..

[13]  Roland Rosen,et al.  About The Importance of Autonomy and Digital Twins for the Future of Manufacturing , 2015 .

[14]  Tobias Hoßfeld,et al.  An Evaluation of QoE in Cloud Gaming Based on Subjective Tests , 2011, 2011 Fifth International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing.

[15]  Carl Gutwin,et al.  The effects of network delays on group work in real-time groupware , 2001, ECSCW.

[16]  Niall Murray,et al.  A QoE evaluation of immersive augmented and virtual reality speech & language assessment applications , 2017, International Workshop on Quality of Multimedia Experience.

[17]  Peter A. Howarth,et al.  Visual fatigue caused by viewing stereoscopic motion images: Background, theories, and observations , 2008, Displays.

[18]  Niall Murray,et al.  A QoE assessment method based on EDA, heart rate and EEG of a virtual reality assistive technology system , 2018, MMSys.