Delay Impacts on EEG-Based Determination of the Human Visual Interface QoE for Virtual and Augmented Realities

The emergence of 5G services includes those requiring extremely low-latency for command and control application scenarios in the low millisecond range. With a significant human-machine interaction component, the Tactile Internet will require that the experiences based on the human visual interface can be dynamically adjusted within similar time frames. In this paper, we evaluate the impact that different delays currently attainable with commercial hardware would have on predicting the Quality of Experience (QoE) with immersive images. Specifically, we employ electroencephalography (EEG) data to predict how future subjects would determine the media quality in a Passive Human In-the-Loop (PHIL) scenario. This initial extension of our prior work focuses specifically on the delay in the gathering and processing of data and presents a first foray of bringing the passive human-in-the-loop QoE adjustment approach to the Tactile Internet. We find that there is limited value in increasing the delays of two different approaches to predicting the QoE. We additionally note that current approaches to predicting a user's QoE based on other users' EEG patterns exhibit only limited prediction accuracy.

[1]  Patrick Seeling,et al.  Augmented vision and Quality of Experience assessment: Towards a unified evaluation framework , 2015, 2015 IEEE International Conference on Communication Workshop (ICCW).

[2]  Cristina Hava Muntean,et al.  User-centered EEG-based multimedia quality assessment , 2013, 2013 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[3]  Peter Schelkens,et al.  Qualinet White Paper on Definitions of Quality of Experience , 2013 .

[4]  Patrick Seeling,et al.  Towards still image experience predictions in augmented vision settings , 2017, 2017 14th IEEE Annual Consumer Communications & Networking Conference (CCNC).

[5]  Marcus A. Magnor,et al.  Assessing the quality of compressed images using EEG , 2011, 2011 18th IEEE International Conference on Image Processing.

[6]  Lea Skorin-Kapov,et al.  A Survey of Emerging Concepts and Challenges for QoE Management of Multimedia Services , 2018, ACM Trans. Multim. Comput. Commun. Appl..

[7]  Cesare Furlanello,et al.  A Comparison of MCC and CEN Error Measures in Multi-Class Prediction , 2010, PloS one.

[8]  Sebastian Bosse,et al.  Toward a Direct Measure of Video Quality Perception Using EEG , 2012, IEEE Transactions on Image Processing.

[9]  Patrick Seeling,et al.  Towards Prediction of Immersive Virtual Reality Image Quality of Experience and Quality of Service , 2018, Future Internet.

[10]  Patrick Seeling,et al.  Visual Interface Evaluation for Wearables Datasets: Predicting the Subjective Augmented Vision Image QoE and QoS , 2017, Future Internet.

[11]  Naeem Ramzan,et al.  Perceptual video quality evaluation by means of physiological signals , 2017, 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX).

[12]  Thomas Wiegand,et al.  Brain-Computer Interfacing for multimedia quality assessment , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[13]  David M. W. Powers,et al.  Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation , 2011, ArXiv.

[14]  Sebastian Bosse,et al.  EEG-based classification of video quality perception using steady state visual evoked potentials (SSVEPs) , 2015, Journal of neural engineering.

[15]  Peter Reichl,et al.  Logarithmic laws in service quality perception: where microeconomics meets psychophysics and quality of experience , 2013, Telecommun. Syst..

[16]  Patrick Seeling,et al.  Spherical image QoE approximations for vision augmentation scenarios , 2019, Multimedia Tools and Applications.

[17]  Markus Fiedler,et al.  A generic quantitative relationship between quality of experience and quality of service , 2010, IEEE Network.

[18]  Gerhard P. Fettweis,et al.  The Tactile Internet: Applications and Challenges , 2014, IEEE Vehicular Technology Magazine.

[19]  Charles D. Creusere,et al.  The effect of perceptual video quality on EEG power distribution , 2016, 2016 IEEE International Conference on Image Processing (ICIP).