A QoE assessment method based on EDA, heart rate and EEG of a virtual reality assistive technology system

The1 key aim of various assistive technology (AT) systems is to augment an individual's functioning whilst supporting an enhanced quality of life (QoL). In recent times, we have seen the emergence of Virtual Reality (VR) based assistive technology systems made possible by the availability of commercially available Head Mounted Displays (HMDs). The use of VR for AT aims to support levels of interaction and immersion not previously possibly with more traditional AT solutions. Crucial to the success of these technologies is understanding, from the user perspective, the influencing factors that affect the user Quality of Experience (QoE). In addition to the typical QoE metrics, other factors to consider are human behavior like mental and emotional state, posture and gestures. In terms of trying to objectively quantify such factors, there are wide ranges of wearable sensors that are able to monitor physiological signals and provide reliable data. In this demo, we will capture and present the users EEG, heart Rate, EDA and head motion during the use of AT VR application. The prototype is composed of the sensor and presentation systems: for acquisition of biological signals constituted by wearable sensors and the virtual wheelchair simulator that interfaces to a typical LCD display.

[1]  Alexandre Cardoso,et al.  An middleware for motion capture devices applied to virtual rehab , 2013, 2013 IEEE Virtual Reality (VR).

[2]  Basel Kikhia,et al.  Utilizing a Wristband Sensor to Measure the Stress Level for People with Dementia , 2016, Sensors.

[3]  Alexander Raake,et al.  Quality of Experience: Advanced Concepts, Applications and Methods , 2014 .

[4]  Robert A. Rose,et al.  Altered heart rate regulation by the autonomic nervous system in mice lacking natriuretic peptide receptor C (NPR-C) , 2017, Scientific Reports.

[5]  Joris C Verster,et al.  The effect of stress on core and peripheral body temperature in humans , 2013, Stress.

[6]  Sean Brennan,et al.  Comparing User QoE via Physiological and Interaction Measurements of Immersive AR and VR Speech and Language Therapy Applications , 2017, ACM Multimedia.

[7]  Eduardo Lázaro Martins Naves,et al.  REALIDADE VIRTUAL E TECNOLOGIA ASSISTIVA: AMBIENTE SEGURO PARA TREINAMENTO DE CADEIRANTES CONTROLADO POR SINAIS ELETROMIOGRÁFICOS , 2016 .

[8]  Phuoc Tran-Gia,et al.  Best Practices for QoE Crowdtesting: QoE Assessment With Crowdsourcing , 2014, IEEE Transactions on Multimedia.

[9]  Cristina Hava Muntean,et al.  User-centered EEG-based multimedia quality assessment , 2013, 2013 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[10]  Martin Ouwerkerk,et al.  Can mobile skin conductance assessments be helpful in signalling imminent inpatient aggression? , 2012, Acta Neuropsychiatrica.

[11]  Christian Timmerer,et al.  An evaluation of Heart Rate and ElectroDermal Activity as an objective QoE evaluation method for immersive virtual reality environments , 2016, 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX).

[12]  Ramin Skibba,et al.  Virtual reality comes of age , 2018, Nature.

[13]  C. C. Duncan,et al.  Event-related potentials in clinical research: Guidelines for eliciting, recording, and quantifying mismatch negativity, P300, and N400 , 2009, Clinical Neurophysiology.

[14]  Maja Matijasevic,et al.  Performance and QoE assessment of HTC Vive and Oculus Rift for pick-and-place tasks in VR , 2017, 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX).

[15]  Niall Murray,et al.  A QoE evaluation of immersive augmented and virtual reality speech & language assessment applications , 2017, International Workshop on Quality of Multimedia Experience.

[16]  Eduardo Lázaro Martins Naves,et al.  Electric-Powered Wheelchair Control Using Eye Tracking Techniques , 2016 .

[17]  C. Milne AUTONOMIC NERVOUS SYSTEM , 1957, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[18]  Zhan Zhao,et al.  Detecting work-related stress with a wearable device , 2017, Comput. Ind..

[19]  S. Coyle,et al.  Brain–computer interfaces: a review , 2003 .

[20]  Vicente Ferreira de Lucena,et al.  Multimodal System for Training at Distance in a Virtual or Augmented Reality Environment for Users of Electric-Powered Wheelchairs , 2016 .

[21]  Martin L. Griss,et al.  Activity-Aware Mental Stress Detection Using Physiological Sensors , 2010, MobiCASE.