Review on using physiology in quality of experience

In the area of Quality of Experience (QoE), one challenge is to design test methodologies in order to evaluate the perceived quality of multimedia content delivered through technical systems. Traditionally, this evaluation is done using subjective opinion tests. However, sometimes it is difficult for observers to communicate the experienced quality through the given scale. Furthermore, those tests do not give insights into how the user is reacting on an internal physiological level. To overcome these issues, one approach is to use physiological measures, in order to derive a direct non-verbal response of the recipient. In this paper, we review studies that have been performed in the domain of QoE using physiological measures and we look into current activities in standardization bodies. We present challenges this research faces. and give an overview on what researchers should be aware of when they want to start working in this research area.

[1]  Touradj Ebrahimi,et al.  EEG correlates during video quality perception , 2014, 2014 22nd European Signal Processing Conference (EUSIPCO).

[2]  Sebastian Möller,et al.  Subjective quality ratings and physiological correlates of synthesized speech , 2013, 2013 Fifth International Workshop on Quality of Multimedia Experience (QoMEX).

[3]  Sebastian Möller,et al.  Brain Activity Correlates of Quality of Experience , 2014, Quality of Experience.

[4]  Sebastian Bosse,et al.  EEG-based classification of video quality perception using steady state visual evoked potentials (SSVEPs) , 2015, Journal of neural engineering.

[5]  Sebastian Möller,et al.  Using electroencephalography to analyze sleepiness due to low-quality audiovisual stimuli , 2016, Signal Process. Image Commun..

[6]  Yodchanan Wongsawat,et al.  WEIGHTED-FREQUENCY INDEX FOR EEG-BASED MENTAL FATIGUE ALARM SYSTEM , 2011 .

[7]  Sebastian Möller,et al.  Using electroencephalography and subjective self-assessment to measure the influence of quality variations in cloud gaming , 2015, 2015 Seventh International Workshop on Quality of Multimedia Experience (QoMEX).

[8]  Marcus A. Magnor,et al.  Single-trial EEG classification of artifacts in videos , 2012, TAP.

[9]  Marcus A. Magnor,et al.  EEG analysis of implicit human visual perception , 2012, CHI.

[10]  John J. B. Allen,et al.  Frontal EEG asymmetry as a moderator and mediator of emotion , 2004, Biological Psychology.

[11]  Markus Fiedler,et al.  Quality of Experience: From Assessment to Application (Dagstuhl Seminar 15022) , 2015, Dagstuhl Reports.

[12]  Sebastian Möller,et al.  Perception of low-quality videos analyzed by means of electroencephalography , 2012, 2012 Fourth International Workshop on Quality of Multimedia Experience.

[13]  D. Pizzagalli.  Electroencephalography and High-Density Electrophysiological Source Localization , 2007 .

[14]  Marcus A. Magnor,et al.  Assessing the quality of compressed images using EEG , 2011, 2011 18th IEEE International Conference on Image Processing.

[15]  Sebastian Möller,et al.  Changes of vigilance caused by varying bit rate conditions , 2013, 2013 Fifth International Workshop on Quality of Multimedia Experience (QoMEX).

[16]  William D. Voiers,et al.  Modulated noise reference unit (MNRU) tests using DRT, DAM, and spelling alphabet test materials , 1990 .

[17]  H. Berger,et al.  Über das Elektrenkephalogramm des Menschen , 1937, Archiv für Psychiatrie und Nervenkrankheiten.

[18]  Jan-Niklas Antons.  Neural Correlates of Quality Perception for Complex Speech Signals , 2015, T-Labs Series in Telecommunication Services.

[19]  Julien Perez,et al.  On the measurement of image quality perception using frontal EEG analysis , 2013, 2013 International Conference on Smart Communications in Network Technologies (SaCoNeT).

[20]  M. Coles,et al.  Event-related brain potentials: An introduction. , 1995 .

[21]  Gabriel Curio,et al.  Subjective Listening Tests and Neural Correlates of Speech Degradation in Case of Signal-Correlated Noise , 2010 .

[22]  C. C. Duncan,et al.  Event-related potentials in clinical research: Guidelines for eliciting, recording, and quantifying mismatch negativity, P300, and N400 , 2009, Clinical Neurophysiology.

[23]  Sebastian Möller,et al.  Is low quality media affecting the level of fatigue? , 2014, 2014 Sixth International Workshop on Quality of Multimedia Experience (QoMEX).

[24]  Cristina Hava Muntean,et al.  User-centered EEG-based multimedia quality assessment , 2013, 2013 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[25]  Martin A. Lindquist,et al.  Handbook of Psychophysiology: Elements of Functional Neuroimaging , 2007 .

[26]  Peter Schelkens,et al.  Qualinet White Paper on Definitions of Quality of Experience , 2013 .

[27]  ITU-T Rec. P.910 (04/2008) Subjective video quality assessment methods for multimedia applications , 2009 .

[28]  Stefan Haufe,et al.  Single-trial analysis and classification of ERP components — A tutorial , 2011, NeuroImage.

[29]  Robert Schleicher,et al.  Does Low Quality Audiovisual Content Increase Fatigue of Viewers? , 2017 .

[30]  Sebastian Möller,et al.  A Physiological Approach to Determine Video Quality , 2011, 2011 IEEE International Symposium on Multimedia.

[31]  Sebastian Bosse,et al.  Toward a Direct Measure of Video Quality Perception Using EEG , 2012, IEEE Transactions on Image Processing.

[32]  Seong-Eun Moon,et al.  Perceptual Experience Analysis for Tone-mapped HDR Videos Based on EEG and Peripheral Physiological Signals , 2015, IEEE Transactions on Autonomous Mental Development.

[33]  Sebastian Möller,et al.  Too tired for calling? A physiological measure of fatigue caused by bandwidth limitations , 2012, 2012 Fourth International Workshop on Quality of Multimedia Experience.

[34]  P. Alku,et al.  Sensitivity of the human auditory cortex to acoustic degradation of speech and non-speech sounds , 2010, BMC Neuroscience.

[35]  A. Craig,et al.  Reproducibility of the spectral components of the electroencephalogram during driver fatigue. , 2005, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[36]  Sebastian Möller,et al.  Analyzing Speech Quality Perception Using Electroencephalography , 2012, IEEE Journal of Selected Topics in Signal Processing.

[37]  Sebastian Möller,et al.  Using Electroencephalography to Measure Perceived Video Quality , 2014, IEEE Journal of Selected Topics in Signal Processing.

[38]  Marcus A. Magnor,et al.  Evaluation of video artifact perception using event-related potentials , 2011, APGV '11.

[39]  Guideline 5: Guidelines for Standard Electrode Position Nomenclature , 2006, American journal of electroneurodiagnostic technology.

[40]  C. Herrmann.  Human EEG responses to 1–100 Hz flicker: resonance phenomena in visual cortex and their potential correlation to cognitive phenomena , 2001, Experimental Brain Research.