Objective characterization of human behavioural characteristics for QoE assessment: A pilot study on the use of electroencephalography features

Quality of Experience (QoE) is a human-centric paradigm which produces the blue print of human behavioral states such as perception, emotion, cognition and expectation. Recent advances in neurophysiological monitoring tools have facilitated the study of frequency, time and location of neuronal activity to an unprecedented degree, as well as opened doors to a better understanding of human cognition, emotions and overall behavioral systems. These neurophysiological insights may provide more accurate and objective characterization of QoE metrics. This paper seeks to investigate neuronal activity generated by three different quality levels of a speech stimulus using electroencephalography (EEG). To this end, an electroencephalography (EEG) feature was computed based on the coupling between so-called delta and beta EEG frequency bands, which has previously been linked with negative behavioral characteristics (anxiety, frustration, dissatisfaction). The result indicates an increase in delta and beta coupling with a decrease in the speech quality levels. Additionally, neural correlates of a subjective affective scores (arousal and valence) were also computed and shown to be inversely proportional with EEG feature. These preliminary findings corroborate that emotions play a significant role in human quality and QoE perception.

[1]  Junqing Yu,et al.  An improved valence-arousal emotion space for video affective content representation and recognition , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[2]  Noël Crespi,et al.  QoE Aware Service Delivery in Distributed Environment , 2011, 2011 IEEE Workshops of International Conference on Advanced Information Networking and Applications.

[3]  Sebastian Möller,et al.  Neurophysiological experimental facility for Quality of Experience (QoE) assessment , 2013, 2013 IFIP/IEEE International Symposium on Integrated Network Management (IM 2013).

[4]  Sebastian Möller,et al.  Perception of low-quality videos analyzed by means of electroencephalography , 2012, 2012 Fourth International Workshop on Quality of Multimedia Experience.

[5]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[6]  D. O'Shaughnessy,et al.  Auditory BCIs for Visually Impaired Users : Should Developers Worry About the Quality of Text-to-Speech Readers ? , 2013 .

[7]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[8]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[9]  P. Lang The emotion probe. Studies of motivation and attention. , 1995, The American psychologist.

[10]  E. Naumann,et al.  EEG asymmetry, dispositional mood and personality , 1999 .

[11]  Kay Connelly,et al.  Toward total quality of experience: A QoE model in a communication ecosystem , 2012, IEEE Communications Magazine.

[12]  Elisabeth André,et al.  Emotion recognition based on physiological changes in music listening , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Marcus A. Magnor,et al.  Single-trial EEG classification of artifacts in videos , 2012, TAP.

[14]  Jon D. Morris Observations: SAM: The Self-Assessment Manikin An Efficient Cross-Cultural Measurement Of Emotional Response 1 , 1995 .

[15]  M. Ferrari,et al.  Principles, techniques, and limitations of near infrared spectroscopy. , 2004, Canadian journal of applied physiology = Revue canadienne de physiologie appliquee.

[16]  J. Gray,et al.  Précis of The neuropsychology of anxiety: An enquiry into the functions of the septo-hippocampal system , 1982, Behavioral and Brain Sciences.

[17]  Jack van Honk,et al.  Salivary cortisol levels and the coupling of midfrontal delta-beta oscillations. , 2005, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[18]  Jack van Honk,et al.  Anxious apprehension increases coupling of delta and beta oscillations. , 2006, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[19]  Thomas E. Nichols,et al.  Activation of the medial prefrontal cortex and extended amygdala by individual ratings of emotional arousal: a fMRI study , 2003, Biological Psychiatry.

[20]  K. Roelofs,et al.  Cortisol administration enhances the coupling of midfrontal delta and beta oscillations. , 2008, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[21]  Sebastian Bosse,et al.  Toward a Direct Measure of Video Quality Perception Using EEG , 2012, IEEE Transactions on Image Processing.

[22]  Luigi Landini,et al.  Advanced Image Processing in Magnetic Resonance Imaging , 2005 .