Using electroencephalography to analyze sleepiness due to low-quality audiovisual stimuli

Standardized methods to assess the quality of experience (QoE) of multimedia focus typically on short sequences of approximately 10s and a subjective judgment of the test participant. Two main problems occur when using this methodology: On the one hand these short sequences do not represent the typical media usage, and on the other hand it is still not completely understood how these subjective ratings are formed within the test participant. To overcome the second issue and to gain insight into the internal processing, electroencephalography (EEG) has been introduced successfully to the domain of QoE. As it is possible to use EEG to assess the quality perception continuously, we present two studies using standard documentary audiovisual clips with a length of 40min and 60min as stimuli. During the presentation of these quality-wise manipulated test sequences, we record an electroencephalogram and other physiological measures. We show that features of the EEG recordings indicate a change in the cognitive state of the test participant during the exposure to low-quality compared to high-quality sequences. HighlightsUsing physiological measures to obtain features to relate to audiovisual quality perception.In two studies we could confirm previous research results.Commercially available documentaries were used for the studies.We extracted frequency band powers from two sub-bands,Could show significant differences for low-quality sequences compared to high-quality sequences.Increased level of fatigue physiologically measured.

[1]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[2]  Sebastian Möller,et al.  Analyzing Speech Quality Perception Using Electroencephalography , 2012, IEEE Journal of Selected Topics in Signal Processing.

[3]  W. Klimesch EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis , 1999, Brain Research Reviews.

[4]  Marina Schmid,et al.  An Introduction To The Event Related Potential Technique , 2016 .

[5]  Marcus A. Magnor,et al.  Assessing the quality of compressed images using EEG , 2011, 2011 18th IEEE International Conference on Image Processing.

[6]  Sebastian Möller,et al.  Changes of vigilance caused by varying bit rate conditions , 2013, 2013 Fifth International Workshop on Quality of Multimedia Experience (QoMEX).

[7]  R. Schleicher,et al.  Blinks and saccades as indicators of fatigue in sleepiness warners: looking tired? , 2022 .

[8]  J. Stern,et al.  Eye movements and blinks: their relationship to higher cognitive processes. , 1989, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[9]  W. Klimesch,et al.  Induced alpha band power changes in the human EEG and attention , 1998, Neuroscience Letters.

[10]  G. Zajicek,et al.  The Wisdom of the Body , 1934, Nature.

[11]  A.B. Dumont,et al.  Quality in Engineering , 1950, Proceedings of the IRE.

[12]  F. Bartlett Ferrier Lecture - Fatigue following highly skilled work , 1943, Proceedings of the Royal Society of London. Series B - Biological Sciences.

[13]  T. Åkerstedt,et al.  Subjective and objective sleepiness in the active individual. , 1990, The International journal of neuroscience.

[14]  Ulrich Reiter,et al.  Audio Quality Requirements and Comparison of Multimodal vs. Unimodal Perception of Impairments for Long Duration Content , 2014, J. Signal Process. Syst..

[15]  H. Jasper,et al.  The ten-twenty electrode system of the International Federation. The International Federation of Clinical Neurophysiology. , 1999, Electroencephalography and clinical neurophysiology. Supplement.

[16]  D. Purves Principles of Cognitive Neuroscience , 2007 .

[17]  Antitza Dantcheva,et al.  TEST EQUIPMENT OF TIME-VARIANT SUBJECTIVE PERCEPTUAL VIDEO QUALITY IN MOBILE TERMINALS , 2005 .

[18]  Sebastian Möller,et al.  Using Electroencephalography to Measure Perceived Video Quality , 2014, IEEE Journal of Selected Topics in Signal Processing.

[19]  Maarten A. S. Boksem,et al.  Effects of mental fatigue on attention: an ERP study. , 2005, Brain research. Cognitive brain research.

[20]  A. Craig,et al.  Regional brain wave activity changes associated with fatigue. , 2012, Psychophysiology.

[21]  Yodchanan Wongsawat,et al.  WEIGHTED-FREQUENCY INDEX FOR EEG-BASED MENTAL FATIGUE ALARM SYSTEM , 2011 .

[23]  M. J. Blake,et al.  Time of day effects on performance in a range of tasks , 1967 .

[24]  Sebastian Möller,et al.  Too tired for calling? A physiological measure of fatigue caused by bandwidth limitations , 2012, 2012 Fourth International Workshop on Quality of Multimedia Experience.

[25]  A. J. Fridlund,et al.  The Skeletomotor System , 1990 .

[26]  Kenneth Holmqvist,et al.  Eye tracking: a comprehensive guide to methods and measures , 2011 .

[27]  J. Cacioppo,et al.  The skeletomotor system: Surface electromyography. , 2007 .

[28]  A. Boxtel,et al.  Optimal signal bandwidth for the recording of surface EMG activity of facial, jaw, oral, and neck muscles. , 2001 .

[29]  Simone Benedetto,et al.  Driver workload and eye blink duration , 2011 .

[30]  W. Boucsein Electrodermal activity, 2nd ed. , 2012 .

[31]  Lætitia Gros,et al.  Combination of physiological and subjective measures to assess quality of experience for audiovisual technologies , 2011, 2011 Third International Workshop on Quality of Multimedia Experience.

[32]  A. Craig,et al.  A critical review of the psychophysiology of driver fatigue , 2001, Biological Psychology.

[33]  C. Shapiro,et al.  Distinguishing sleepiness and fatigue: focus on definition and measurement. , 2006, Sleep medicine reviews.

[34]  G. Berntson,et al.  Handbook of Psychophysiology: Cardiovascular Psychophysiology , 2007 .

[35]  Sebastian Möller,et al.  Is low quality media affecting the level of fatigue? , 2014, 2014 Sixth International Workshop on Quality of Multimedia Experience (QoMEX).

[36]  Helmut Hlavacs,et al.  Slider or glove? Proposing an alternative quality rating methodology , 2010 .

[37]  M. Angela Sasse,et al.  Do Users Always Know What's Good For Them? Utilising Physiological Responses to Assess Media Quality , 2000, BCS HCI.

[38]  M. A. Recarte,et al.  Mental Workload and Visual Impairment: Differences between Pupil, Blink, and Subjective Rating , 2008, The Spanish Journal of Psychology.

[39]  B. Oken Electrophysiology of Mind: Event-Related Brain Potentials and Cognition , 1996 .

[40]  A. Craig,et al.  Driver fatigue: electroencephalography and psychological assessment. , 2002, Psychophysiology.

[41]  E. D. de Geus,et al.  Effects of work stress on ambulatory blood pressure, heart rate, and heart rate variability. , 2000, Hypertension.