Using electroencephalography and subjective self-assessment to measure the influence of quality variations in cloud gaming

Subjective self-assessment is a frequently used method when it comes to Quality of Experience assessment in general. If correctly used a variety of scales can be applied to assess the quality of cloud gaming for different constructs such as experienced quality or flow. Besides self-assessment, physiological correlates are a promising method to measure the influence of cloud gaming quality on the player without the interruption introduced by the rating task. We present subjective and physiological results and lessons learned from a laboratory study in which 32 participants played a first person shooter game in a cloud gaming setup with varying levels of video quality caused by different video compression bitrates. We found that the video quality influenced the perceived quality, player experience, the valence rating, and the alpha frequency band power. It is shown that 1) subjective methods assess the quality variation and 2) physiological measures capture the influence on the player in terms of a reduced cognitive state. Taken together, test set-ups will benefit from a mixed methods approach in cloud gaming QoE testing.

[1]  Martina Zitterbart,et al.  Subjective quality assessment for multiplayer real-time games , 2002, NetGames '02.

[2]  Yutaka Ishibashi,et al.  QoE assessment of interactivity and fairness in First Person Shooting with group synchronization control , 2010, 2010 9th Annual Workshop on Network and Systems Support for Games.

[3]  C. C. Duncan,et al.  Event-related potentials in clinical research: Guidelines for eliciting, recording, and quantifying mismatch negativity, P300, and N400 , 2009, Clinical Neurophysiology.

[4]  Mark Claypool,et al.  The effects of loss and latency on user performance in unreal tournament 2003® , 2004, NetGames '04.

[5]  H. Berger,et al.  Über das Elektrenkephalogramm des Menschen , 1937, Archiv für Psychiatrie und Nervenkrankheiten.

[6]  Michael Bredel,et al.  A measurement study regarding quality of service and its impact on multiplayer online games , 2010, 2010 9th Annual Workshop on Network and Systems Support for Games.

[7]  Sebastian Möller,et al.  Assessing the Impact of Game Type, Display Size and Network Delay on Mobile Gaming QoE , 2014, Prax. Inf.verarb. Kommun..

[8]  Kuan-Ta Chen,et al.  Effect of Network Quality on Player Departure Behavior in Online Games , 2009, IEEE Transactions on Parallel and Distributed Systems.

[9]  T. Åkerstedt,et al.  Subjective and objective sleepiness in the active individual. , 1990, The International journal of neuroscience.

[10]  METHODS FOR SUBJECTIVE DETERMINATION OF TRANSMISSION QUALITY Summary , 2022 .

[11]  Cheng-Hsin Hsu,et al.  GamingAnywhere: an open cloud gaming system , 2013, MMSys.

[12]  Lennart E. Nacke,et al.  More than a feeling: Measurement of sonic user experience and psychophysiology in a first-person shooter game , 2010, Interact. Comput..

[13]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[14]  B. Oken Electrophysiology of Mind: Event-Related Brain Potentials and Cognition , 1996 .

[15]  K. Poels,et al.  "It is always a lot of fun!": exploring dimensions of digital game experience using focus group methodology , 2007, Future Play.

[16]  Sujit Dey,et al.  Cloud mobile gaming: modeling and measuring user experience in mobile wireless networks , 2012, MOCO.

[17]  H. Jasper,et al.  The ten-twenty electrode system of the International Federation. The International Federation of Clinical Neurophysiology. , 1999, Electroencephalography and clinical neurophysiology. Supplement.

[18]  Sebastian Möller,et al.  Using Electroencephalography to Measure Perceived Video Quality , 2014, IEEE Journal of Selected Topics in Signal Processing.

[19]  Jan-Niklas Antons Neural Correlates of Quality Perception for Complex Speech Signals , 2015, T-Labs Series in Telecommunication Services.

[20]  S. Zander,et al.  Empirically Measuring the QoS Sensitivity of Interactive Online Game Players , 2004 .