Toward task-dependent evaluation of web-QoE: Free exploration vs. “Who Ate What?”

Quality of experience of web services is negatively influenced by system delays. To quantify delay and resulting user satisfaction quality evaluation experiments are used, but they typically disregards users' tasks and content of the website as a part of the assessment procedure. The goal of this study is to explore impact of a user's task, information presentation such as per-element load durations and page load strategies on Quality of Experience. We conducted an experimental study with 25 participants. The results underline the importance of designing task-aware and content-aware solutions for improving Quality of Experience for delay sensitive web services.

[1]  Ernst Heinrich Weber,et al.  De pulsu, resorptione, auditu et tactu. Annotationes anatomicae et physiologicae , 1834 .

[2]  Patrick Le Callet,et al.  Considering Temporal Variations of Spatial Visual Distortions in Video Quality Assessment , 2009, IEEE Journal of Selected Topics in Signal Processing.

[3]  Peter Reichl,et al.  The Logarithmic Nature of QoE and the Role of the Weber-Fechner Law in QoE Assessment , 2010, 2010 IEEE International Conference on Communications.

[4]  Markus Fiedler,et al.  The memory effect and its implications on Web QoE modeling , 2011, 2011 23rd International Teletraffic Congress (ITC).

[5]  Kasper Hornbæk,et al.  Meta-analysis of correlations among usability measures , 2007, CHI.

[6]  ITU-T Rec. P.910 (04/2008) Subjective video quality assessment methods for multimedia applications , 2009 .

[7]  Ergonomic requirements for office work with visual display terminals ( VDTs ) — Part 11 : Guidance on usability , 1998 .

[8]  Multimedia Quality of Service and performance – Generic and user-related aspects Estimating end-to-end performance in IP networks for data applications , 2014 .

[9]  C. McGarty,et al.  Research Methods and Statistics in Psychology , 2003 .

[10]  Raimund Schatz,et al.  Vienna surfing: assessing mobile broadband quality in the field , 2011, W-MUST '11.

[11]  Peter Reichl,et al.  “Time is bandwidth”? Narrowing the gap between subjective time perception and Quality of Experience , 2012, 2012 IEEE International Conference on Communications (ICC).

[12]  Raimund Schatz,et al.  Poor, Good Enough or Even Better? Bridging the Gap between Acceptability and QoE of Mobile Broadband Data Services , 2011, 2011 IEEE International Conference on Communications (ICC).

[13]  Bruce J Tromberg,et al.  The need for speed , 2012, Smart Structures.

[14]  Allan Kuchinsky,et al.  Integrating user-perceived quality into Web server design , 2000, Comput. Networks.

[15]  Dennis F. Galletta,et al.  When the Wait Isn't So Bad: The Interacting Effects of Website Delay, Familiarity, and Breadth , 2006, Inf. Syst. Res..

[16]  Peter Schelkens,et al.  Qualinet White Paper on Definitions of Quality of Experience , 2013 .