More than I ever wanted or just good enough? User expectations and subjective quality perception in the context of networked multimedia services

AbstractThis article addresses the overall relevance and the influence of user expectations in the context of perceptual quality evaluation of technical systems, and how information about individual expectations can be integrated into research on Quality of Experience (QoE). Based on a literature survey on expectations in the fields of psychology, service quality and consumer satisfaction theory, an existing conceptual QoE perception model is extended by explicitly including desired and adequate expectations in the quality perception process. A direct expectation assessment paradigm is proposed that uses dedicated questionnaires. Further, it is shown how expectation-related knowledge can be used to increase the accuracy of quality prediction models. In addition, experimental setups are presented that enable controlled triggering of expectations in user studies. It is discussed how the role of expectations for QoE can be investigated in future research as well as how to further validate the proposed methods.

[1]  Dominik Strohmeier,et al.  Open Profiling of Quality: A Mixed Method Approach to Understanding Multimodal Quality Perception , 2010, Adv. Multim..

[2]  Carol Reeves,et al.  DEFINING QUALITY: ALTERNATIVES AND IMPLICATIONS , 1994 .

[3]  A. Parasuraman,et al.  SERVQUAL: A multiple-item scale for measuring consumer perceptions of service quality. , 1988 .

[4]  F. L. Ruch,et al.  Psychology and Life , 2001 .

[5]  Manuela Pereira,et al.  Factors Influencing Quality of Experience , 2014, Quality of Experience.

[6]  R. Oliver.  Satisfaction: A Behavioral Perspective On The Consumer , 1996 .

[7]  Francis Rumsey,et al.  On Some Biases Encountered in Modern Audio Quality Listening Tests-A Review , 2008 .

[8]  Mario Kind,et al.  Economical analysis of experience-optimized service delivery , 2010, 2010 9th Conference of Telecommunication, Media and Internet.

[9]  Alexander Raake,et al.  Quality and Quality of Experience , 2014, Quality of Experience.

[10]  Antonio Liotta,et al.  Predicting quality of experience in multimedia streaming , 2009, MoMM.

[11]  Soe-Tsyr Yuan,et al.  A quantitative approach to measure customer expectation for service innovation within service experience delivery , 2009, ICEC.

[12]  Phuoc Tran-Gia,et al.  Anatomy of a Crowdsourcing Platform - Using the Example of Microworkers.com , 2011, 2011 Fifth International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing.

[13]  Richard W. Scamell,et al.  The Effects of Information System User Expectations on Their Performance and Perceptions , 1993, MIS Q..

[14]  Kai Kristensen,et al.  Measuring the impact of buying behaviour on customer satisfaction , 1999 .

[15]  Jukka Ojasalo,et al.  Managing customer expectations in professional services , 2001 .

[16]  Dawn Iacobucci,et al.  The Role of Post-Experience Comparison Standards in the Evaluation of Unfamiliar Services , 1992 .

[17]  C. Osgood,et al.  The Measurement of Meaning , 1958 .

[18]  Piet Demeester,et al.  Lessons learned during real-life QoE assessment , 2012, euroITV 2012.

[19]  R. B. Woodruff,et al.  Expectations and norms in models of consumer satisfaction. , 1987 .

[20]  Tobias Hoßfeld,et al.  From Packets to People: Quality of Experience as a New Measurement Challenge , 2013, Data Traffic Monitoring and Analysis.

[21]  M. Rokeach,et al.  Beliefs, Attitudes and Values. A Theory of Organization and Change , 1968 .

[22]  Sebastian Möller,et al.  Quality Dimensions of Narrowband and Wideband Speech Transmission , 2010 .

[23]  Alexander Raake,et al.  Toward task-dependent evaluation of web-QoE: Free exploration vs. “Who Ate What?” , 2012, 2012 IEEE Globecom Workshops.

[24]  Sebastian Möller,et al.  Assessment and Prediction of Speech Quality in Telecommunications , 2000 .

[25]  Marília Curado,et al.  Quality Level Control for Multi-User Sessions in Future Generation Networks , 2008, IEEE GLOBECOM 2008 - 2008 IEEE Global Telecommunications Conference.

[26]  Anja Feldmann,et al.  A QoE Perspective on Sizing Network Buffers , 2014, Internet Measurement Conference.

[27]  Takumi Miyoshi,et al.  QoE-driven bandwidth allocation method based on user characteristics , 2014, The 16th Asia-Pacific Network Operations and Management Symposium.

[28]  Vlado Menkovski,et al.  Online QoE prediction , 2010, 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX).

[29]  Eduardo Cerqueira,et al.  Video quality estimator for wireless mesh networks , 2012, 2012 IEEE 20th International Workshop on Quality of Service.

[30]  F. Buttle.  SERVQUAL: review, critique, research agenda , 1996 .

[31]  Raimund Schatz,et al.  Where's the music? comparing the QoE impact of temporal impairments between music and video streaming , 2013, 2013 Fifth International Workshop on Quality of Multimedia Experience (QoMEX).

[32]  M. Polonsky,et al.  Measuring expectations: forecast vs. ideal expectations. Does it really matter? , 2005 .

[33]  Alexander Raake,et al.  Quality of Experience: Advanced Concepts, Applications and Methods , 2014 .

[34]  Jorge Gonçalves,et al.  Mobile cloud storage: a contextual experience , 2014, MobileHCI '14.

[35]  Judee K. Burgoon,et al.  The role of expectations in human-computer interaction , 1999, GROUP.

[36]  R. Rust,et al.  Service Quality: Insights and Managerial Implications from the Frontier , 1994 .

[37]  Alexander Raake,et al.  Speech Quality of VoIP - Assessment and Prediction , 2006 .

[38]  S. McIntyre,et al.  Developing Practical Procedures for the Measurement of Personal Values in Cross-Cultural Marketing , 1979 .

[39]  Romano Fantacci,et al.  Handset and network quality performance benchmarking for QoE improvement , 2013, 2013 IEEE Globecom Workshops (GC Wkshps).

[40]  Martin O'Neill,et al.  An exploratory study of the effects of experience on consumer perceptions of the service quality construct , 2003 .

[41]  H. Raghav Rao,et al.  A study of the effect of consumer trust on consumer expectations and satisfaction: the Korean experience , 2003, ICEC '03.

[42]  Christian Keimel,et al.  Crowdsourcing in QoE Evaluation , 2014, Quality of Experience.

[43]  Wenan Zhou,et al.  Research on the User Behavior-Based QoE Evaluation Method for HTTP Mobile Streaming , 2014, 2014 Ninth International Conference on Broadband and Wireless Computing, Communication and Applications.

[44]  Arkady B. Zaslavsky,et al.  A probabilistic context-aware approach for quality of experience measurement in pervasive systems , 2011, SAC.

[45]  Maarten Wijnants,et al.  Investigating the relationship between QoS and QoE in a mixed desktop/handheld gaming setting , 2009, Co-Next Student Workshop '09.

[46]  A. Parasuraman,et al.  The nature and determinants of customer expectations of service , 1993 .

[47]  Patrick Le Callet,et al.  From SD to HD Television: Effects of H.264 Distortions Versus Display Size on Quality of Experience , 2006, 2006 International Conference on Image Processing.

[48]  Claudio Cicconetti,et al.  User-level performance evaluation of VoIP using ns-2 , 2007, Valuetools 2007.

[49]  Peter Schelkens,et al.  Qualinet White Paper on Definitions of Quality of Experience , 2013 .

[50]  Ute Jekosch,et al.  Voice and Speech Quality Perception: Assessment and Evaluation , 2005 .

[51]  Alexander Raake,et al.  Quality of Experience , 2014, T-Labs Series in Telecommunication Services.

[52]  V. Zeithaml,et al.  A Dynamic Process Model of Service Quality: From Expectations to Behavioral Intentions , 1993 .

[53]  Peter Reichl,et al.  “Time is bandwidth”? Narrowing the gap between subjective time perception and Quality of Experience , 2012, 2012 IEEE International Conference on Communications (ICC).

[54]  Richard T. Watson,et al.  Measuring Information Systems Service Quality: Lessons From Two Longitudinal Case Studies , 1998, MIS Q..

[55]  Robert J. Meyer,et al.  Learning and the Cognitive Algebra of Price Expectations , 1997 .