Investigations on the role of expectations and individual decisions in quality perception

In the scientific field of Quality of Experience (QoE) the impact of technical influencing factors — often referred as Quality of Service (Qos) — and additional context factors like applications, usage scenarios, emotional state, etc. on the subjective quality assessment is examined. Nevertheless, two relevant aspects have been neglected so far in QoE related research: user expectations and user decisions. Hence, a literature study is presented which explains how expectations are addressed in related research fields and how individual expectations can be quantified. Based on that, four empirical user studies are discussed which show how to trigger quality-related expectations in a laboratory setup and which methodological aspects need to be considered. Based on the concept of desired and adequate expectations [11], questionnaires have been used to measure individual expectations in the context of video on demand and telecommunication providers. This information is furthermore used to enhance the prediction accuracy of quantitative QoE models up to 12%. A failure to fulfill quality-related user expectations may entail certain user decisions, e.g., the technical video quality of a streamed video is increased, which also includes higher fees. For this reason, three user studies are discussed which have examined the impact of economic user decisions on QoE. In these studies the test participants were able to spend real money for enhanced video quality. According to the discussed findings, the individual decision regarding quality and price has a positive impact on subjective quality assessment. Moreover, recommendations are presented which can be used for further QoE experiments including economic decisions. The impact of non-economic decisions on QoE assessment is investigated by three user studies, which focused on the impact of individual decisions regarding quality impairment, end device and content. So far, the ambiguous results of these three user studies make it impossible to draw final conclusions regarding the impact of non-economic user decisions on quality assessment. Finally, both user-related QoE-aspects — user expectations and user decisions — are presented in the framework of the quality formation process [12] which describes the interaction between expectations, decisions and subjective quality assessment.

[1]  Patrick Le Callet,et al.  From SD to HD Television: Effects of H.264 Distortions Versus Display Size on Quality of Experience , 2006, 2006 International Conference on Image Processing.

[2]  Julie Barnett,et al.  The value of choice: development of a new measurement tool. , 2008, The British journal of general practice : the journal of the Royal College of General Practitioners.

[3]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[4]  Soe-Tsyr Yuan,et al.  A quantitative approach to measure customer expectation for service innovation within service experience delivery , 2009, ICEC.

[5]  Eckehard G. Steinbach,et al.  Towards the design of an intuitive multi-view video navigation interface based on spatial information , 2013, MobileHCI '13.

[6]  Fang Yu,et al.  Lay Rationalism and Inconsistency between Predicted Experience and Decision , 2003 .

[7]  Francis Rumsey,et al.  On Some Biases Encountered in Modern Audio Quality Listening Tests-A Review , 2008 .

[8]  James J. Kellaris,et al.  An Exploratory Study of Price/Perceived-Quality Relationships Among Consumer Services , 1988 .

[9]  Alexander Raake,et al.  Parametric model for audiovisual quality assessment in IPTV: ITU-T Rec. P.1201.2 , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[10]  Khalid Al-Begain,et al.  User Centric Quality of Experience Testing for Video on Demand over IMS , 2009, 2009 First International Conference on Computational Intelligence, Communication Systems and Networks.

[11]  Judee K. Burgoon,et al.  The role of expectations in human-computer interaction , 1999, GROUP.

[12]  Claudio Cicconetti,et al.  User-level performance evaluation of VoIP using ns-2 , 2007, Valuetools 2007.

[13]  Yoram Wind,et al.  Preference of Relevant Others and Individual Choice Models , 1976 .

[14]  Darrel D. Muehling,et al.  Defining, Operationalizing, and Using Involvement in Advertising Research: A Review , 1993 .

[15]  Alexander Raake,et al.  Speech Quality of VoIP - Assessment and Prediction , 2006 .

[16]  Dawn Iacobucci,et al.  The Role of Post-Experience Comparison Standards in the Evaluation of Unfamiliar Services , 1992 .

[17]  Amit Mukhopadhyay,et al.  Delivering quality of experience in multimedia networks , 2010 .

[18]  E. Deci,et al.  Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions. , 2000, Contemporary educational psychology.

[19]  Marília Curado,et al.  Quality Level Control for Multi-User Sessions in Future Generation Networks , 2008, IEEE GLOBECOM 2008 - 2008 IEEE Global Telecommunications Conference.

[20]  Burkhard Stiller,et al.  Telecommunication Economics , 2012, Lecture Notes in Computer Science.

[21]  Maarten Wijnants,et al.  Investigating the relationship between QoS and QoE in a mixed desktop/handheld gaming setting , 2009, Co-Next Student Workshop '09.

[22]  Raimund Schatz,et al.  Got what you want? Modeling expectations to enhance web QoE prediction , 2014, 2014 Sixth International Workshop on Quality of Multimedia Experience (QoMEX).

[23]  James J. Kellaris,et al.  The Role of Selective Information Processing in Price-Quality Inference , 2004 .

[24]  Sebastian Möller,et al.  Speech Quality Estimation: Models and Trends , 2011, IEEE Signal Processing Magazine.

[25]  Ya-Qin Zhang,et al.  Transporting real-time video over the Internet: challenges and approaches , 2000, Proceedings of the IEEE.

[26]  Peter Reichl,et al.  The QoE alchemy: Turning quality into money. Experiences with a refined methodology for the evaluation of willingness-to-pay for service quality , 2012, 2012 Fourth International Workshop on Quality of Multimedia Experience.

[27]  Takumi Miyoshi,et al.  QoE-driven bandwidth allocation method based on user characteristics , 2014, The 16th Asia-Pacific Network Operations and Management Symposium.

[28]  J. Brehm Postdecision changes in the desirability of alternatives. , 1956, Journal of abnormal psychology.

[29]  R. B. Woodruff,et al.  Expectations and norms in models of consumer satisfaction. , 1987 .

[30]  Thomas T. Nagle,et al.  The Strategy and Tactics of Pricing: A Guide to Growing More Profitably , 2005 .

[31]  Peter Schelkens,et al.  Qualinet White Paper on Definitions of Quality of Experience , 2013 .

[32]  Ute Jekosch,et al.  Voice and Speech Quality Perception: Assessment and Evaluation , 2005 .

[33]  Peer Soelberg,et al.  Unprogrammed Decision Making , 2015 .

[34]  R. Oliver Measurement and evaluation of satisfaction processes in retail settings. , 1981 .

[35]  V. Zeithaml,et al.  A Dynamic Process Model of Service Quality: From Expectations to Behavioral Intentions , 1993 .

[36]  Peter Reichl,et al.  The trouble with choice: An empirical study to investigate the influence of charging strategies and content selection on QoE , 2013, Proceedings of the 9th International Conference on Network and Service Management (CNSM 2013).

[37]  Richard T. Watson,et al.  Measuring Information Systems Service Quality: Lessons From Two Longitudinal Case Studies , 1998, MIS Q..

[38]  Peter Reichl,et al.  The role of cognitive dissonance for QoE evaluation of multimedia services , 2012, 2012 IEEE Globecom Workshops.

[39]  Raimund Schatz,et al.  Evaluating the influence of expectations, price and content selection on video quality perception , 2014, 2014 Sixth International Workshop on Quality of Multimedia Experience (QoMEX).

[40]  Sebastian Möller,et al.  Assessment and Prediction of Speech Quality in Telecommunications , 2000 .

[41]  A. Parasuraman,et al.  The nature and determinants of customer expectations of service , 1993 .

[42]  Jillian C. Sweeney,et al.  Are There Cognitive Dissonance Segments? , 2003 .

[43]  Raimund Schatz,et al.  The influence of user decisions on subjective quality assessment ratings , 2015, 2015 IEEE International Conference on Communication Workshop (ICCW).

[44]  Michael S. Borella,et al.  Internet packet loss: measurement and implications for end-to-end QoS , 1998, Proceedings of the 1998 ICPP Workshop on Architectural and OS Support for Multimedia Applications Flexible Communication Systems. Wireless Networks and Mobile Computing (Cat. No.98EX206).

[45]  Aaron C. Kay,et al.  Sour Grapes, Sweet Lemons, and the Anticipatory Rationalization of the Status Quo , 2002 .

[46]  Dominik Strohmeier,et al.  Open Profiling of Quality: A Mixed Method Approach to Understanding Multimodal Quality Perception , 2010, Adv. Multim..

[47]  Wenan Zhou,et al.  Research on the User Behavior-Based QoE Evaluation Method for HTTP Mobile Streaming , 2014, 2014 Ninth International Conference on Broadband and Wireless Computing, Communication and Applications.

[48]  Jeffrey K. MacKie-Mason,et al.  Pricing Congestible Network Resources (Invited Paper) , 1995, IEEE J. Sel. Areas Commun..

[49]  Afb,et al.  CONSUMER BEHAVIOUR I , 2013 .

[50]  Anja Feldmann,et al.  A QoE Perspective on Sizing Network Buffers , 2014, Internet Measurement Conference.

[51]  M. Rokeach The Nature Of Human Values , 1974 .

[52]  H. Raghav Rao,et al.  A study of the effect of consumer trust on consumer expectations and satisfaction: the Korean experience , 2003, ICEC '03.

[53]  Peter Reichl,et al.  “Time is bandwidth”? Narrowing the gap between subjective time perception and Quality of Experience , 2012, 2012 IEEE International Conference on Communications (ICC).

[54]  M. Rupp,et al.  On the Willingness to Pay in Relation to Delivered Quality of Mobile Video Streaming , 2008, 2008 Digest of Technical Papers - International Conference on Consumer Electronics.

[55]  Vyas Sekar,et al.  Understanding the impact of video quality on user engagement , 2011, SIGCOMM.

[56]  Timo Ojala,et al.  Case Study in Assessing Subjective QoS of a Mobile Multimedia Web Service in a Real Multi-access Network , 2005, IWQoS.

[57]  S. Möller,et al.  All Users Are (Not) Equal - The Influence of User Characteristics on Perceived Quality, Modality Choice and Performance , 2011, IWSDS.

[58]  Markku Turunen,et al.  Subjective evaluation of spoken dialogue systems using SER VQUAL method , 2004, INTERSPEECH.

[59]  L. Festinger,et al.  A Theory of Cognitive Dissonance , 2017 .

[60]  S. McIntyre,et al.  Developing Practical Procedures for the Measurement of Personal Values in Cross-Cultural Marketing , 1979 .

[61]  Raimund Schatz,et al.  Wireless vs. wireline shootout: Howuser expectations influence quality of experience , 2012, 2012 Fourth International Workshop on Quality of Multimedia Experience.

[62]  Romano Fantacci,et al.  Handset and network quality performance benchmarking for QoE improvement , 2013, 2013 IEEE Globecom Workshops (GC Wkshps).

[63]  Jillian C. Sweeney,et al.  Cognitive Dissonance after Purchase: A Multidimensional Scale. , 2000 .

[64]  Martin O'Neill,et al.  An exploratory study of the effects of experience on consumer perceptions of the service quality construct , 2003 .

[65]  P. Reichl Charging for Quality-of-Experience : A New Paradigm for Pricing IP-based Service , 2006 .

[66]  R. Shepard,et al.  Multidimensional Scaling: Theory and Applications in the Behavioral Sciences, Volume 1. , 1973 .

[67]  A. Parasuraman,et al.  Delivering quality service : balancing customer perceptions and expectations , 1990 .

[68]  Tobias Hoßfeld,et al.  An Evaluation of QoE in Cloud Gaming Based on Subjective Tests , 2011, 2011 Fifth International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing.

[69]  E. Bretagne Multi-Bid Auctions for Bandwidth Allocation in Communication Networks , 2005 .

[70]  J. Dietz Satisfaction: A Behavioral Perspective on the Consumer , 1997 .

[71]  Markus Rupp,et al.  A QoE Evaluation Methodology for HD Video Streaming Using Social Networking , 2011, 2011 IEEE International Symposium on Multimedia.

[72]  Peter Fröhlich,et al.  QoE in 10 seconds: Are short video clip lengths sufficient for Quality of Experience assessment? , 2012, 2012 Fourth International Workshop on Quality of Multimedia Experience.

[73]  A. Parasuraman,et al.  SERVQUAL: A multiple-item scale for measuring consumer perceptions of service quality. , 1988 .

[74]  Vlado Menkovski,et al.  Online QoE prediction , 2010, 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX).

[75]  Piet Demeester,et al.  Lessons learned during real-life QoE assessment , 2012, euroITV 2012.

[76]  Alan Lewis,et al.  The Cambridge handbook of psychology and economic behaviour, second edition , 2018 .

[77]  R. Cialdini,et al.  Preference for Consistency: The Development of a Valid Measure and the Discovery of Surprising Behavioral Implications , 1995 .

[78]  Helmut Hlavacs,et al.  A comprehensive view on user studies: survey and open issues for mobile TV , 2009, EuroITV '09.

[79]  J. Zaichkowsky Measuring the Involvement Construct , 1985 .

[80]  Christopher K. Hsee Less is Better: When Low-Value Options are Valued More Highly than High-Value Options , 1998 .

[81]  Eduardo Cerqueira,et al.  Video quality estimator for wireless mesh networks , 2012, 2012 IEEE 20th International Workshop on Quality of Service.

[82]  F. Buttle SERVQUAL: review, critique, research agenda , 1996 .

[83]  R. BFTTMAN Information Processing Models of Consumer Behavior , 2007 .

[84]  Robert A. Peterson,et al.  The Price-Perceived Quality Relationship: Experimental Evidence , 1970 .

[85]  M. Lepper,et al.  The Construction of Preference: When Choice Is Demotivating: Can One Desire Too Much of a Good Thing? , 2006 .

[86]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[87]  J. D. Mcconnell The Price-Quality Relationship in an Experimental Setting , 1968 .

[88]  Deborah Estrin,et al.  Pricing in computer networks: motivation, formulation, and example , 1993, TNET.

[89]  D. Kahneman Maps of Bounded Rationality: Psychology for Behavioral Economics , 2003 .

[90]  H. Martens,et al.  Multivariate analysis of quality , 2000 .

[91]  Raimund Schatz,et al.  Where's the music? comparing the QoE impact of temporal impairments between music and video streaming , 2013, 2013 Fifth International Workshop on Quality of Multimedia Experience (QoMEX).

[92]  Christoph Breidert,et al.  Estimation of willingness-to-pay. Theory, measurement, and application. , 2005 .

[93]  M. Polonsky,et al.  Measuring expectations: forecast vs. ideal expectations. Does it really matter? , 2005 .

[94]  Zhang Xingming,et al.  Design of a QoS Control Scheme for Real-Time Mobile Video Based on H.264 , 2012, 2012 International Conference on Computer Science and Service System.

[95]  Gerard Briscoe,et al.  Digital Ecosystems: Evolving Service-Orientated Architectures , 2006, 2006 1st Bio-Inspired Models of Network, Information and Computing Systems.

[96]  Tobias Hoßfeld,et al.  From Packets to People: Quality of Experience as a New Measurement Challenge , 2013, Data Traffic Monitoring and Analysis.

[97]  Jorge Gonçalves,et al.  Mobile cloud storage: a contextual experience , 2014, MobileHCI '14.

[98]  Christoph Piesbergen,et al.  Erfassung von kognitiver Dissonanz nach Kaufentscheidungen , 2011 .

[99]  G. Urban,et al.  Pre-Test-Market Evaluation of New Packaged Goods: A Model and Measurement Methodology , 1978 .

[100]  Raimund Schatz,et al.  Evaluating the impact of expectations on end-user quality perception , 2017 .

[101]  Sebastian Möller,et al.  Quality Dimensions of Narrowband and Wideband Speech Transmission , 2010 .

[102]  E. Deci,et al.  On the Importance of Self-Determination for Intrinsically-Motivated Behavior , 1978 .

[103]  Phuoc Tran-Gia,et al.  Anatomy of a Crowdsourcing Platform - Using the Example of Microworkers.com , 2011, 2011 Fifth International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing.

[104]  Peter Reichl,et al.  From Quality of Experience to Willingness to Pay for Interconnection Service Quality , 2012, Networking Workshops.

[105]  Klaus Peter Kaas Empirische Preisabsatzfunktionen bei Konsumgütern , 1977 .

[106]  Vicki G. Morwitz,et al.  Do Intentions Really Predict Behavior? Self-Generated Validity Effects in Survey Research , 2005 .

[107]  Richard W. Scamell,et al.  The Effects of Information System User Expectations on Their Performance and Perceptions , 1993, MIS Q..

[108]  Peter Reichl,et al.  QoE Alchemy 2.0: An improved test setup for the pecuniary bias of QoE , 2013, 2013 Fifth International Workshop on Quality of Multimedia Experience (QoMEX).

[109]  Arkady B. Zaslavsky,et al.  A probabilistic context-aware approach for quality of experience measurement in pervasive systems , 2011, SAC.

[110]  Peter Lambert,et al.  Assessing Quality of Experience of IPTV and Video on Demand Services in Real-Life Environments , 2010, IEEE Transactions on Broadcasting.

[111]  Robert J. Meyer,et al.  Learning and the Cognitive Algebra of Price Expectations , 1997 .

[112]  S. Hormuth The sampling of experiences in situ , 1986 .

[113]  Stefan Winkler,et al.  Digital Video Quality: Vision Models and Metrics , 2005 .

[114]  Mohammad S. Obaidat,et al.  QoS-Guaranteed Bandwidth Shifting and Redistribution in Mobile Cloud Environment , 2014, IEEE Transactions on Cloud Computing.

[115]  Sebastian Möller,et al.  T-V-model: Parameter-based prediction of IPTV quality , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[116]  N. Bown,et al.  The lure of choice , 2003 .

[117]  Michael Hahsler,et al.  A REVIEW OF METHODS FOR MEASURING WILLINGNESS-TO-PAY , 2017 .

[118]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[119]  M. Rokeach,et al.  Beliefs, Attitudes and Values. A Theory of Organization and Change , 1968 .

[120]  C. Whan Park,et al.  Joint decisions in home purchasing : A muddling-through process , 1982 .

[121]  Carol Reeves,et al.  DEFINING QUALITY: ALTERNATIVES AND IMPLICATIONS , 1994 .

[122]  Kai Kristensen,et al.  Measuring the impact of buying behaviour on customer satisfaction , 1999 .

[123]  Jukka Ojasalo,et al.  Managing customer expectations in professional services , 2001 .

[124]  Peter Reichl,et al.  Logarithmic laws in service quality perception: where microeconomics meets psychophysics and quality of experience , 2013, Telecommun. Syst..

[125]  S. Iyengar,et al.  Born to choose: the origins and value of the need for control , 2010, Trends in Cognitive Sciences.

[126]  Mario Kind,et al.  Economical analysis of experience-optimized service delivery , 2010, 2010 9th Conference of Telecommunication, Media and Internet.

[127]  Antonio Liotta,et al.  Predicting quality of experience in multimedia streaming , 2009, MoMM.

[128]  Peter Reichl,et al.  Market entrance, user interaction and willingness-to-pay: Exploring fundamentals of QoE-based charging for VoD services , 2013, 2013 IEEE Global Communications Conference (GLOBECOM).

[129]  J. Neter,et al.  Applied Linear Statistical Models (3rd ed.). , 1992 .

[130]  Alexander Raake,et al.  Quality of Experience: Advanced Concepts, Applications and Methods , 2014 .

[131]  J. D. Mcconnell,et al.  Effect of pricing on perception of product quality. , 1968, The Journal of applied psychology.

[132]  Andy P. Field,et al.  Discovering Statistics Using SPSS , 2000 .