QoE in the Web: A dance of design and performance

Web services and applications are an increasingly pervasive fixture of modern life and business. This paper reports on a Web-based crowdsourced subjective assessment campaign in which we studied the effects of network performance and design aspects of manipulated Web sites on the perceived performance, perceived ease-of-use, visual appeal, as well as on the overall Quality of Experience of users browsing a given Web site. We consider the simultaneous impact of multiple factors on different dimensions of QoE, as well as their interplay, with a focus on the interactions between page/element loading times and Web site visual appeal and ease-of-use. Key results have shown the following: page loading times and visual appeal have a significant effect on overall user QoE; both higher perceived aesthetics and higher perceived ease-of-use result in an increased user tolerance to delay; and overall QoE is strongly correlated with perceived aesthetics, perceived ease-of-use, and perceived network performance.

[1]  Alexandre N. Tuch,et al.  Is beautiful really usable? Toward understanding the relation between usability, aesthetics, and affect in HCI , 2012, Comput. Hum. Behav..

[2]  Lea Skorin-Kapov,et al.  Towards an understanding of visual appeal in website design , 2013, 2013 Fifth International Workshop on Quality of Multimedia Experience (QoMEX).

[3]  Jusak Jusak,et al.  Analysis of networking and Application Layer derived metrics for web Quality of Experience , 2012, 2012 IEEE Consumer Communications and Networking Conference (CCNC).

[4]  Kasper Hornbæk,et al.  Current practice in measuring usability: Challenges to usability studies and research , 2006, Int. J. Hum. Comput. Stud..

[5]  Paul van Schaik,et al.  Modelling user experience with web sites: Usability, hedonic value, beauty and goodness , 2008, Interact. Comput..

[6]  Joachim Meyer,et al.  Economic and subjective measures of the perceived value of aesthetics and usability , 2006, TCHI.

[7]  Yunjie Calvin Xu,et al.  The effects of web site aesthetics and shopping task on consumer online purchasing behavior , 2008, CHI Extended Abstracts.

[8]  Noam Tractinsky,et al.  Assessing dimensions of perceived visual aesthetics of web sites , 2004 .

[9]  Peter Reichl,et al.  The Logarithmic Nature of QoE and the Role of the Weber-Fechner Law in QoE Assessment , 2010, 2010 IEEE International Conference on Communications.

[10]  Rafael Jaron,et al.  User Evaluation of Websites: From First Impression to Recommendation , 2014, Interact. Comput..

[11]  Phuoc Tran-Gia,et al.  Best Practices for QoE Crowdtesting: QoE Assessment With Crowdsourcing , 2014, IEEE Transactions on Multimedia.

[12]  Dianne Cyr,et al.  Colour appeal in website design within and across cultures: A multi-method evaluation , 2010, Int. J. Hum. Comput. Stud..

[13]  Morten Moshagen,et al.  A blessing, not a curse: Experimental evidence for beneficial effects of visual aesthetics on performance , 2009, Ergonomics.

[14]  Paul van Schaik,et al.  The role of context in perceptions of the aesthetics of web pages over time , 2009, Int. J. Hum. Comput. Stud..

[15]  Hans van der Heijden,et al.  Factors influencing the usage of websites: the case of a generic portal in The Netherlands , 2003, Inf. Manag..

[16]  James R. Lewis,et al.  Psychometric Evaluation of the PSSUQ Using Data from Five Years of Usability Studies , 2002, Int. J. Hum. Comput. Interact..

[17]  Jun Kong,et al.  A comparative study of three social networking websites , 2013, World Wide Web.

[18]  Sangwon Lee,et al.  Understanding user preferences based on usability and aesthetics before and after actual use , 2010, Interact. Comput..

[19]  Marc Hassenzahl,et al.  The Interplay of Beauty, Goodness, and Usability in Interactive Products , 2004, Hum. Comput. Interact..

[20]  Sarah Diefenbach,et al.  The "Beauty Dilemma": beauty is valued but discounted in product choice , 2009, The Study of Visual Aesthetics in Human-Computer Interaction.

[21]  Tele Tan,et al.  Design of a Web-Based LBS Framework Addressing Usability, Cost, and Implementation Constraints , 2010, World Wide Web.

[22]  Markus Fiedler,et al.  The memory effect and its implications on Web QoE modeling , 2011, 2011 23rd International Teletraffic Congress (ITC).

[23]  Markus Fiedler,et al.  Waiting times in quality of experience for web based services , 2012, 2012 Fourth International Workshop on Quality of Multimedia Experience.

[24]  Sangwon Lee,et al.  Users' perceptions of usability and aesthetics as criteria of pre- and post-use preferences , 2012 .

[25]  Amitava Chattopadhyay,et al.  Waiting for the Web: How Screen Color Affects Time Perception , 2004 .

[26]  Bo N. Schenkman,et al.  Aesthetics and preferences of web pages , 2000, Behav. Inf. Technol..

[27]  Antonella De Angeli,et al.  Towards a theory of user judgment of aesthetics and user interface quality , 2008, TCHI.