User Evaluation of Websites: From First Impression to Recommendation

Content, usability, and aesthetics are core constructs in users’ perception and evaluation of websites, but little is known about their interplay in different use phases. In a first study web users (N=330) stated content as most relevant, followed by usability and aesthetics. In study 2 tests with four websites were performed (N=300), resulting data were modeled in path analyses. In this model aesthetics had the largest influence on first impressions, while all three constructs had an impact on first and overall impressions. However, only content contributed significantly to the intention to revisit or recommend a website. Using data from a third study (N=512, 42 websites), we were able to replicate this model. As before, perceived usability affected first and overall impressions, while content perception was important for all analyzed website use phases. In addition, aesthetics also had a small but significant impact on the participants’ intentions to revisit or recommend.

[1]  Steve Muylle,et al.  The role of pleasure in web site success , 2006, Inf. Manag..

[2]  Phillip W. Braddy,et al.  Internet Recruiting: Effects of Website Content Features on Viewers' Perceptions of Organizational Culture , 2009 .

[3]  John D'Ambra,et al.  Emerging factors in user evaluation of the World Wide Web , 2001, Inf. Manag..

[4]  Christian Köhler,et al.  How do consumers search for and appraise health information on the world wide web? Qualitative study using focus groups, usability tests, and in-depth interviews , 2002, BMJ : British Medical Journal.

[5]  Jonathan W. Palmer,et al.  Web Site Usability, Design, and Performance Metrics , 2002, Inf. Syst. Res..

[6]  Milena M. Head,et al.  Exploring human images in website design: a multi-method approach , 2009 .

[7]  Naveen Donthu,et al.  Developing a Scale to Measure the Perceived Quality of An Internet Shopping Site ( SITEQUAL ) , 2005 .

[8]  Morten Moshagen,et al.  Facets of visual aesthetics , 2010, Int. J. Hum. Comput. Stud..

[9]  Marc Hassenzahl,et al.  The Inference of Perceived Usability From Beauty , 2010, Hum. Comput. Interact..

[10]  Prashant C. Palvia,et al.  Developing and validating an instrument for measuring user-perceived web quality , 2002, Inf. Manag..

[11]  Naveen Donthu,et al.  Developing a Scale to Measure the Perceived Quality of an Internet Shopping Site (PQISS) , 2015 .

[12]  Tim Berners-Lee,et al.  Publishing on the semantic web , 2001, Nature.

[13]  Kasper Hornbæk,et al.  Current practice in measuring usability: Challenges to usability studies and research , 2006, Int. J. Hum. Comput. Stud..

[14]  Gerrit Hirschfeld,et al.  Spatial frequencies in aesthetic website evaluations – explaining how ultra-rapid evaluations are formed , 2012, Ergonomics.

[15]  H. Leder,et al.  A model of aesthetic appreciation and aesthetic judgments. , 2004, British journal of psychology.

[16]  Noam Tractinsky,et al.  Evaluating the consistency of immediate aesthetic perceptions of web pages , 2006, Int. J. Hum. Comput. Stud..

[17]  Morten Moshagen,et al.  A short version of the visual aesthetics of websites inventory , 2013 .

[18]  Noam Tractinsky,et al.  Assessing dimensions of perceived visual aesthetics of web sites , 2004 .

[19]  Amanda Spink,et al.  How are we searching the World Wide Web? A comparison of nine search engine transaction logs , 2006, Inf. Process. Manag..

[20]  James A. Hendler,et al.  Web science: an interdisciplinary approach to understanding the web , 2008, CACM.

[21]  Choon-Ling Sia,et al.  Consumer trust and distrust: An issue of website design , 2010, Int. J. Hum. Comput. Stud..

[22]  Young Jun Lim,et al.  Consumers' Perceived Importance of and Satisfaction with Internet Shopping , 2001, Electron. Mark..

[23]  R. Gurrea,et al.  The role played by perceived usability, satisfaction and consumer trust on website loyalty , 2006, Inf. Manag..

[24]  Masaaki Kurosu,et al.  Apparent usability vs. inherent usability: experimental analysis on the determinants of the apparent usability , 1995, CHI 95 Conference Companion.

[25]  M. Anne Britt,et al.  The seduction of easiness: How science depictions influence laypeople’s reliance on their own evaluation of scientific information , 2012 .

[26]  Stephen H. Wagner,et al.  Recruiting on Corporate Web Sites: Perceptions of Fit and Attraction , 2010 .

[27]  Gerrit Hirschfeld,et al.  High and low spatial frequencies in website evaluations , 2010, Ergonomics.

[28]  E. W. Gould,et al.  Crosscurrents: cultural dimensions and global Web user-interface design , 2000, INTR.

[29]  David Robins,et al.  Aesthetics and credibility in web site design , 2008, Inf. Process. Manag..

[30]  Martin Schrepp,et al.  Cognitive Processes Causing the Relationship between Aesthetics and Usability , 2008, USAB.

[31]  C. Ranganathan,et al.  Key dimensions of business-to-consumer web sites , 2002, Inf. Manag..

[32]  Miriam J. Metzger Making sense of credibility on the Web: Models for evaluating online information and recommendations for future research , 2007, J. Assoc. Inf. Sci. Technol..

[33]  Steven John Simon,et al.  The impact of culture and gender on web sites: an empirical study , 2000, DATB.

[34]  Ida Engholm,et al.  Digital style history: the development of graphic design on the Internet , 2002, Digit. Creativity.

[35]  Fariza Fauzi,et al.  A user study to investigate semantically relevant contextual information of WWW images , 2010, Int. J. Hum. Comput. Stud..

[36]  Chang Liu,et al.  Exploring the factors associated with Web site success in the context of electronic commerce , 2000, Inf. Manag..

[37]  Marshall Scott Poole,et al.  Affect in Web Interfaces: A Study of the Impacts of Web Page Visual Complexity and Order , 2010, MIS Q..

[38]  Peter R. Harris,et al.  How do patients evaluate and make use of online health information? , 2007, Social science & medicine.

[39]  Antonella De Angeli,et al.  Towards a theory of user judgment of aesthetics and user interface quality , 2008, TCHI.

[40]  Andreas Sonderegger,et al.  The influence of product aesthetics and usability over the course of time: a longitudinal field experiment , 2012, Ergonomics.

[41]  John T. Cacioppo,et al.  The Elaboration Likelihood Model of Persuasion , 1986, Advances in Experimental Social Psychology.

[42]  Robert F. Otondo,et al.  Web-based recruitment: effects of information, organizational brand, and attitudes toward a Web site on applicant attraction. , 2007, The Journal of applied psychology.

[43]  Lisa A Sutherland,et al.  Unraveling the web: an evaluation of the content quality, usability, and readability of nutrition web sites. , 2005, Journal of nutrition education and behavior.

[44]  Scott B. MacKenzie,et al.  Common method biases in behavioral research: a critical review of the literature and recommended remedies. , 2003, The Journal of applied psychology.

[45]  Eelko K. R. E. Huizingh,et al.  The content and design of web sites: an empirical study , 2000, Inf. Manag..

[46]  Gitte Lindgaard,et al.  Attention web designers: You have 50 milliseconds to make a good first impression! , 2006, Behav. Inf. Technol..

[47]  Huatong Sun,et al.  Building a culturally-competent corporate web site: an exploratory study of cultural markers in multilingual web design , 2001, SIGDOC '01.

[48]  Liu Fang,et al.  Cultural Dimensions of Website Design and Content , 2003 .

[49]  Jacob Cohen Statistical Power Analysis , 1992 .

[50]  Gavriel Salvendy,et al.  The contribution of apparent and inherent usability to a user's satisfaction in a searching and browsing task on the Web , 2002, Ergonomics.

[51]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[52]  Kasper Hornbæk,et al.  Old wine in new bottles or novel challenges: a critical analysis of empirical studies of user experience , 2011, CHI.

[53]  Yong Jin Kim,et al.  Do visitors' interest level and perceived quantity of web page content matter in shaping the attitude toward a web site? , 2006, Decis. Support Syst..

[54]  S. Clark,et al.  Your patient information website: how good is it? , 2012, Colorectal disease : the official journal of the Association of Coloproctology of Great Britain and Ireland.

[55]  Sangwon Lee,et al.  Users' perceptions of usability and aesthetics as criteria of pre- and post-use preferences , 2012 .

[56]  P. Levy,et al.  Organizational Web Sites: Web Site Content and Style as Determinants of Organizational Attraction , 2003 .

[57]  Noam Tractinsky,et al.  Aesthetics and apparent usability: empirically assessing cultural and methodological issues , 1997, CHI.

[58]  Mohan J. Dutta-Bergman The Impact of Completeness and Web Use Motivation on the Credibility of e‐Health Information , 2004 .

[59]  Melody Y. Ivory,et al.  Evolution of web site design patterns , 2005, TOIS.

[60]  Marc Hassenzahl,et al.  User experience - a research agenda , 2006, Behav. Inf. Technol..

[61]  R. Watson,et al.  The Influence of Home Page Complexity on Consumer Attention, Attitudes, and Purchase Intent , 2006 .

[62]  Sascha Mahlke,et al.  Factors influencing the experience of website usage , 2002, CHI Extended Abstracts.

[63]  Stephen A. Rains,et al.  Health information-seeking and perceptions of website credibility: Examining Web-use orientation, message characteristics, and structural features of websites , 2009, Comput. Hum. Behav..

[64]  Bo N. Schenkman,et al.  Aesthetics and preferences of web pages , 2000, Behav. Inf. Technol..

[65]  James Hendler,et al.  Science and the Semantic Web , 2003, Science.

[66]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[67]  Antonis C. Stylianou,et al.  Global corporate web sites: an empirical investigation of content and design , 2003, Inf. Manag..

[68]  Noam Tractinsky,et al.  Toward the Study of Aesthetics in Information Technology , 2004, ICIS.

[69]  M. Thüring,et al.  Usability, aesthetics and emotions in human–technology interaction , 2007 .

[70]  Viswanath Venkatesh,et al.  Assessing a Firm's Web Presence: A Heuristic Evaluation Procedure for the Measurement of Usability , 2002, Inf. Syst. Res..

[71]  Sangwon Lee,et al.  Understanding user preferences based on usability and aesthetics before and after actual use , 2010, Interact. Comput..

[72]  Gitte Lindgaard,et al.  An exploration of relations between visual appeal, trustworthiness and perceived usability of homepages , 2011, TCHI.

[73]  Polona Vilar,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction (5th edition) , 2010, J. Assoc. Inf. Sci. Technol..

[74]  Dianne Cyr,et al.  Colour appeal in website design within and across cultures: A multi-method evaluation , 2010, Int. J. Hum. Comput. Stud..

[75]  Takayuki Watanabe Experimental evaluation of usability and accessibility of heading elements , 2007, W4A '07.

[76]  Sucheta Nadkarni,et al.  A Task-Based Model of Perceived Website Complexity , 2007, MIS Q..

[77]  Alexandre N. Tuch,et al.  The role of visual complexity and prototypicality regarding first impression of websites: Working towards understanding aesthetic judgments , 2012, Int. J. Hum. Comput. Stud..

[78]  Alexandre N. Tuch,et al.  Visual complexity of websites: Effects on users' experience, physiology, performance, and memory , 2009, Int. J. Hum. Comput. Stud..

[79]  Hans van der Heijden,et al.  Factors influencing the usage of websites: the case of a generic portal in The Netherlands , 2003, Inf. Manag..

[80]  Morten Moshagen,et al.  A blessing, not a curse: Experimental evidence for beneficial effects of visual aesthetics on performance , 2009, Ergonomics.

[81]  Takayuki Watanabe Experimental evaluation of usability and accessibility of heading elements , 2009, Disability and rehabilitation. Assistive technology.

[82]  Paul van Schaik,et al.  The role of context in perceptions of the aesthetics of web pages over time , 2009, Int. J. Hum. Comput. Stud..