Towards a theory of user judgment of aesthetics and user interface quality

The article introduces a framework for users' design quality judgments based on Adaptive Decision Making theory. The framework describes judgment on quality attributes (usability, content/functionality, aesthetics, customisation and engagement) with dependencies on decision making arising from the user's background, task and context. The framework is tested and refined by three experimental studies. The first two assessed judgment of quality attributes of websites with similar content but radically different designs for aesthetics and engagement. Halo effects were demonstrated whereby attribution of good quality on one attribute positively influenced judgment on another, even in the face of objective evidence to the contrary (e.g., usability errors). Users' judgment was also shown to be susceptible to framing effects of the task and their background. These appear to change the importance order of the quality attributes; hence, quality assessment of a design appears to be very context dependent. The third study assessed the influence of customisation by experiments on mobile services applications, and demonstrated that evaluation of customisation depends on the users' needs and motivation. The results are discussed in the context of the literature on aesthetic judgment, user experience and trade-offs between usability and hedonic/ludic design qualities.

[1]  Antonella De Angeli,et al.  Investigating attractiveness in web user interfaces , 2007, CHI.

[2]  Jinwoo Kim,et al.  Critical factors for the aesthetic fidelity of web pages: empirical studies with professional web designers and users , 2004, Interact. Comput..

[3]  Antonella De Angeli,et al.  Pleasure versus efficiency in user interfaces: towards an involvement framework , 2002 .

[4]  Xiaoming Wang,et al.  Chapter 7 , 2003, School Health Policy & Practice.

[5]  Jakob Nielsen,et al.  Heuristic evaluation of user interfaces , 1990, CHI '90.

[6]  Eric J. Johnson,et al.  The adaptive decision maker , 1993 .

[7]  Gary Perlman,et al.  Practical usability evaluation , 1994, CHI Extended Abstracts.

[8]  Kevin Mullet,et al.  Designing Visual Interfaces: Communication Oriented Techniques , 1994 .

[9]  P. Fishwick Exploring Attributes of Skins as Potential Antecedents of Emotion in Hci , 2006 .

[10]  Marc Hassenzahl,et al.  The Effect of Perceived Hedonic Quality on Product Appealingness , 2001, Int. J. Hum. Comput. Interact..

[11]  D. Norman Emotional design : why we love (or hate) everyday things , 2004 .

[12]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[13]  Noam Tractinsky,et al.  Aesthetics and apparent usability: empirically assessing cultural and methodological issues , 1997, CHI.

[14]  M. Csíkszentmihályi Flow: The Classic Work on How to Achieve Happiness , 2002 .

[15]  E. Berscheid,et al.  What is beautiful is good. , 1972, Journal of personality and social psychology.

[16]  Stephan Wensveen,et al.  Augmenting fun and beauty: a pamphlet , 2000, DARE '00.

[17]  John C. McCarthy,et al.  Technology as experience , 2004, INTR.

[18]  Michael Burmester,et al.  Hedonic and ergonomic quality aspects determine a software's appeal , 2000, CHI.

[19]  Noam Tractinsky,et al.  Assessing dimensions of perceived visual aesthetics of web sites , 2004 .

[20]  Marc Hassenzahl,et al.  MARC HASSENZAHL CHAPTER 3 The Thing and I: Understanding the Relationship Between User and Product , 2003 .

[21]  Jakob Nielsen,et al.  Designing Web Usability: The Practice of Simplicity , 1999 .

[22]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[23]  Peter H. Bloch Seeking the Ideal Form: Product Design and Consumer Response , 1995 .

[24]  N. Tractinsky,et al.  What is beautiful is usable , 2000, Interact. Comput..

[25]  Martin Ludvigsen,et al.  Aesthetic interaction: a pragmatist's aesthetics of interactive systems , 2004, DIS '04.

[26]  M J Bernier,et al.  Establishing the psychometric properties of a scale for evaluating quality in printed education materials. , 1996, Patient education and counseling.

[27]  Antonella De Angeli,et al.  Customer experience requirements for e-commerce websites , 2007, Int. J. Web Eng. Technol..

[28]  Jinwoo Kim,et al.  Designing emotionally evocative homepages: an empirical study of the quantitative relations between design factors and emotional dimensions , 2003, Int. J. Hum. Comput. Stud..

[29]  C.D. Martin,et al.  The Media Equation: How People Treat Computers, Television and New Media Like Real People and Places [Book Review] , 1997, IEEE Spectrum.

[30]  F. Reid Rediscovering the Social Group: A Self-Categorization Theory , 1987 .

[31]  Amy L. Parsons,et al.  Emotional Design: Why We Love (or Hate) Everyday Things , 2006 .

[32]  John W. Payne,et al.  The adaptive decision maker: Name index , 1993 .

[33]  Andrew F. Monk,et al.  Theory of Personalization of Appearance: Why Users Personalize Their PCs and Mobile Phones , 2003, Hum. Comput. Interact..

[34]  R. Shusterman Pragmatist Aesthetics: Living Beauty, Rethinking Art , 1992 .

[35]  Gitte Lindgaard,et al.  What is this evasive beast we call user satisfaction? , 2003, Interact. Comput..

[36]  Alistair G. Sutcliffe Heuristic Evaluation of Website Attractiveness and Usability , 2001, DSV-IS.

[37]  K. Gegenfurtner,et al.  Design Issues in Gaze Guidance Under review with ACM Transactions on Computer Human Interaction , 2009 .

[38]  Marti A. Hearst,et al.  The State of the Art in Automated Usability Evaluation of User , 2000 .

[39]  Alistair G. Sutcliffe,et al.  Assessing the reliability of heuristic evaluation for Web site attractiveness and usability , 2002, Proceedings of the 35th Annual Hawaii International Conference on System Sciences.

[40]  Jakob Nielsen,et al.  Chapter 4 – The Usability Engineering Lifecycle , 1993 .

[41]  John P. Sheposh,et al.  Beauty or Brains: Which Image for Your Mate? , 1977 .

[42]  Carolyn Snyder,et al.  Web Site Usability: A Designer's Guide , 1997 .

[43]  Marc Hassenzahl,et al.  The Interplay of Beauty, Goodness, and Usability in Interactive Products , 2004, Hum. Comput. Interact..

[44]  Peter H. Bloch Seeking the Ideal Form: Product Design and Consumer Response: , 1995 .

[45]  Anthony Shong-Yu Chow To Flash Or Not To Flash? Usability And User Engagement Of HTML Vs. Flash. , 2004 .

[46]  Antonella De Angeli,et al.  Assessing Interaction Styles in Web User Interfaces , 2005, INTERACT.

[47]  B. Merrilees,et al.  Corporate Branding: A Framework for E-retailers , 2002 .

[48]  Johan Redström,et al.  From use to presence: on the expressions and aesthetics of everyday computational things , 2002, TCHI.