The Impact of Personality on the Subjective Assessment of Usability

ABSTRACT The system usability scale (SUS) has been widely employed in both the field and the laboratory as a valid and reliable measure of system usability. Although its psychometric properties are relatively well understood, the impact that differences in users’ personality traits have on their perceived usability of products, services, and systems has not been deeply explored—even though people’s scores on personality traits have been shown to be reliable and predict a staggering array of societally important outcomes in work, school, and life domains. In this study, 268 users assessed the usability of 20 different products retrospectively with the SUS. Five broad personality traits were then measured using the Mini-IPIP scale. Results indicated that measured personality traits do correlate with the rated usability of products, where measures of Openness to Experience and Agreeableness have the strongest positive correlations with subjective usability assessment. Implications for practitioners, designers, and researchers are discussed.

[1]  Robert F. Easley,et al.  Research Note - How Does Personality Matter? Relating the Five-Factor Model to Technology Acceptance and Use , 2008, Inf. Syst. Res..

[2]  P. Costa,et al.  Conceptions and correlates of openness to experience. , 1997 .

[3]  Richard E. Lucas,et al.  Personality development across the life span: longitudinal analyses with a national sample from Germany. , 2011, Journal of personality and social psychology.

[4]  Stefano Federici,et al.  Assessing User Satisfaction in the Era of User Experience: Comparison of the SUS, UMUX, and UMUX-LITE as a Function of Product Experience , 2015, Int. J. Hum. Comput. Interact..

[5]  Murray R. Barrick,et al.  THE BIG FIVE PERSONALITY DIMENSIONS AND JOB PERFORMANCE: A META-ANALYSIS , 1991 .

[6]  David C. Funder,et al.  Lay Conceptions of the Five-Factor Model and its Indicators , 1998 .

[7]  Giorgio Maria Di Nunzio,et al.  Web log analysis: a review of a decade of studies about information acquisition, inspection and interpretation of user interaction , 2011, Data Mining and Knowledge Discovery.

[8]  M. Ashton,et al.  The HEXACO Honesty-Humility, Agreeableness, and Emotionality Factors , 2014, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[9]  G.E. Burnett,et al.  Personality as A-Criterion for Selecting Usability Testing Participants , 2006, 2006 ITI 4th International Conference on Information & Communications Technology.

[10]  Nuria Oliver,et al.  Influence of personality on satisfaction with mobile phone services , 2013, TCHI.

[11]  James R. Lewis,et al.  IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use , 1995, Int. J. Hum. Comput. Interact..

[12]  Ergonomic requirements for office work with visual display terminals ( VDTs ) — Part 11 : Guidance on usability , 1998 .

[13]  Jeff Sauro,et al.  When designing usability questionnaires, does it hurt to be positive? , 2011, CHI.

[14]  J. Hogan,et al.  Conscientiousness and integrity at work , 1997 .

[15]  Li-fang Zhang,et al.  DOES THE BIG FIVE PREDICT LEARNING APPROACHES , 2003 .

[16]  Manoochehr Azkhosh,et al.  Five Factor Model in Iranian Culture: A Psychometrics Analysis of NEO-Five Factor Inventory (NEO-FFI) , 2014 .

[17]  R. McCrae,et al.  An introduction to the five-factor model and its applications. , 1992, Journal of personality.

[18]  Aaron Marcus,et al.  User Interface Design's Return on Investment: Examples and Statistics , 2005 .

[19]  Kibeom Lee,et al.  Fluid Intelligence, Crystallized Intelligence, and the Openness/Intellect Factor , 2000 .

[20]  Kraig Finstad.  The system usability scale and non-native English speakers , 2006 .

[21]  P. Costa,et al.  Adding Liebe und Arbeit: The Full Five-Factor Model and Well-Being , 1991 .

[22]  M. Voracek,et al.  Why can't a man be more like a woman? Sex differences in Big Five personality traits across 55 cultures. , 2008, Journal of personality and social psychology.

[23]  James T. Miller,et al.  An Empirical Evaluation of the System Usability Scale , 2008, Int. J. Hum. Comput. Interact..

[24]  Megan Johnson,et al.  The Relationship Between Levels of User Experience with a Product and Perceived System Usability , 2013 .

[25]  Katherine M. White,et al.  Personality and Self-Esteem as Predictors of Young People's Technology Use , 2008, Cyberpsychology Behav. Soc. Netw..

[26]  Michael D. Byrne,et al.  The Importance of Psychological Science in a Voter’s Ability to Cast a Vote , 2016 .

[27]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[28]  Mark Batey,et al.  Individual Differences in Ideational Behavior: Can the Big Five and Psychometric Intelligence Predict Creativity Scores? , 2010 .

[29]  S. Gosling,et al.  A very brief measure of the Big-Five personality domains , 2003 .

[30]  Richard E. Lucas,et al.  The mini-IPIP scales: tiny-yet-effective measures of the Big Five factors of personality. , 2006, Psychological assessment.

[31]  A. Tellegen,et al.  PERSONALITY PROCESSES AND INDIVIDUAL DIFFERENCES An Alternative "Description of Personality": The Big-Five Factor Structure , 2022 .

[32]  F. Reichheld.  The one number you need to grow. , 2003, Harvard business review.

[33]  A. Furnham,et al.  Can personality factors predict intelligence , 2005 .

[34]  Antonio Terracciano,et al.  Personality Plasticity After Age 30 , 2006, Personality & social psychology bulletin.

[35]  Anne Marsden,et al.  International Organization for Standardization , 2014 .

[36]  Samuel D Gosling,et al.  Age differences in personality traits from 10 to 65: Big Five domains and facets in a large cross-sectional sample. , 2011, Journal of personality and social psychology.

[37]  James R. Lewis,et al.  Psychometric evaluation of an after-scenario questionnaire for computer usability studies: the ASQ , 1991, SGCH.

[38]  A. Caspi,et al.  The Power of Personality: The Comparative Validity of Personality Traits, Socioeconomic Status, and Cognitive Ability for Predicting Important Life Outcomes , 2007, Perspectives on psychological science : a journal of the Association for Psychological Science.

[39]  Jordan B Peterson,et al.  Between facets and domains: 10 aspects of the Big Five. , 2007, Journal of personality and social psychology.

[40]  Christoph Kemper,et al.  Short Scales – Five Misunderstandings and Ways to Overcome Them , 2014 .

[41]  Andrew Dillon,et al.  User analysis in HCI - the historical lessons from individual differences research , 1996, Int. J. Hum. Comput. Stud..

[42]  Peter Harms,et al.  An evaluation of the consequences of using short measures of the Big Five personality traits. , 2012, Journal of personality and social psychology.

[43]  Joar Vittersø,et al.  Personality and technology acceptance: the influence of personality factors on the core constructs of the Technology Acceptance Model , 2013, Behav. Inf. Technol..

[44]  T. Judge,et al.  Five-factor model of personality and transformational leadership. , 2000, The Journal of applied psychology.

[45]  Gregory M. Hurtz,et al.  Personality and job performance: the Big Five revisited. , 2000, The Journal of applied psychology.

[46]  Sherry H. Stewart,et al.  Big-Five personality domains predict drinking motives , 2004 .

[47]  R. McCrae,et al.  Openness to Experience , 2014, Encyclopedia of Evolutionary Psychological Science.

[48]  Philip Kortum,et al.  Evaluation of Home Health Care Devices: Remote Usability Assessment , 2015, JMIR human factors.

[49]  James R. Lewis,et al.  How Expertise Affects a Digital-Rights-Management-Sharing Application's Usability , 2016, IEEE Software.

[50]  Volkan Özbek,et al.  The Impact of Personality on Technology Acceptance: A Study on Smart Phone Users , 2014 .

[51]  Wolmet Barendregt,et al.  Predicting effectiveness of children participants in user testing based on personality characteristics , 2007, Behav. Inf. Technol..

[52]  André Vandierendonck,et al.  Some effects of menu characteristics and user personality on performance with menu-driven interfaces , 1990 .

[53]  J. Harris,et al.  Measured intelligence, achievement, openness to experience, and creativity , 2004 .

[54]  Philip T. Kortum,et al.  Measuring the Usability of Mobile Applications for Phones and Tablets , 2015, Int. J. Hum. Comput. Interact..

[55]  Russell J. Branaghan.  Book Review: Usability Assessment: How to Measure the Usability of Products, Services, and Systems , 2017 .

[56]  Philip T. Kortum,et al.  Usability Ratings for Everyday Products Measured With the System Usability Scale , 2013, Int. J. Hum. Comput. Interact..

[57]  Andrew Muddimer,et al.  The effect of experience on system usability scale ratings , 2012 .

[58]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[59]  Antti Oulasvirta,et al.  Too good to be bad: Favorable product expectations boost subjective usability ratings , 2011, Interact. Comput..

[60]  S. Joseph,et al.  Big 5 correlates of three measures of subjective well-being , 2003 .

[61]  Markus Bühner,et al.  Predicting academic success with the Big 5 rated from different points of view: Self‐rated, other rated and faked , 2010 .

[62]  L. Cronbach.  Response Sets and Test Validity , 1946 .

[63]  S. Srivastava,et al.  The Big Five Trait taxonomy: History, measurement, and theoretical perspectives. , 1999 .

[64]  Gregory A. Huber,et al.  The Big Five Personality Traits in the Political Arena , 2011 .

[65]  Thomas K. Landauer,et al.  Trouble with Computers: Usefulness, Usability, and Productivity , 1996 .