Developing and Validating the User Burden Scale: A Tool for Assessing User Burden in Computing Systems

Computing systems that place a high level of burden on their users can have a negative affect on initial adoption, retention, and overall user experience. Through an iterative process, we have developed a model for user burden that consists of six constructs: 1) difficulty of use, 2) physical, 3) time and social, 4) mental and emotional, 5) privacy, and 6) financial. If researchers and practitioners can have an understanding of the overall level of burden systems may be having on the user, they can have a better sense of whether and where to target future design efforts that can reduce those burdens. To help assist with understanding and measuring user burden, we have also developed and validated a measure of user burden in computing systems called the User Burden Scale (UBS), which is a 20-item scale with 6 individual sub-scales representing each construct. This paper presents the process we followed to develop and validate this scale for use in evaluating user burden in computing systems. Results indicate that the User Burden Scale has good overall inter-item reliability, convergent validity with similar scales, and concurrent validity when compared to systems abandoned vs. those still in use.

[1]  John L. Bennett,et al.  Visual display terminals: Usability issues and health concerns , 1984 .

[2]  Yang Wang,et al.  Multimodal behavior and interaction as indicators of cognitive load , 2012, TIIS.

[3]  Jonathan Klein,et al.  Frustrating the user on purpose: a step toward building an affective computer , 2002, Interact. Comput..

[4]  Beom Suk Jin,et al.  Usability risk level evaluation for physical user interface of mobile phone , 2010, Comput. Ind..

[5]  Rudy Den Buurman,et al.  User-centred design of smart products , 1997 .

[6]  Judith Donath.  How social media design shapes society , 2014, CHI Extended Abstracts.

[7]  R. Harmon,et al.  Incorporating price sensitivity measurement into the software engineering process , 2003, PICMET '03: Portland International Conference on Management of Engineering and Technology Technology Management for Reshaping the World, 2003..

[8]  B. Schneiderman,et al.  Designing the User Interface. Strategies for Effective Human-Computer Interaction , 1992 .

[9]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[10]  Mary Corbett,et al.  SUMI: the Software Usability Measurement Inventory , 1993, Br. J. Educ. Technol..

[11]  Kent L. Norman,et al.  Development of an instrument measuring user satisfaction of the human-computer interface , 1988, CHI '88.

[12]  Gregory D. Abowd,et al.  Towards a questionnaire for measuring affective benefits and costs of communication technologies , 2014, CSCW.

[13]  Clayton Lewis,et al.  Designing for usability—key principles and what designers think , 1983, CHI '83.

[14]  A M Wichansky,et al.  Usability testing in 2000 and beyond , 2000, Ergonomics.

[15]  David Kotz,et al.  Privacy in mobile technology for personal healthcare , 2012, CSUR.

[16]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[17]  Peter Kulchyski.  and , 2015 .

[18]  Deb Sledgianowski,et al.  Social Network Sites: Antecedents of User Adoption and Usage , 2008, AMCIS.

[19]  Robert J. K. Jacob,et al.  Brain measurement for usability testing and adaptive interfaces: an example of uncovering syntactic workload with functional near infrared spectroscopy , 2009, CHI.

[20]  Thomas Beauvisage,et al.  Computer usage in daily life , 2009, CHI.

[21]  R. Weiss.  Learning from strangers : the art and method of qualitative interview studies , 1995 .

[22]  Jonathan Klein,et al.  This computer responds to user frustration: Theory, design, and results , 2002, Interact. Comput..

[23]  Manfred Tscheligi,et al.  Workload on your fingertips: the influence of workload on touch-based drag and drop , 2013, ITS.

[24]  James A. Landay,et al.  Privacy risk models for designing privacy-sensitive ubiquitous computing systems , 2004, DIS '04.

[25]  Sammy W. Pearson,et al.  Development of a Tool for Measuring and Analyzing Computer User Satisfaction , 1983 .

[26]  J. Gliem,et al.  Calculating, Interpreting, And Reporting Cronbach’s Alpha Reliability Coefficient For Likert-Type Scales , 2003 .

[27]  Fabio Mendez,et al.  On the advantages and disadvantages of subjective measures , 2014 .

[28]  Debora Shaw,et al.  Handbook of usability testing: How to plan, design, and conduct effective tests , 1996 .

[29]  Jane Ogden,et al.  How meaningful are data from Likert scales? An evaluation of how ratings are made and the role of the response shift in the socially disadvantaged , 2012, Journal of health psychology.

[30]  Dola Barua.  Location-Based Services for Mobile Telephony: a study of Users' privacy concerns , 2015 .

[31]  Louise Demers,et al.  The Quebec User Evaluation of Satisfaction with Assistive Technology (QUEST 2.0): An overview and recent progress , 2002 .

[32]  Fred D. Davis.  User Acceptance of Information Technology: System Characteristics, User Perceptions and Behavioral Impacts , 1993, Int. J. Man Mach. Stud..

[33]  Ivo Düntsch,et al.  The IsoMetrics usability inventory: An operationalization of ISO 9241-10 supporting summative and formative evaluation of software systems , 1999, Behav. Inf. Technol..

[34]  Ben Shneiderman,et al.  Designing the user interface (2nd ed.): strategies for effective human-computer interaction , 1992 .

[35]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[36]  Godwin J. Udo,et al.  Privacy and security concerns as major barriers for e-commerce: a survey study , 2001, Inf. Manag. Comput. Secur..

[37]  Mark Bilandzic,et al.  The embodied hybrid space: designing ubiquitous computing towards an amplification of situated real world experiences , 2010, OZCHI '10.

[38]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[39]  Joseph F. Dumas,et al.  A Practical Guide to Usability Testing , 1993 .

[40]  J. Guinée.  Handbook on life cycle assessment — operational guide to the ISO standards , 2001 .

[41]  Richard E. Boyatzis,et al.  Transforming Qualitative Information: Thematic Analysis and Code Development , 1998 .

[42]  Gavriel Salvendy,et al.  A proposed index of usability: A method for comparing the relative usability of different software systems , 1997, Behav. Inf. Technol..

[43]  James A Lenker,et al.  Conceptualization and measurement of assistive technology usability , 2007, Disability and rehabilitation. Assistive technology.

[44]  R. Linn.  Educational measurement, 3rd ed. , 1989 .

[45]  Jakob Nielsen.  Usability metrics and methodologies , 1991, SGCH.

[46]  David Wright,et al.  Should privacy impact assessments be mandatory? , 2011, Commun. ACM.

[47]  Helen Petrie,et al.  The Evaluation of Accessibility, Usability, and User Experience , 2009, The Universal Access Handbook.

[48]  Michael D. Buhrmester,et al.  Amazon's Mechanical Turk , 2011, Perspectives on psychological science : a journal of the Association for Psychological Science.

[49]  Shelah Leader,et al.  A method for identifying the financial burden of hospitalized infants on families. , 2002, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[50]  Clayton Shepard,et al.  Exploring iPhone usage: the influence of socioeconomic differences on smartphone adoption, usage and usability , 2012, Mobile HCI.