Measuring Mobile User Experience Instruments for Research and Practice

User experience (UX) research focuses in large part on how users subjectively evaluate digital products, services, and software. In the mobile computing domain, however, UX researchers currently face limitations in the multifaceted measures that they can apply to assess specific mobile device and software combinations. Currently available measures can produce only single-score usability measures (e.g., the well-known system usability scale and its variants) or cover only a part of the mobile device-software user experience (e.g., the recently developed mobile application usability instrument). This paper adds two multifaceted survey instruments to the toolkit of UX researchers and practitioners: the mobile user experience (MUX) instrument, a 15-item instrument tailored toward scholarly research, and the short-form sMUX, a six-item instrument intended for use in practical settings or other situations where survey length is constrained.

[1]  Anol Bhattacherjee,et al.  Understanding Information Systems Continuance: An Expectation-Confirmation Model , 2001, MIS Q..

[2]  Cheryl Burke Jarvis,et al.  The problem of measurement model misspecification in behavioral and organizational research and some recommended solutions. , 2005, The Journal of applied psychology.

[3]  Nathan P. Podsakoff,et al.  The Role of Formative Measurement Models in Strategic Management Research: Review, Critique, and Implications for Future Research , 2006 .

[4]  R. Peterson,et al.  On the relationship between coefficient alpha and composite reliability. , 2013, The Journal of applied psychology.

[5]  Kyoung-jae Kim,et al.  User Experience and the Multi-Stage Adoption of Mobile Apps , 2014 .

[6]  Timothy R. Hinkin,et al.  A Brief Tutorial on the Development of Measures for Use in Survey Questionnaires , 1998 .

[7]  E. Vance Wilson,et al.  Some Unfortunate Consequences of Non-Randomized, Grouped-Item Survey Administration in IS Research , 2012, ICIS.

[8]  Viswanath Venkatesh,et al.  Turning Visitors into Customers: A Usability-Centric Perspective on Purchase Behavior in Electronic Channels , 2006, Manag. Sci..

[9]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[10]  Kraig Finstad,et al.  The Usability Metric for User Experience , 2010, Interact. Comput..

[11]  Ephraim R. McLean,et al.  Information Systems Success: The Quest for the Dependent Variable , 1992, Inf. Syst. Res..

[12]  Philip T. Kortum,et al.  Determining what individual SUS scores mean: adding an adjective rating scale , 2009 .

[13]  M. Liang,et al.  Comparative Measurement Sensitivity of Short and Longer Health Status Instruments , 1992, Medical care.

[14]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[15]  Hongbo Lyu,et al.  An Experience-Based Framework for Evaluating Tourism Mobile Commerce Platforms , 2017, Inf..

[16]  David F. Larcker,et al.  Structural Equation Models with Unobservable Variables and Measurement Error: Algebra and Statistics: , 1981 .

[17]  Joseph S. Dumas,et al.  Usability in practice: formative usability evaluations - evolution and revolution , 2002, CHI Extended Abstracts.

[18]  M. Galesic,et al.  Effects of Questionnaire Length on Participation and Indicators of Response Quality in a Web Survey , 2009 .

[19]  Tamás D. Gedeon,et al.  Pagination versus Scrolling in Mobile Web Search , 2016, CIKM.

[20]  Rolph E. Anderson,et al.  Multivariate Data Analysis (7th ed. , 2009 .

[21]  Dale Goodhue,et al.  Task-Technology Fit and Individual Performance , 1995, MIS Q..

[22]  Paul van Schaik,et al.  Modelling user experience - An agenda for research and practice , 2010, Interact. Comput..

[23]  John P. Robinson,et al.  CHAPTER 1 – Criteria for Scale Selection and Evaluation , 1991 .

[24]  Eleanor T. Loiacono-Mello,et al.  A Call for Item-ordering Transparency in Online IS Survey Administration , 2017, AMCIS.

[25]  James R. Lewis,et al.  Measuring Perceived Usability: The SUS, UMUX-LITE, and AltUsability , 2015, Int. J. Hum. Comput. Interact..

[26]  Stefano Federici,et al.  On the dimensionality of the System Usability Scale: a test of alternative measurement models , 2009, Cognitive Processing.

[27]  Viswanath Venkatesh,et al.  Consumer Acceptance and Use of Information Technology: Extending the Unified Theory of Acceptance and Use of Technology , 2012, MIS Q..

[28]  Jeff Sauro,et al.  The Factor Structure of the System Usability Scale , 2009, HCI.

[29]  Jaehyun Park,et al.  Developing and Verifying a Questionnaire for Evaluating User Value of a Mobile Device , 2015 .

[30]  D. Belanche,et al.  Website usability, consumer satisfaction and the intention to use a website: The moderating effect of perceived risk , 2012 .

[31]  T. Heberlein,et al.  Factors affecting response rates to mailed questionnaires: A quantitative analysis of the published literature. , 1978 .

[32]  Marc Hassenzahl,et al.  The Thing and I: Understanding the Relationship Between User and Product , 2005, Funology.

[33]  Jaehyun Park,et al.  Developing Elements of User Experience for Mobile Phones and Services: Survey, Interview, and Observation Approaches , 2013 .

[34]  Marc Hassenzahl,et al.  User experience - a research agenda , 2006, Behav. Inf. Technol..

[35]  Rémi Houdaille,et al.  Shaping HTTP adaptive streams for a better user experience , 2012, MMSys '12.

[36]  L. Portney,et al.  Foundations of Clinical Research: Applications to Practice , 2015 .

[37]  Nikolaos K. Tselios,et al.  Does size matter?: investigating the impact of mobile phone screen size on users' perceived usability, effectiveness and efficiency. , 2013, MobileHCI '13.

[38]  M. Abdalla,et al.  SF 36 health survey questionnaire: II. Responsiveness to changes in health status in four common clinical conditions. , 1994, Quality in health care : QHC.

[39]  Selim Ickin,et al.  Factors influencing quality of experience of commonly used mobile applications , 2012, IEEE Communications Magazine.

[40]  Michalis Nik Xenos,et al.  Perceived Usability Evaluation of Learning Management Systems: A First Step towards Standardization of the System Usability Scale in Greek , 2012, 2012 16th Panhellenic Conference on Informatics.

[41]  Zahra Ghanbari,et al.  Psychometric properties of the persian language version of the system usability scale. , 2014, Health promotion perspectives.

[42]  Philip T. Kortum,et al.  Measuring the Usability of Mobile Applications for Phones and Tablets , 2015, Int. J. Hum. Comput. Interact..

[43]  Vincent Koenig,et al.  User experience: A concept without consensus? Exploring practitioners' perspectives through an international survey , 2015, Comput. Hum. Behav..

[44]  Richard P. Bagozzi,et al.  Measurement and Meaning in Information Systems and Organizational Research: Methodological and Philosophical Foundations , 2011, MIS Q..

[45]  E. Vance Wilson,et al.  Context Counts: Effects of Work versus Non-Work Context on Participants' Perceptions of Fit in E-mail versus Face-to-Face Communication , 2008, Commun. Assoc. Inf. Syst..

[46]  Viswanath Venkatesh,et al.  Mobile Application Usability: Conceptualization and Instrument Development , 2015, MIS Q..

[47]  E. Vance Wilson,et al.  MUX: Development of a Holistic Mobile User Experience Instrument , 2017, HICSS.