Identifying Usability and Productivity Dimensions for Measuring the Success of Mobile Business Services

This paper reviews existing measures used for evaluating the usability of information systems and those used for evaluating the level of the productivity of a company. We discuss the usefulness of the existing measures in the mobile business context, where both mobility and work-context pose specific demands for the mobile business services. The review showed that the existing measures rarely consider the great contextual variation caused by the mobility of the services and the demands this poses on usability; which, in turn, affects productivity. To build a measurement tool that better meets the requirements of mobile business services, we completed case studies on two mobile business services, one used in passenger transport and the other in construction sites. Based on the understanding gained from the case studies, we propose a list of dimensions and items addressing both usability and productivity aspects that work as the basis for a multidisciplinary measurement tool.

[1]  Mikael Wiberg.  "Anytime, Anywhere" in the Context of Mobile Work , 2005, Encyclopedia of Information Science and Technology.

[2]  B. S. Sahay.  Multi‐factor productivity measurement model for service organisation , 2005 .

[3]  Reidar Conradi,et al.  Support of Smart Work Processes in Context Rich Environments , 2005, MOBIS.

[4]  Kevin J. Dooley,et al.  Productivity as a Performance Measure , 1992 .

[5]  Kent L. Norman,et al.  Development of an instrument measuring user satisfaction of the human-computer interface , 1988, CHI '88.

[6]  Jakob Nielsen,et al.  Measuring usability: preference vs. performance , 1994, CACM.

[7]  Michael J. Shaw,et al.  Success Factors and Impacts of Mobile Business Applications: Results from a Mobile e-Procurement Study , 2004, Int. J. Electron. Commer..

[8]  Sumeet Gupta,et al.  Value-based Adoption of Mobile Internet: An empirical investigation , 2007, Decis. Support Syst..

[9]  Ofir Turel,et al.  Contextual effects on the usability dimensions of mobile value-added services: a conceptual framework , 2006, Int. J. Mob. Commun..

[10]  Stefan Tangen,et al.  Demystifying productivity and performance , 2005 .

[11]  Jinwoo Kim,et al.  Use Contexts for the Mobile Internet: A Longitudinal Study Monitoring Actual Use of Mobile Internet Services , 2005, Int. J. Hum. Comput. Interact..

[12]  Tonya L. Smith-Jackson,et al.  Reliability and validity of the mobile phone usability questionnaire (MPUQ) , 2006 .

[13]  Nicholas D. Evans,et al.  Business Agility: Strategies for Gaining Competitive Advantage through Mobile Business Solutions , 2001 .

[14]  Lorin M. Hitt,et al.  Beyond the productivity paradox , 1998, CACM.

[15]  Kai Wehmeyer,et al.  User-device attachment - scale development and initial test , 2008, Int. J. Mob. Commun..

[16]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[17]  James R. Lewis,et al.  IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use , 1995, Int. J. Hum. Comput. Interact..

[18]  Jonathan Trevor,et al.  Exploiting space and location as a design framework for interactive mobile systems , 2000, TCHI.

[19]  Kasper Hornbæk,et al.  Measuring usability: are effectiveness, efficiency, and satisfaction really correlated? , 2000, CHI.

[20]  Dongsong Zhang,et al.  Challenges, Methodologies, and Issues in the Usability Testing of Mobile Applications , 2005, Int. J. Hum. Comput. Interact..

[21]  D. Scott Sink,et al.  Productivity management : planning, measurement and evaluation, control, and improvement , 1985 .

[22]  Young Sam Ryu,et al.  Development of Usability Questionnaires for Electronic Mobile Products and Decision Making Methods , 2005 .

[23]  Kenneth E. Murphy,et al.  Intangible benefits valuation in ERP projects , 2002, Inf. Syst. J..

[24]  Kasper Hornbæk,et al.  Current practice in measuring usability: Challenges to usability studies and research , 2006, Int. J. Hum. Comput. Stud..

[25]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[26]  Minder Chen,et al.  Providing web services to mobile users: the architecture design of an m-service portal , 2005, Int. J. Mob. Commun..

[27]  Stephanie Rosenbaum,et al.  Categories of Return on Investment and Their Practical Implications , 2005 .

[28]  Dan Steinbock.  The Mobile Revolution: The Making of Mobile Services Worldwide , 2005 .

[29]  Eija Kaasinen,et al.  User Acceptance of Mobile Services , 2009, Int. J. Mob. Hum. Comput. Interact..

[30]  Ergonomic requirements for office work with visual display terminals ( VDTs ) — Part 11 : Guidance on usability , 1998 .

[31]  C. Sørensen,et al.  Expanding the 'mobility' concept , 2001, SIGG.

[32]  Andrea Rangone,et al.  B2e mobile internet: an exploratory study of Italian applications , 2006, Bus. Process. Manag. J..

[33]  Matti Vartiainen,et al.  Mobile Virtual Work - Concepts, Outcomes and Challenges , 2006, Mobile Virtual Work - A New Paradigm?.

[34]  Parag C. Pendharkar,et al.  Human-computer interaction issues for mobile computing in a variable work context , 2004, Int. J. Hum. Comput. Stud..

[35]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[36]  E. Brynjolfsson,et al.  Paradox Lost? Firm-Level Evidence on the Returns to Information Systems Spending , 1996 .