Reliability and validity of the mobile phone usability questionnaire (MPUQ)

This study was a follow-up to determine the psychometric quality of the usability questionnaire items derived from a previous study (Ryu and Smith-Jackson, 2005), and to find a subset of items that represents a higher measure of reliability and validity. To evaluate the items, the questionnaire was administered to a representative sample involving approximately 300 participants. The findings revealed a six-factor structure, including (1) Ease of learning and use, (2) Assistance with operation and problem solving, (3) Emotional aspect and multimedia capabilities, (4) Commands and minimal memory load, (5) Efficiency and control, and (6) Typical tasks for mobile phones. The appropriate 72 items constituted the Mobile Phone Usability Questionnaire (MPUQ), which evaluates the usability of mobile phones for the purpose of making decisions among competing variations in the end-user market, determining alternatives of prototypes during the development process, and evolving versions during an iterative design process.

[1]  John P. Campbell,et al.  Measurement Theory for the Behavioral Sciences. , 1983 .

[2]  L. Cronbach.  Coefficient alpha and the internal structure of tests , 1951 .

[3]  Larry Hatcher,et al.  A Step-by-Step Approach to Using the SAS System for Factor Analysis and Structural Equation Modeling , 1994 .

[4]  van Epwm Erik Veenendaal,et al.  Questionnaire based usability testing , 1999 .

[5]  B. Price.  A First Course in Factor Analysis , 1993 .

[6]  Tonya L. Smith-Jackson,et al.  Development of Usability Questionnaire Items for Mobile Products and Content Validity , 2005 .

[7]  Mary Corbett,et al.  SUMI: the Software Usability Measurement Inventory , 1993, Br. J. Educ. Technol..

[8]  R. Lissitz,et al.  Limitations of Coefficient Alpha as an Index of Test Unidimensionality1 , 1977 .

[9]  Richard G. Netemeyer,et al.  Scaling Procedures: Issues and Applications , 2003 .

[10]  Motoei Azuma.  SquaRE The next generation of the ISO/IEC 9126 and 14598 international standards series on software product quality , 2001 .

[11]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[12]  James R. Lewis,et al.  IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use , 1995, Int. J. Hum. Comput. Interact..

[13]  Howard B. Lee,et al.  A first course in factor analysis , 1973 .

[14]  James R. Lewis,et al.  Psychometric Evaluation of the PSSUQ Using Data from Five Years of Usability Studies , 2002, Int. J. Hum. Comput. Interact..

[15]  R. Darlington,et al.  Factor Analysis , 2008 .

[16]  Joseph B. Sidowski,et al.  Measurements of computer satisfaction, literacy, and aptitudes: A review , 1990, Int. J. Hum. Comput. Interact..

[17]  Ergonomic requirements for office work with visual display terminals ( VDTs ) — Part 11 : Guidance on usability , 1998 .

[18]  Kent L. Norman,et al.  Development of an instrument measuring user satisfaction of the human-computer interface , 1988, CHI '88.

[19]  Jurek Kirakowski,et al.  The Software Usability Measurement Inventory: Background and Usage , 1996 .

[20]  Rosedith Sitgreaves Bowker.  Measurement Theory for the Behavioral Sciences , 1983 .

[21]  C. Heckler.  A Step-by-Step Approach to Using the SAS™ System for Factor Analysis and Structural Equation Modeling , 1996 .

[22]  Robert F. DeVellis,et al.  Scale Development: Theory and Applications. , 1992 .

[23]  Xianggui Qu,et al.  Multivariate Data Analysis , 2007, Technometrics.

[24]  J. M. Cortina,et al.  What Is Coefficient Alpha? An Examination of Theory and Applications , 1993 .

[25]  F. Floyd,et al.  Factor analysis in the development and refinement of clinical assessment instruments. , 1995 .

[26]  Jurek Kirakowski,et al.  Measuring the Usability of Web Sites , 1998 .

[27]  Udo Konradt,et al.  Usability in online shops: scale construction, validation and the influence on the buyers’ intention and decision , 2003, Behav. Inf. Technol..