The mHealth App Usability Questionnaire (MAUQ): Development and Validation Study

Background After a mobile health (mHealth) app is created, an important step is to evaluate the usability of the app before it is released to the public. There are multiple ways of conducting a usability study, one of which is collecting target users’ feedback with a usability questionnaire. Different groups have used different questionnaires for mHealth app usability evaluation: The commonly used questionnaires are the System Usability Scale (SUS) and Post-Study System Usability Questionnaire (PSSUQ). However, the SUS and PSSUQ were not designed to evaluate the usability of mHealth apps. Self-written questionnaires are also commonly used for evaluation of mHealth app usability but they have not been validated. Objective The goal of this project was to develop and validate a new mHealth app usability questionnaire. Methods An mHealth app usability questionnaire (MAUQ) was designed by the research team based on a number of existing questionnaires used in previous mobile app usability studies, especially the well-validated questionnaires. MAUQ, SUS, and PSSUQ were then used to evaluate the usability of two mHealth apps: an interactive mHealth app and a standalone mHealth app. The reliability and validity of the new questionnaire were evaluated. The correlation coefficients among MAUQ, SUS, and PSSUQ were calculated. Results In this study, 128 study participants provided responses to the questionnaire statements. Psychometric analysis indicated that the MAUQ has three subscales and their internal consistency reliability is high. The relevant subscales correlated well with the subscales of the PSSUQ. The overall scale also strongly correlated with the PSSUQ and SUS. Four versions of the MAUQ were created in relation to the type of app (interactive or standalone) and target user of the app (patient or provider). A website has been created to make it convenient for mHealth app developers to use this new questionnaire in order to assess the usability of their mHealth apps. Conclusions The newly created mHealth app usability questionnaire—MAUQ—has the reliability and validity required to assess mHealth app usability.

[1]  Heather J Ross,et al.  Mobile Phone-Based Telemonitoring for Heart Failure Management: A Randomized Controlled Trial , 2012, Journal of medical Internet research.

[2]  Thomas K. Landauer,et al.  Behavioral Research Methods in Human-Computer Interaction , 1997 .

[3]  Jie Bao,et al.  Systematic Review Protocol to Assess the Effectiveness of Usability Questionnaires in mHealth App Studies , 2017, JMIR research protocols.

[4]  Bambang Parmanto,et al.  Outcomes of Clinicians, Caregivers, Family Members and Adults with Spina Bifida Regarding Receptivity to use of the iMHere mHealth Solution to Promote Wellness , 2013, International journal of telerehabilitation.

[5]  Chao-Ming Wang,et al.  A study of usability principles and interface design for mobile e-books , 2015, Ergonomics.

[6]  Jason W. Osborne,et al.  Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. , 2005 .

[7]  Rebecca Schnall,et al.  Health Information Technology Usability Evaluation Scale (Health-ITUES) for Usability Assessment of Mobile Health Technology: Validation Study , 2018, JMIR mHealth and uHealth.

[8]  Stoyan R. Stoyanov,et al.  Development and Validation of the User Version of the Mobile Application Rating Scale (uMARS) , 2016, JMIR mHealth and uHealth.

[9]  BAMBANG PARMANTO,et al.  Development of the Telehealth Usability Questionnaire (TUQ) , 2016, International journal of telerehabilitation.

[10]  William Brown,et al.  Assessment of the Health IT Usability Evaluation Model (Health-ITUEM) for evaluating mobile health (mHealth) technology , 2013, J. Biomed. Informatics.

[11]  David M. Liebovitz,et al.  Consumer Mobile Health Apps: Current State, Barriers, and Future Directions , 2017, PM & R : the journal of injury, function, and rehabilitation.

[12]  B. Parmanto,et al.  A User-Centered Approach: Understanding Client and Caregiver Needs and Preferences in the Development of mHealth Apps for Self-Management , 2017, JMIR mHealth and uHealth.

[13]  P. Krebs,et al.  Health App Use Among US Mobile Phone Owners: A National Survey , 2015, JMIR mHealth and uHealth.

[14]  Bambang Parmanto,et al.  Development of mHealth system for supporting self-management and remote consultation of skincare , 2015, BMC Medical Informatics and Decision Making.

[15]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[16]  James R. Lewis,et al.  IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use , 1995, Int. J. Hum. Comput. Interact..

[17]  Alain Abran,et al.  Usability evaluation of mobile applications using ISO 9241 and ISO 25062 standards , 2016, SpringerPlus.

[18]  Suzanne Bakken,et al.  Examining construct and predictive validity of the Health-IT Usability Evaluation Scale: confirmatory factor analysis and structural equation modeling results. , 2014, Journal of the American Medical Informatics Association : JAMIA.

[19]  Bambang Parmanto,et al.  iMHere: A Novel mHealth System for Supporting Self-Care in Management of Complex and Chronic Conditions , 2013, JMIR mHealth and uHealth.

[20]  Derek Flood,et al.  Usability of mobile applications: literature review and rationale for a new usability model , 2013, Journal of Interaction Science.

[21]  Amira A. Roess,et al.  The Promise, Growth, and Reality of Mobile Health - Another Data-free Zone. , 2017, The New England journal of medicine.

[22]  Oksana Zelenko,et al.  Mobile App Rating Scale: A New Tool for Assessing the Quality of Health Mobile Apps , 2015, JMIR mHealth and uHealth.

[23]  E. Seto,et al.  Perceptions and Experiences of Heart Failure Patients and Clinicians on the Use of Mobile Phone-Based Telemonitoring , 2012, Journal of medical Internet research.

[24]  Kent L. Norman,et al.  Development of an instrument measuring user satisfaction of the human-computer interface , 1988, CHI '88.