Usability Challenges for Health and Wellness Mobile Apps: Mixed-Methods Study Among mHealth Experts and Consumers

Background By 2019, there will be an estimated 4.68 billion mobile phone users globally. This increase comes with an unprecedented proliferation in mobile apps, a plug-and-play product positioned to improve lives in innumerable ways. Within this landscape, medical apps will see a 41% compounded annual growth rate between 2015 and 2020, but paradoxically, prevailing evidence indicates declining downloads of such apps and decreasing “stickiness” with the intended end users. Objective As usability is a prerequisite for success of health and wellness mobile apps, this paper aims to provide insights and suggestions for improving usability experience of the mobile health (mHealth) app by exploring the degree of alignment between mHealth insiders and consumers. Methods Usability-related major themes were selected from over 20 mHealth app development studies. The list of themes, grouped into 5 categories using the Nielsen usability model, was then used as a framework to identify and classify the responses from mHealth expert (insider) interviews. Responses from the qualitative phase were integrated into some questions for a quantitative consumer survey. Subsequently, categorical data from qualitative mHealth insider interviews and numerical data from a quantitative consumer survey were compared in order to identify common usability themes and areas of divergence. Results Of the 5 usability attributes described in Nielsen model, Satisfaction ranked as the top attribute for both mHealth insiders and consumers. Satisfaction refers to user likability, comfort, and pleasure. The consumer survey yielded 451 responses. Out of 9 mHealth insiders’ top concerns, 5 were similar to those of the consumers. On the other hand, consumers did not grade themes such as Intuitiveness as important, which was deemed vital by mHealth insiders. Other concerns of the consumers include in-app charges and advertisements. Conclusions This study supports and contributes to the existing pool of mixed-research studies. Strengthening the connectivity between suppliers and users (through the designed research tool) will help increase uptake of mHealth apps. In a holistic manner, this will have a positive overall outcome for the mHealth app ecosystem.

[1]  Elizabeth M. Borycki,et al.  Usability problems do not heal by themselves: National survey on physicians' experiences with EHRs in Finland , 2017, Int. J. Medical Informatics.

[2]  Peter D. Karp,et al.  How much does curation cost? , 2016, Database J. Biol. Databases Curation.

[3]  J. Morse Designing funded qualitative research. , 1994 .

[4]  Aline Chevalier,et al.  The influence of the search complexity and the familiarity with the website on the subjective appraisal of aesthetics, mental effort and usability , 2014, Behav. Inf. Technol..

[5]  Marco Kalz,et al.  Smartphone Apps for Cardiopulmonary Resuscitation Training and Real Incident Support: A Mixed-Methods Evaluation Study , 2014, Journal of medical Internet research.

[6]  Nancy Staggers,et al.  An evaluation of patients' experienced usability of a diabetes mHealth system using a multi-method approach , 2016, J. Biomed. Informatics.

[7]  Emma J. Rose,et al.  Community-Based User Experience: Evaluating the Usability of Health Insurance Information with Immigrant Patients , 2017, IEEE Transactions on Professional Communication.

[8]  A. Haines,et al.  The Effectiveness of Mobile-Health Technology-Based Health Behaviour Change or Disease Management Interventions for Health Care Consumers: A Systematic Review , 2013, PLoS medicine.

[9]  Cecily Morrison,et al.  Apps for asthma self-management: a systematic assessment of content and tools , 2012, BMC Medicine.

[10]  C Sutter,et al.  Notebook input devices put to the age test: the usability of trackpoint and touchpad for middle-aged adults , 2007, Ergonomics.

[11]  John Torous,et al.  Towards a Framework for Evaluating Mobile Mental Health Apps. , 2015, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[13]  Susan S. Woods,et al.  Barriers and drivers of health information technology use for the elderly, chronically ill, and underserved. , 2008, Evidence report/technology assessment.

[14]  Jodi G. Daniel,et al.  A national action plan to support consumer engagement via e-health. , 2013, Health affairs.

[15]  Dan Wilson,et al.  Integrating data from an online diabetes prevention program into an electronic health record and clinical workflow, a design phase usability study , 2016, BMC Medical Informatics and Decision Making.

[16]  Jenine K. Harris,et al.  Evaluating Diabetes Mobile Applications for Health Literate Designs and Functionality, 2014 , 2015, Preventing chronic disease.

[17]  J. Coughlin,et al.  PERSPECTIVE: Older Adults' Adoption of Technology: An Integrated Approach to Identifying Determinants and Barriers , 2015 .

[18]  Allison Gates,et al.  Evaluating User Perceptions of Mobile Medication Management Applications With Older Adults: A Usability Study , 2014, JMIR mHealth and uHealth.

[19]  Joel J. P. C. Rodrigues,et al.  Mobile-health: A review of current state in 2015 , 2015, J. Biomed. Informatics.

[20]  Lotte N. S. Andreasen Struijk,et al.  Error-Free Text Typing Performance of an Inductive Intra-Oral Tongue Computer Interface for Severely Disabled Individuals , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  Gunnar Hartvigsen,et al.  Mobile Health Applications to Assist Patients with Diabetes: Lessons Learned and Design Implications , 2012, Journal of diabetes science and technology.

[22]  Markus Pudelko,et al.  Challenges in international survey research: a review with illustrations and suggested solutions for best practice , 2013, European J. of International Management.

[23]  John Michael Pearson,et al.  Integrating website usability with the electronic commerce acceptance model , 2011, Behav. Inf. Technol..

[24]  Shah Jahan Miah,et al.  Extending the framework for mobile health information systems Research: A content analysis , 2017, Inf. Syst..

[25]  Laura Johnson,et al.  How Many Interviews Are Enough? , 2006 .

[26]  J. Nielsen Usability inspection methods , 1994, CHI Conference Companion.

[27]  Jovy-Anne Rosario,et al.  A Study in Usability: Redesigning a Health Sciences Library's Mobile Site , 2012, Medical reference services quarterly.

[28]  M. Green,et al.  Digital natives , 2012, BDJ.

[29]  S. Stjernswärd,et al.  User value and usability of a web‐based mindfulness intervention for families living with mental health problems , 2017, Health & social care in the community.

[30]  Rex B. Kline,et al.  Usability measurement and metrics: A consolidated model , 2006, Software Quality Journal.

[31]  Oksana Burford,et al.  Mobile Health Apps to Facilitate Self-Care: A Qualitative Study of User Experiences , 2016, PloS one.

[32]  Alexandra Fort,et al.  Digital, analogue, or redundant speedometers for truck driving: Impact on visual distraction, efficiency and usability. , 2017, Applied ergonomics.

[33]  Kensaku Kawamoto,et al.  Model Formulation: The HL7-OMG Healthcare Services Specification Project: Motivation, Methodology, and Deliverables for Enabling a Semantically Interoperable Service-oriented Architecture for Healthcare , 2009, J. Am. Medical Informatics Assoc..

[34]  Roslyn Cameron,et al.  A sequential mixed model research design: Design, analytical and display issues , 2009 .

[35]  J. Cafazzo,et al.  Design of an mHealth App for the Self-management of Adolescent Type 1 Diabetes: A Pilot Study , 2012, Journal of medical Internet research.

[36]  Syed Ali Hussain,et al.  A qualitative study of user perceptions of mobile health apps , 2016, BMC Public Health.

[37]  Parmit K. Chilana,et al.  Acceptance of Commercially Available Wearable Activity Trackers Among Adults Aged Over 50 and With Chronic Illness: A Mixed-Methods Evaluation , 2016, JMIR mHealth and uHealth.

[38]  Corbin Bosse,et al.  Improving EHR Usability Using LEAN Methodology , 2016, Nursing Informatics.

[39]  D. Spruijt-Metz,et al.  mHealth approaches to child obesity prevention: successes, unique challenges, and next directions , 2013, Translational behavioral medicine.

[40]  L. Kozma-Spytek,et al.  Telecoil-mode hearing aid compatibility performance requirements for wireless and cordless handsets: magnetic signal-to-noise. , 2011, Journal of the American Academy of Audiology.

[41]  Richard J. Rossi,et al.  Applied Biostatistics for the Health Sciences , 2009 .

[42]  Christian Lovis,et al.  Assessing the Usability of Six Data Entry Mobile Interfaces for Caregivers: A Randomized Trial , 2017 .

[43]  Jasmine Travers,et al.  A user-centered model for designing consumer mobile health (mHealth) applications (apps) , 2016, J. Biomed. Informatics.

[44]  Michael D Fetters,et al.  Achieving integration in mixed methods designs-principles and practices. , 2013, Health services research.

[45]  Anne-Marie Guerguerian,et al.  “Usability of data integration and visualization software for multidisciplinary pediatric intensive care: a human factors approach to assessing technology” , 2017, BMC Medical Informatics and Decision Making.

[46]  C. Hawn Take two aspirin and tweet me in the morning: how Twitter, Facebook, and other social media are reshaping health care. , 2009, Health affairs.

[47]  M. Prensky Digital Natives, Digital Immigrants Part 1 , 2001 .

[48]  William B. Lober,et al.  Development and usability testing of a web-based cancer symptom and quality-of-life support intervention , 2015, Health Informatics J..

[49]  A. Rykman,et al.  Patient Engagement Is Related to Impairment Reduction During Digital Game-Based Therapy in Stroke. , 2017, Games for health journal.

[50]  Klaus Krippendorff,et al.  Content Analysis: An Introduction to Its Methodology , 1980 .

[51]  Qing Zhu,et al.  Status and trends of mobile-health applications for iOS devices: A developer's perspective , 2011, J. Syst. Softw..

[52]  Mariette Bengtsson,et al.  How to plan and perform a qualitative study using content analysis , 2016 .

[53]  William Cyrus Navidi,et al.  Statistics for Engineers and Scientists , 2004 .

[54]  Dongsong Zhang,et al.  Challenges, Methodologies, and Issues in the Usability Testing of Mobile Applications , 2005, Int. J. Hum. Comput. Interact..

[55]  J. Creswell Qualitative inquiry and research design: choosing among five traditions. , 1998 .

[56]  Jason W. Osborne,et al.  Best Practices in Data Cleaning: A Complete Guide to Everything You Need to Do Before and After Collecting Your Data , 2012 .

[57]  Lyndal Trevena,et al.  A systematic review of quality assessment methods for smartphone health apps. , 2015, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[58]  Molly E Waring,et al.  Evaluating and selecting mobile health apps: strategies for healthcare providers and healthcare organizations , 2014, Translational behavioral medicine.

[59]  Ilkka Korhonen,et al.  Mobile Diary for Wellness Management—Results on Usage and Usability in Two User Studies , 2008, IEEE Transactions on Information Technology in Biomedicine.

[60]  P. Pronovost,et al.  Usability and perceived usefulness of Personal Health Records for preventive health care: a case study focusing on patients' and primary care providers' perspectives. , 2014, Applied ergonomics.

[61]  Audie A Atienza,et al.  Mobile health technology evaluation: the mHealth evidence workshop. , 2013, American journal of preventive medicine.