A Multi-step Usability Evaluation of a Self-Management App to Support Medication Adherence in Persons Living with HIV

PURPOSE Adherence to antiretroviral therapy is essential to HIV management and sustaining viral suppression. Despite simplified regimens, adherence remains difficult for certain persons living with HIV (PLWH). There is evidence to support the use of mHealth apps for effective self-management in PLWH; however, a medication adherence app with real-time monitoring for this population has not been developed and rigorously evaluated by PLWH. We developed a mHealth app (WiseApp) for HIV self-management to help PLWH self-manage their health. The purpose of this study was to evaluate the usability of the WiseApp. METHODS We conducted a three-step usability evaluation using 1) a traditional think-aloud protocol with end-users, 2) a heuristic evaluation with experts in informatics, and 3) a cognitive walkthrough with end-users. During the cognitive walkthrough, we tested two devices (fitness tracker and medication tracking bottle) that were linked to the WiseApp. RESULTS The think-aloud protocol informed iterative updates to the app, specifically to make it easier to see different sections of the app. The heuristic evaluation confirmed the necessity of these design changes. The cognitive walkthrough informed additional updates and confirmed that overall, the app and the linked devices were usable for the end-users. CONCLUSION The results of the cognitive walkthrough with both experts and end-users informed iterative refinements to the WiseApp and finalization of a mHealth app for PLWH to better self-manage their health.

[1]  S. Lewin,et al.  The end of AIDS: HIV infection as a chronic disease , 2013, The Lancet.

[2]  Rebecca Schnall,et al.  Health Information Technology Usability Evaluation Scale (Health-ITUES) for Usability Assessment of Mobile Health Technology: Validation Study , 2018, JMIR mHealth and uHealth.

[3]  A. Justice HIV and Aging: Time for a New Paradigm , 2010, Current HIV/AIDS reports.

[4]  A. Wu,et al.  Patient-reported nonadherence to HAART is related to protease inhibitor levels. , 2000 .

[5]  Misha Pavel,et al.  Advancing the Science of mHealth , 2012, Journal of health communication.

[6]  Nneka Emenyonu,et al.  Real-Time Adherence Monitoring for HIV Antiretroviral Therapy , 2010, AIDS and Behavior.

[7]  Jasmine Travers,et al.  mHealth Technology as a Persuasive Tool for Treatment, Care and Management of Persons Living with HIV , 2015, AIDS and Behavior.

[8]  Nigel Bevan,et al.  International standards for HCI and usability , 2001, Int. J. Hum. Comput. Stud..

[9]  Jasmine Travers,et al.  A user-centered model for designing consumer mobile health (mHealth) applications (apps) , 2016, J. Biomed. Informatics.

[10]  Alan R. Hevner,et al.  The Three Cycle View of Design Science , 2007, Scand. J. Inf. Syst..

[11]  S. Bakken,et al.  Development of a Customizable Health IT Usability Evaluation Scale. , 2010, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[12]  Monique W. M. Jaspers,et al.  A comparison of usability methods for testing interactive health technologies: Methodological aspects and empirical evidence , 2009, Int. J. Medical Informatics.

[13]  S. Folstein,et al.  "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. , 1975, Journal of psychiatric research.

[14]  Audie A Atienza,et al.  Mobile health technology evaluation: the mHealth evidence workshop. , 2013, American journal of preventive medicine.

[15]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[16]  Loren G. Miller,et al.  A prospective study of predictors of adherence to combination antiretroviral medication , 2002, Journal of General Internal Medicine.

[17]  Jasmine Travers,et al.  Use of Design Science for Informing the Development of a Mobile App for Persons Living with HIV , 2014, AMIA.

[18]  Haomiao Jia,et al.  Mobile Health Technology for Improving Symptom Management in Low Income Persons Living with HIV , 2018, AIDS and Behavior.

[19]  Vimla L. Patel,et al.  Usability in the real world: assessing medical information technologies in patients' homes , 2003, J. Biomed. Informatics.

[20]  Emily Gerth-Guyette,et al.  Impact of mHealth Chronic Disease Management on Treatment Adherence and Patient Outcomes: A Systematic Review , 2015, Journal of medical Internet research.

[21]  B Sheehan,et al.  A comparison of usability factors of four mobile devices for accessing healthcare information by adolescents. , 2012, Applied clinical informatics.

[22]  William Brown,et al.  Assessment of the Health IT Usability Evaluation Model (Health-ITUEM) for evaluating mobile health (mHealth) technology , 2013, J. Biomed. Informatics.

[23]  Brian Shackel,et al.  Usability - Context, framework, definition, design and evaluation , 1991, Interact. Comput..

[24]  Cathleen Wharton,et al.  Cognitive Walkthroughs: A Method for Theory-Based Evaluation of User Interfaces , 1992, Int. J. Man Mach. Stud..

[25]  Rebecca Schnall,et al.  Comparison of a User-Centered Design, Self-Management App to Existing mHealth Apps for Persons Living With HIV , 2015, JMIR mHealth and uHealth.

[26]  Martin C. Maguire,et al.  Methods to support human-centred design , 2001, Int. J. Hum. Comput. Stud..

[27]  L. Hirschhorn,et al.  The CASE adherence index: A novel method for measuring adherence to antiretroviral therapy , 2006, AIDS care.

[28]  R. Hays,et al.  A Comparison Study of Multiple Measures of Adherence to HIV Protease Inhibitors , 2001, Annals of Internal Medicine.

[29]  L. Faulkner Beyond the five-user assumption: Benefits of increased sample sizes in usability testing , 2003, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[30]  Patrick S Sullivan,et al.  Connecting race and place: a county-level analysis of White, Black, and Hispanic HIV prevalence, poverty, and level of urbanization. , 2014, American journal of public health.

[31]  Susan M. Kaiser,et al.  Development and usability testing of FOCUS: a smartphone system for self-management of schizophrenia. , 2013, Psychiatric rehabilitation journal.

[32]  B. J. Fogg,et al.  Persuasive technology: using computers to change what we think and do , 2002, UBIQ.