A web application to involve patients in the medication reconciliation process: a user-centered usability and usefulness study

Objective Medication reconciliation (MedRec) can improve patient safety by resolving medication discrepancies. Because information technology (IT) and patient engagement are promising approaches to optimizing MedRec, the SEAMPAT project aims to develop a MedRec IT platform based on two applications: the "patient app" and the "MedRec app." This study evaluates three dimensions of the usability (efficiency, satisfaction, and effectiveness) and usefulness of the patient app. Methods We performed a four-month user-centered observational study. Quantitative and qualitative data were collected. Participants completed the system usability scale (SUS) questionnaire and a second questionnaire on usefulness. Effectiveness was assessed by measuring the completeness of the medication list generated by the patient application and its correctness (ie medication discrepancies between the patient list and the best possible medication history). Qualitative data were collected from semi-structured interviews, observations and comments, and questions raised by patients. Results Forty-two patients completed the study. Sixty-nine percent of patients considered the patient app to be acceptable (SUS Score ≥ 70) and usefulness was high. The medication list was complete for a quarter of the patients (7/28) and there was a discrepancy for 21.7% of medications (21/97). The qualitative data enabled the identification of several barriers (related to functional and non-functional aspects) to the optimization of usability and usefulness. Conclusions Our findings highlight the importance and value of user-centered usability testing of a patient application implemented in "real-world" conditions. To achieve adoption and sustained use by patients, the app should meet patients' needs while also efficiently improving the quality of MedRec.

[1]  Tosha B. Wetterneck,et al.  A toolkit to disseminate best practices in inpatient medication reconciliation: multi-center medication reconciliation quality improvement study (MARQUIS). , 2013, Joint Commission journal on quality and patient safety.

[2]  J. B. Brooke,et al.  SUS: a retrospective , 2013 .

[3]  S. Simon,et al.  Aligning Medication Reconciliation and Secure Messaging: Qualitative Study of Primary Care Providers’ Perspectives , 2013, Journal of medical Internet research.

[4]  Blake J. Lesselroth,et al.  Medication review software to improve the accuracy of outpatient medication histories: protocol for a randomized controlled trial , 2012 .

[5]  David W. Bates,et al.  An effort to improve electronic health record medication list accuracy between visits: Patients' and physicians' response , 2008, Int. J. Medical Informatics.

[6]  J. Schnipper,et al.  The problem with medication reconciliation , 2016, BMJ Quality & Safety.

[7]  Carol M. Barnum.  Usability Testing Essentials: Ready, Set...Test! , 2010 .

[8]  Jeff Sauro,et al.  When designing usability questionnaires, does it hurt to be positive? , 2011, CHI.

[9]  Alain Venot,et al.  Design and evaluation of a software for the objective and easy-to-read presentation of new drug properties to physicians , 2015, BMC Medical Informatics and Decision Making.

[10]  Alain Venot,et al.  Comparison of two kinds of interface, based on guided navigation or usability principles, for improving the adoption of computerized decision support systems: application to the prescription of antibiotics. , 2014, Journal of the American Medical Informatics Association : JAMIA.

[11]  Anne Spinewine,et al.  Electronic tools to support medication reconciliation: a systematic review , 2017, J. Am. Medical Informatics Assoc..

[12]  James L. Rudolph,et al.  Characterizing medication discrepancies among older adults during transitions of care: a systematic review focusing on discrepancy synonyms, data sources and classification terms , 2013 .

[13]  Andrew J. McLachlan,et al.  Impact of electronic medication reconciliation interventions on medication discrepancies at hospital transitions: a systematic review and meta-analysis , 2016, BMC Medical Informatics and Decision Making.

[14]  Ben Shneiderman,et al.  Twinlist: Novel User Interface Designs for Medication Reconciliation , 2013, AMIA.

[15]  Anne Spinewine,et al.  Approaches for improving continuity of care in medication management: a systematic review. , 2013, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[16]  Stephanie K. Mueller,et al.  Hospital-based medication reconciliation practices: a systematic review. , 2012, Archives of internal medicine.

[17]  M. J. Yuan,et al.  An Observational Study to Evaluate the Usability and Intent to Adopt an Artificial Intelligence–Powered Medication Reconciliation Tool , 2016, Interactive journal of medical research.

[18]  Zackary Berger,et al.  Promoting engagement by patients and families to reduce adverse events in acute care settings: a systematic review , 2013, BMJ quality & safety.

[19]  Rosemary Burke,et al.  Pharmacist-led admission medication reconciliation before and after the implementation of an electronic medication management system , 2017, Int. J. Medical Informatics.

[20]  S. Simon,et al.  Engaging patients in medication reconciliation via a patient portal following hospital discharge. , 2014, Journal of the American Medical Informatics Association : JAMIA.

[21]  Sung-joon Min,et al.  Posthospital medication discrepancies: prevalence and contributing factors. , 2005, Archives of internal medicine.

[22]  Paul Barach,et al.  Beliefs and experiences can influence patient participation in handover between primary and secondary care—a qualitative study of patient perspectives , 2012, BMJ quality & safety.

[23]  Catherine L. Liang,et al.  Effect of an electronic medication reconciliation application and process redesign on potential adverse drug events: a cluster-randomized trial. , 2009, Archives of internal medicine.

[24]  K. Shojania,et al.  Medication Reconciliation During Transitions of Care as a Patient Safety Strategy , 2013, Annals of Internal Medicine.

[25]  A. C. Zoni,et al.  The impact of medication reconciliation program at admission in an internal medicine department. , 2012, European journal of internal medicine.

[26]  Hsiu-Fang Hsieh,et al.  Three Approaches to Qualitative Content Analysis , 2005, Qualitative health research.

[27]  Ben Shneiderman,et al.  Novel user interface design for medication reconciliation: an evaluation of Twinlist , 2015, J. Am. Medical Informatics Assoc..

[28]  Joseph L. Kannry,et al.  The Relationship of Usability to Medical Error: An Evaluation of Errors Associated with Usability Problems in the Use of a Handheld Application for Prescribing Medications , 2004, MedInfo.

[29]  Marco Aiello,et al.  Usability Evaluation of a Web-Based Support System for People With a Schizophrenia Diagnosis , 2012, Journal of medical Internet research.

[30]  Nancy Staggers,et al.  Quantifying usability: an evaluation of a diabetes mHealth system on effectiveness, efficiency, and satisfaction metrics with associated user characteristics , 2015, J. Am. Medical Informatics Assoc..

[31]  Juan Pablo Hourcade,et al.  Personal health records: a randomized trial of effects on elder medication safety , 2014, J. Am. Medical Informatics Assoc..

[32]  Tina M Nester,et al.  Implementation of an electronic system for medication reconciliation. , 2007, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[33]  Gijs Hesselink,et al.  The key actor: a qualitative study of patient participation in the handover process in Europe , 2012, BMJ quality & safety.

[34]  Tejal K. Gandhi,et al.  Effects of an online personal health record on medication accuracy and safety: a cluster-randomized trial , 2012, J. Am. Medical Informatics Assoc..

[35]  Blake J. Lesselroth,et al.  Using consumer-based kiosk technology to improve and standardize medication reconciliation in a specialty care setting. , 2009, Joint Commission journal on quality and patient safety.

[36]  Elizabeth M Borycki,et al.  Low-cost rapid usability engineering: designing and customizing usable healthcare information systems. , 2006, Healthcare quarterly.

[37]  Jeffrey Rubin,et al.  Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests , 1994 .

[38]  Abha Agrawal,et al.  Reducing medication errors and improving systems reliability using an electronic medication reconciliation system. , 2009, Joint Commission journal on quality and patient safety.

[39]  Michael K Paasche-Orlow,et al.  Beyond Medication Reconciliation: The Correct Medication List , 2017, JAMA.

[40]  F. Lau,et al.  Use of Information Technology in Medication Reconciliation: A Scoping Review , 2010, The Annals of pharmacotherapy.

[41]  Miika Linna,et al.  The Effect of a Patient Portal With Electronic Messaging on Patient Activation Among Chronically Ill Patients: Controlled Before-and-After Study , 2014, Journal of medical Internet research.

[42]  M. Street,et al.  A systematic review of reliable and valid tools for the measurement of patient participation in healthcare , 2015, BMJ Quality & Safety.

[43]  Valéry Ramon,et al.  SEAMPAT - An ICT Platform for Medication Reconciliation with Active Patient Involvement , 2016, ICCHP.

[44]  J Brender,et al.  STARE-HI – Statement on Reporting of Evaluation Studies in Health Informatics , 2013, Applied Clinical Informatics.

[45]  A. C. Zoni,et al.  Developing a programme for medication reconciliation at the time of admission into hospital , 2011, International Journal of Clinical Pharmacy.

[46]  Philip T. Kortum,et al.  Determining what individual SUS scores mean: adding an adjective rating scale , 2009 .

[47]  Anne Spinewine,et al.  Initiatives promoting seamless care in medication management: an international review of the grey literature , 2013, International Journal of Clinical Pharmacy.

[48]  James T. Miller,et al.  An Empirical Evaluation of the System Usability Scale , 2008, Int. J. Hum. Comput. Interact..

[49]  Jeffrey L. Schnipper,et al.  Hospital-Based Medication Reconciliation Practices , 2016 .

[50]  Blake J. Lesselroth,et al.  Implementation Brief: Design and Implementation of a Medication Reconciliation Kiosk: the Automated Patient History Intake Device (APHID) , 2009, J. Am. Medical Informatics Assoc..

[51]  Jeff Sauro,et al.  The Factor Structure of the System Usability Scale , 2009, HCI.

[52]  Norman K. Sondheimer,et al.  How Patients Can Improve the Accuracy of their Medical Records , 2014, EGEMS.

[53]  Anne Spinewine,et al.  Content validity and inter-rater reliability of an instrument to characterize unintentional medication discrepancies. , 2012, Drugs & aging.

[54]  Blake J. Lesselroth,et al.  Primary care provider perceptions and use of a novel medication reconciliation technology. , 2011, Informatics in primary care.

[55]  Katie A. Siek,et al.  Colorado Care Tablet: The design of an interoperable Personal Health Application to help older adults with multimorbidity manage their medications , 2010, J. Biomed. Informatics.

[56]  Taya Irizarry,et al.  Patient Portals and Patient Engagement: A State of the Science Review , 2015, Journal of medical Internet research.

[57]  Dominique Pestiaux,et al.  Accès direct par les patients à leur dossier médical informatisé. Présentation du projet mis en place au sein des Cliniques universitaires Saint-Luc , 2015 .

[58]  Blackford Middleton,et al.  Design and implementation of a web-based patient portal linked to an electronic health record designed to improve medication safety: the Patient Gateway medications module. , 2008, Informatics in primary care.

[59]  S. Tulledge-Scheitel,et al.  Medication reconciliation in ambulatory care: attempts at improvement , 2009, Quality and Safety in Health Care.

[60]  R. Plá-Mestre,et al.  Effectiveness of an electronic tool for medication reconciliation in a general surgery department , 2015, International Journal of Clinical Pharmacy.

[61]  Vimla L. Patel,et al.  Cognitive and usability engineering methods for the evaluation of clinical information systems , 2004, J. Biomed. Informatics.