Framework for Evaluating and Implementing Inpatient Portals: a Multi-stakeholder Perspective

Inpatient portals are emerging as an important tool to support patient care and are increasingly being adopted in hospitals. However, best practices concerning the implementation, use, and impact of these portals are poorly understood. To improve evaluation and implementation efforts, this paper develops a logic model that can help researchers and hospital managers in deploying and assessing the impact of inpatient portals. Guided by the Systems Engineering Initiative for Patient Safety (SEIPS) framework, we held a series of two focus groups (n = 12 and n = 8, respectively) and an online forum (n = 14) including hospital administrators, clinicians, patients, and information technology team members to learn from these stakeholders about the system-wide implementation and evaluation of an inpatient portal at an academic medical center in the United States. These sessions were supplemented with a Nominal Group process to assess the relative importance and feasibility of evaluation areas. Our Logic Model highlights that patients are at the center of the multi-stakeholder context within which inpatient portals are being implemented, and that collaborative work is necessary for successful implementation and evaluation of the tool. The Model also identifies priority areas for evaluation, and it suggests measures and data sources applicable for quality improvement and research. Applying the SEIPS 2.0 framework, this Logic Model captures the multiple relevant stakeholder perspectives by describing the organizational structures, processes, and outcomes that pertain to inpatient portals. This Model provides specific evaluation suggestions for hospital managers seeking to implement inpatient portals as well as for researchers seeking to evaluate this new technology.

[1]  Ann Scheck McAlearney,et al.  Information technology to support patient engagement: where do we stand and where can we go? , 2017, J. Am. Medical Informatics Assoc..

[2]  Alvin Rajkomar,et al.  Using Tablet Computers to Increase Patient Engagement With Electronic Personal Health Records: Protocol For a Prospective, Randomized Interventional Study , 2016, JMIR research protocols.

[3]  Steven K. Feiner,et al.  Patient engagement in the inpatient setting: a systematic review , 2014, J. Am. Medical Informatics Assoc..

[4]  Michelle L. Rogers,et al.  Research Paper: Usability Testing Finds Problems for Novice Users of Pediatric Portals , 2009, J. Am. Medical Informatics Assoc..

[5]  Roberta Shanman,et al.  Identifying, Categorizing, and Evaluating Health Care Efficiency Measures , 2008 .

[6]  Peter Hoonakker,et al.  Using an inpatient portal to engage families in pediatric hospital care , 2017, J. Am. Medical Informatics Assoc..

[7]  K. Klein,et al.  The Challenge of Innovation Implementation , 1996 .

[8]  C. Helfrich,et al.  Implementation Science Organizational Readiness to Change Assessment (orca): Development of an Instrument Based on the Promoting Action on Research in Health Services (parihs) Framework , 2022 .

[9]  Christian D Helfrich,et al.  Determinants of Implementation Effectiveness , 2007, Medical care research and review : MCRR.

[10]  Laura Sampietro-Colom,et al.  CHANGING HEALTH TECHNOLOGY ASSESSMENT PARADIGMS? , 2016, International Journal of Technology Assessment in Health Care.

[11]  André L. Delbecq,et al.  A Group Process Model for Problem Identification and Program Planning , 1971 .

[12]  Ann Scheck McAlearney,et al.  System-Wide Inpatient Portal
 Implementation: Survey of Health Care Team Perceptions , 2017, JMIR medical informatics.

[13]  P. Carayon,et al.  SEIPS 2.0: a human factors framework for studying and improving the work of healthcare professionals and patients , 2013, Ergonomics.

[14]  E. Winstanley,et al.  Inpatient Experiences with MyChart Bedside. , 2017, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[15]  G. Pisano,et al.  Disrupted Routines: Team Learning and New Technology Implementation in Hospitals , 2001 .

[16]  Taya Irizarry,et al.  Patient Portals and Patient Engagement: A State of the Science Review , 2015, Journal of medical Internet research.

[17]  Sarah A. Collins,et al.  Acute care patient portals: a qualitative study of stakeholder perspectives on current practices , 2017, J. Am. Medical Informatics Assoc..

[18]  Hsiu-Fang Hsieh,et al.  Three Approaches to Qualitative Content Analysis , 2005, Qualitative health research.

[19]  Oddbjørn Bukve,et al.  A qualitative study of contextual factors’ impact on measures to reduce surgery cancellations , 2014, BMC Health Services Research.

[20]  Suzanne Bakken,et al.  Review of health information technology usability study methodologies , 2011, J. Am. Medical Informatics Assoc..

[21]  James B. Jones,et al.  The Wired Patient: Patterns of Electronic Patient Portal Use Among Patients With Cardiac Disease or Diabetes , 2015, Journal of medical Internet research.

[22]  Ann Scheck McAlearney,et al.  High Touch and High Tech (HT2) Proposal: Transforming Patient Engagement Throughout the Continuum of Care by Engaging Patients with Portal Technology at the Bedside , 2016, JMIR research protocols.

[23]  Fred D. Davis,et al.  A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies , 2000, Management Science.

[24]  K. Lorig Outcome measures for health education and other health care interventions , 1996 .

[25]  Jennifer L. Hefner,et al.  The role of leadership in eliminating health care-associated infections: a qualitative study of eight hospitals. , 2013, Advances in health care management.

[26]  Patricia C. Dykes,et al.  An informatics research agenda to support patient and family empowerment and engagement in care and recovery during and after hospitalization , 2018, J. Am. Medical Informatics Assoc..

[27]  Steven K. Feiner,et al.  Engaging hospitalized patients in clinical care: Study protocol for a pragmatic randomized controlled trial. , 2016, Contemporary clinical trials.

[28]  Patricia C. Dykes,et al.  A web-based, patient-centered toolkit to engage patients and caregivers in the acute care setting: a preliminary evaluation , 2016, J. Am. Medical Informatics Assoc..

[29]  Dean F Sittig,et al.  Eight rights of safe electronic health record use. , 2009, JAMA.

[30]  A. Zaslavsky,et al.  The relationship between patients' perception of care and measures of hospital quality and safety. , 2010, Health services research.

[31]  Joseph Tan,et al.  Understanding Critical Barriers to Implementing a Clinical Information System in a Nursing Home Through the Lens of a Socio-Technical Perspective , 2014, Journal of Medical Systems.

[32]  Peter Hoonakker,et al.  Changes in end-user satisfaction with Computerized Provider Order Entry over time among nurses and providers in intensive care units , 2013, J. Am. Medical Informatics Assoc..

[33]  Shelagh A Mulvaney,et al.  Patient Web Portals to Improve Diabetes Outcomes: A Systematic Review , 2010, Current diabetes reports.

[34]  Patricia C. Dykes,et al.  Participatory Design and Development of a Patient-centered Toolkit to Engage Hospitalized Patients and Care Partners in their Plan of Care , 2014, AMIA.

[35]  P. Margolis,et al.  The Model for Understanding Success in Quality (MUSIQ): building a theory of context in healthcare quality improvement , 2011, BMJ quality & safety.

[36]  Alastair Baker,et al.  Crossing the Quality Chasm: A New Health System for the 21st Century , 2001, BMJ : British Medical Journal.

[37]  J. Hibbard,et al.  Development of the Patient Activation Measure (PAM): conceptualizing and measuring activation in patients and consumers. , 2004, Health services research.

[38]  Gretchen Purcell Jackson,et al.  Use of a Patient Portal During Hospital Admissions to Surgical Services , 2016, AMIA.

[39]  Christopher E. Johnson,et al.  Organizational capacity for change in health care: Development and validation of a scale , 2017, Health care management review.

[40]  David W. Bates,et al.  A Patient-Controlled Journal for an Electronic Medical Record: Issues and Challenges , 2004, MedInfo.

[41]  Gretchen Purcell Jackson,et al.  Health Literacy, Education Levels, and Patient Portal Usage During Hospitalizations , 2015, AMIA.