The effects of interoperable information technology networks on patient safety: a realist synthesis

Interoperable networks connect information technology systems of different organisations, allowing professionals in one organisation to access patient data held in another one. Health policy-makers in many countries believe that they will improve the co-ordination of services and, hence, the quality of services and patient safety. To the best of our knowledge, there have not been any previous systematic reviews of the effects of these networks on patient safety. The aim of the study was to establish how, why and in what circumstances interoperable information technology networks improved patient safety, failed to do so or increased safety risks. The objectives of the study were to (1) identify programme theories and prioritise theories to review; (2) search systematically for evidence to test the theories; (3) undertake quality appraisal, and use included texts to support, refine or reject programme theories; (4) synthesise the findings; and (5) disseminate the findings to a range of audiences. Realist synthesis, including consultation with stakeholders in nominal groups and semistructured interviews. Following a stakeholder prioritisation process, several domains were reviewed: older people living at home requiring co-ordinated care, at-risk children living at home and medicines reconciliation services for any patients living at home. The effects of networks on services in health economies were also investigated. An interoperable network that linked at least two organisations, including a maximum of one hospital, in a city or region. Increase, reduction or no change in patients’ risks, such as a change in the risk of taking an inappropriate medication. We did not find any detailed accounts of the ways in which interoperable networks are intended to work and improve patient safety. Theory fragments were identified and used to develop programme and mid-range theories. There is good evidence that there are problems with the co-ordination of services in each of the domains studied. The implicit hypothesis about interoperable networks is that they help to solve co-ordination problems, but evidence across the domains showed that professionals found interoperable networks difficult to use. There is insufficient evidence about the effectiveness of interoperable networks to allow us to establish how and why they affect patient safety. The lack of evidence about patient-specific measures of effectiveness meant that we were not able to determine ‘what works’, nor any variations in what works, when interoperable networks are deployed and used by health and social care professionals. There is a dearth of evidence about the effects of interoperable networks on patient safety. It is not clear if the networks are associated with safer treatment and care, have no effects or increase clinical risks. Possible future research includes primary studies of the effectiveness of interoperable networks, of economies of scope and scale and, more generally, on the value of information infrastructures. This study is registered as PROSPERO CRD42017073004. This project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full in Health Services and Delivery Research; Vol. 8, No. 40. See the NIHR Journals Library website for further project information.

[1]  Simon Briscoe,et al.  The “realist search”: A systematic scoping review of current practice and reporting , 2019, Research synthesis methods.

[2]  J. Herbert,et al.  Better Together? A Review of Evidence for Multi-Disciplinary Teams Responding to Physical and Sexual Child Abuse , 2019, Trauma, violence & abuse.

[3]  H. Davies,et al.  Understanding organisational culture for healthcare quality improvement , 2018, British Medical Journal.

[4]  Christopher A. Harle,et al.  The benefits of health information exchange: an updated systematic review , 2018, J. Am. Medical Informatics Assoc..

[5]  G. Rait,et al.  Supporting shared decision making for older people with multiple health and social care needs: a realist synthesis , 2018, BMC Geriatrics.

[6]  Hossein Ahmadi,et al.  The impact of health information exchange on healthcare quality and cost-effectiveness: A systematic literature review , 2018, Comput. Methods Programs Biomed..

[7]  B. Melton,et al.  Integrating a health information exchange into a community pharmacy transitions of care service. , 2018, Journal of the American Pharmacists Association : JAPhA.

[8]  K. Brittain,et al.  Care home services at the vanguard: a qualitative study exploring stakeholder views on the development and evaluation of novel, integrated approaches to enhancing healthcare in care homes , 2018, BMJ Open.

[9]  C. Humphreys,et al.  Facilitating the Collaborative Interface between Child Protection and Specialist Domestic Violence Services: A Scoping Review , 2018 .

[10]  H. Petersen,et al.  Nurses’ perspectives on how an e‐message system supports cross‐sectoral communication in relation to medication administration: A qualitative study , 2018, Journal of clinical nursing.

[11]  Carolin Auschra,et al.  Barriers to the Integration of Care in Inter-Organisational Settings: A Literature Review , 2018, International journal of integrated care.

[12]  N. Black,et al.  How do aggregated patient-reported outcome measures data stimulate health care improvement? A realist synthesis , 2017, Journal of health services research & policy.

[13]  Susan S. Woods,et al.  Health Information Exchange Use (1990-2015): A Systematic Review , 2017, EGEMS.

[14]  Denise Cloutier,et al.  From home to 'home': Mapping the caregiver journey in the transition from home care into residential care. , 2017, Journal of aging studies.

[15]  P. Allmark,et al.  Building Realist Program Theory for Large Complex and Messy Interventions , 2017 .

[16]  Trisha Greenhalgh,et al.  Beyond Adoption: A New Framework for Theorizing and Evaluating Nonadoption, Abandonment, and Challenges to the Scale-Up, Spread, and Sustainability of Health and Care Technologies , 2017, Journal of medical Internet research.

[17]  M. Powell,et al.  The governance of integrated health and social care in England since 2010: great expectations not met once again? , 2017, Health policy.

[18]  Richard I. Cook,et al.  Medication Reconciliation Is a Window into “Ordinary” Work , 2017 .

[19]  Enrico W. Coiera,et al.  The role and benefits of accessing primary care patient records during unscheduled care: a systematic review , 2017, BMC Medical Informatics and Decision Making.

[20]  K. Noonan,et al.  Information sharing between the child welfare and behavioral health systems: Perspectives from four stakeholder groups , 2017 .

[21]  M. Chisholm-Burns,et al.  Implementation of a health information exchange into community pharmacy workflow. , 2017, Journal of the American Pharmacists Association : JAPhA.

[22]  Thais Abreu Maia,et al.  Is There Evidence of Cost Benefits of Electronic Medical Records, Standards, or Interoperability in Hospital Information Systems? Overview of Systematic Reviews , 2017, JMIR medical informatics.

[23]  G. Baker,et al.  What works in implementation of integrated care programs for older adults with complex needs? A realist review , 2017, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[24]  G. Wong,et al.  Towards an understanding of how appraisal of doctors produces its effects: a realist review , 2017, Medical education.

[25]  S. Espin,et al.  Elucidating the information exchange during interfacility care transitions: Insights from a Qualitative Study , 2017, BMJ Open.

[26]  P. Chau,et al.  Integrated care for older populations and its implementation facilitators and barriers: A rapid scoping review , 2017, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[27]  Morgane Plantier,et al.  Does adoption of electronic health records improve the quality of care management in France? Results from the French e-SI (PREPS-SIPS) study , 2017, Int. J. Medical Informatics.

[28]  Pia Petersson,et al.  Complex caring needs without simple solutions: the experience of interprofessional collaboration among staff caring for older persons with multimorbidity at home care settings , 2017, Scandinavian journal of caring sciences.

[29]  A. Lees Facts with feelings – social workers' experiences of sharing information across team and agency borders to safeguard children , 2017 .

[30]  S. Espin,et al.  Identifying Effective Nurse‐Led Care Transition Interventions for Older Adults With Complex Needs Using a Structured Expert Panel , 2017, Worldviews on evidence-based nursing.

[31]  Johnanna Hernandez Medication management in the older adult: A narrative exploration , 2017, Journal of the American Association of Nurse Practitioners.

[32]  N. Stanley,et al.  Juggling confidentiality and safety: a qualitative study of how general practice clinicians document domestic violence in families with children , 2017, The British journal of general practice : the journal of the Royal College of General Practitioners.

[33]  Ray Pawson,et al.  Functionality and feedback: a realist synthesis of the collation, interpretation and utilisation of patient-reported outcome measures data to improve patient care , 2017 .

[34]  A. Hutchinson,et al.  User Experience and Care Integration in Transitional Care for Older People From Hospital to Home , 2017, Qualitative health research.

[35]  G. Baker,et al.  Navigating the Challenges of Building Integrated Care Models: Findings from the iCoach Project , 2016 .

[36]  Pieter Fourie,et al.  Power and Integrated Health Care: Shifting from Governance to Governmentality , 2016, International journal of integrated care.

[37]  M. Gold,et al.  Assessing HITECH Implementation and Lessons: 5 Years Later. , 2016, The Milbank quarterly.

[38]  Rainu Kaushal,et al.  Effects of health information technology on patient outcomes: a systematic review , 2016, J. Am. Medical Informatics Assoc..

[39]  Y. Parmet,et al.  The Cognitive Task of Medication Reconciliation - Clinicians’ Approaches to the Arrangement of Medical Condition and Medication History Information , 2016 .

[40]  J. Abraham,et al.  A Survey of the Literature on Unintended Consequences Associated with Health Information Technology: 2014–2015 , 2016, Yearbook of Medical Informatics.

[41]  P. Rogers,et al.  Using realist action research for service redesign , 2016 .

[42]  J. Escarrabill,et al.  Integrated Health Care Barcelona Esquerra (Ais-Be): A Global View of Organisational Development, Re-Engineering of Processes and Improvement of the Information Systems. The Role of the Tertiary University Hospital in the Transformation , 2016, International journal of integrated care.

[43]  M. Giacomini,et al.  Finding Qualitative Research Evidence for Health Technology Assessment , 2016, Qualitative health research.

[44]  Rema Padman,et al.  The Impact of Privacy Regulation and Technology Incentives: The Case of Health Information Exchanges , 2016, Manag. Sci..

[45]  Paul N. Gorman,et al.  Barriers and facilitators to exchanging health information: a systematic review , 2016, Int. J. Medical Informatics.

[46]  Robin Williams Why is it difficult to achieve e-health systems at scale? , 2016 .

[47]  Susan S. Woods,et al.  Outcomes From Health Information Exchange: Systematic Review and Future Research Needs , 2015, JMIR medical informatics.

[48]  Elinam D Dellor,et al.  Introducing Technology in Child Welfare Referrals: A Case Study , 2015, Journal of technology in human services.

[49]  E. Mehuys,et al.  Potentially inappropriate prescribing in community-dwelling older people across Europe: a systematic literature review , 2015, European Journal of Clinical Pharmacology.

[50]  J. Jacob On the Road to Interoperability, Public and Private Organizations Work to Connect Health Care Data. , 2015, JAMA.

[51]  A Hoerbst,et al.  A Systematic Investigation on Barriers and Critical Success Factors for Clinical Information Systems in Integrated Care Settings , 2015, Yearbook of Medical Informatics.

[52]  M. Wise,et al.  Barriers and facilitators of medication reconciliation processes for recently discharged patients from community pharmacists' perspectives. , 2015, Research in social & administrative pharmacy : RSAP.

[53]  D W Bates,et al.  Health Information Technology and Care Coordination: The Next Big Opportunity for Informatics? , 2015, Yearbook of medical informatics.

[54]  Aksel Tjora,et al.  Survival of the project: a case study of ICT innovation in health care. , 2015, Social science & medicine.

[55]  D. Bates,et al.  Task analysis of information technology-mediated medication management in outpatient care , 2015, British journal of clinical pharmacology.

[56]  Huixin Wu,et al.  Barriers and Facilitators of Health Information Exchange (HIE) Adoption in the United States , 2015, 2015 48th Hawaii International Conference on System Sciences.

[57]  Paul G Shekelle,et al.  Usage and Effect of Health Information Exchange , 2014, Annals of Internal Medicine.

[58]  Anthony J. Schueth,et al.  The impact of information technology on managed care pharmacy: today and tomorrow. , 2014, Journal of managed care & specialty pharmacy.

[59]  William W. Stead,et al.  Toward a science of learning systems: a research agenda for the high-functioning Learning Health System , 2014, J. Am. Medical Informatics Assoc..

[60]  Anita Kothari,et al.  Using realist evaluation to open the black box of knowledge translation: a state-of-the-art review , 2014, Implementation Science.

[61]  Pierre Pluye,et al.  Critical reflections on realist review: insights from customizing the methodology to the needs of participatory research assessment , 2014, Research synthesis methods.

[62]  Tony R. Sahama,et al.  Barriers to Implementing eHealth: A Multi-dimensional Perspective , 2014, MIE.

[63]  L. Comer,et al.  Transitions in a wicked environment. , 2014, Journal of nursing management.

[64]  Spencer S. Jones,et al.  Health Information Technology: An Updated Systematic Review With a Focus on Meaningful Use , 2014, Annals of Internal Medicine.

[65]  Doug Smith,et al.  Using Electronic Health Records and Data Warehouse Collaboratively in Community Health Centers , 2013, J. Cases Inf. Technol..

[66]  Andrew Booth,et al.  Towards a methodology for cluster searching to provide conceptual and contextual “richness” for systematic reviews of complex interventions: case study (CLUSTER) , 2013, BMC Medical Research Methodology.

[67]  Paul Stolee,et al.  ‘Trying to find information is like hating yourself every day’: The collision of electronic information systems in transition with patients in transition , 2013, Health Informatics J..

[68]  C. Godfrey,et al.  Homecare safety and medication management with older adults: a scoping review of the quantitative and qualitative evidence , 2013 .

[69]  G. Fitzpatrick,et al.  A Review of 25 Years of CSCW Research in Healthcare: Contributions, Challenges and Future Agendas , 2013, Computer Supported Cooperative Work (CSCW).

[70]  J. Haughney,et al.  Views of healthcare professionals to linkage of routinely collected healthcare data: a systematic literature review , 2013, Journal of the American Medical Informatics Association : JAMIA.

[71]  P. Rosset,et al.  Communication between community and hospital pharmacists: impact on medication reconciliation at admission , 2013, International Journal of Clinical Pharmacy.

[72]  Kellie Thompson Multi‐agency information practices in children's services: the metaphorical ‘jigsaw’ and professionals quest for a ‘full’ picture , 2013 .

[73]  David W. Bates,et al.  National efforts to improve health information system safety in Canada, the United States of America and England , 2013, Int. J. Medical Informatics.

[74]  Kaveh G Shojania,et al.  Trends in adverse events over time: why are we not improving? , 2013, BMJ quality & safety.

[75]  Ray Pawson,et al.  The Science of Evaluation: A Realist Manifesto , 2013 .

[76]  Michael F. O'Connor,et al.  How do clinicians reconcile conditions and medications? The cognitive context of medication reconciliation , 2013, Cognition, Technology & Work.

[77]  Ray Pawson,et al.  RAMESES publication standards: meta-narrative reviews , 2013, BMC Medicine.

[78]  David Heaney,et al.  Boundaries and e-health implementation in health and social care , 2012, BMC Medical Informatics and Decision Making.

[79]  Trisha Greenhalgh,et al.  Large-system transformation in health care: a realist review. , 2012, The Milbank quarterly.

[80]  D. Bates,et al.  National patient safety initiatives: Moving beyond what is necessary , 2012, Israel Journal of Health Policy Research.

[81]  Olavo Fernandes and Kaveh G. Shojania Medication Reconciliation in the Hospital: What, Why, Where, When, Who and How? , 2012 .

[82]  K. Traynor Solid data lacking on HIT and patient safety. , 2012, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[83]  Joshua R. Vest,et al.  Use of a health information exchange system in the emergency care of children , 2011, BMC Medical Informatics Decis. Mak..

[84]  G. Wong,et al.  Known Knowns, Known Unknowns, Unknown Unknowns , 2011 .

[85]  Trisha Greenhalgh,et al.  Protocol - realist and meta-narrative evidence synthesis: Evolving Standards (RAMESES) , 2011, BMC medical research methodology.

[86]  Yisrael Parmet,et al.  Making sense of diseases in medication reconciliation , 2011, Cognition, Technology & Work.

[87]  Carol A. Keohane,et al.  Addition of electronic prescription transmission to computerized prescriber order entry: Effect on dispensing errors in community pharmacies. , 2011, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[88]  C. Anandan,et al.  The Impact of eHealth on the Quality and Safety of Health Care: A Systematic Overview , 2011, PLoS medicine.

[89]  Eta S Berner,et al.  Physician opinions of the importance, accessibility, and quality of health information and their use of the information. , 2010, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[90]  Aziz Sheikh,et al.  Information technology for patient safety , 2010, Quality and Safety in Health Care.

[91]  J. Keen Integration at Any Price , 2010 .

[92]  F. Lau,et al.  Use of Information Technology in Medication Reconciliation: A Scoping Review , 2010, The Annals of pharmacotherapy.

[93]  J. Kralewski,et al.  Health information exchange: participation by Minnesota primary care practices. , 2010, Archives of Internal Medicine.

[94]  D. Moher,et al.  Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement , 2009, BMJ : British Medical Journal.

[95]  A. Lazenbatt,et al.  Information sharing and reporting systems in the UK and Ireland: Professional barriers to reporting child maltreatment concerns , 2009 .

[96]  C. Dowrick,et al.  Implementation Science Development of a Theory of Implementation and Integration: Normalization Process Theory , 2022 .

[97]  Isabella Scandurra,et al.  Organizational effects of information and communication technology (ICT) in elderly homecare: a case study , 2008, Health Informatics J..

[98]  Robin Williams,et al.  Software and Organisations: The Biography of the Enterprise-Wide System or How SAP Conquered the World , 2008 .

[99]  David W. Bates,et al.  Health information exchange and patient safety , 2007, J. Biomed. Informatics.

[100]  Shinji Mase,et al.  The guideline of the personal health data structure to secure safety healthcare: The balance between use and protection to satisfy the patients' needs , 2007, Int. J. Medical Informatics.

[101]  Carole M Cotter Making the case for a clinical information system: the chief information officer view. , 2007, Journal of critical care.

[102]  Alan Hassey,et al.  To opt in or opt out of electronic patient records?: Isle of Wight and Scottish projects are not opt out schemes , 2006, BMJ : British Medical Journal.

[103]  Michael Foley To opt in or opt out of electronic patient records?: Electronic patient record is incompatible with confidentiality , 2006, BMJ : British Medical Journal.

[104]  D. Stone,et al.  Regulatory and policy barriers to effective clinical data exchange: lessons learned from MedsInfo-ED. , 2005, Health affairs.

[105]  R. Alvarez,et al.  The electronic health record: a leap forward in patient safety. , 2004, HealthcarePapers.

[106]  Marc Berg,et al.  Viewpoint Paper: Some Unintended Consequences of Information Technology in Health Care: The Nature of Patient Care Information System-related Errors , 2003, J. Am. Medical Informatics Assoc..

[107]  D. Bates,et al.  Improving safety with information technology. , 2003, The New England journal of medicine.

[108]  G. Teasdale Learning from Bristol: report of the public inquiry into children's heart surgery at Bristol Royal Infirmary 1984-1995 , 2002, British journal of neurosurgery.

[109]  Stephen E. Margolis,et al.  Network externality : an uncommon tragedy , 1994 .

[110]  Diane L. Seger,et al.  Clinical reasoning in the context of active decision support during medication prescribing , 2017, Int. J. Medical Informatics.

[111]  Anne Spinewine,et al.  Electronic tools to support medication reconciliation: a systematic review , 2017, J. Am. Medical Informatics Assoc..

[112]  René Amalberti,et al.  Safer Healthcare , 2016, Springer International Publishing.

[113]  Craig E. Kuziemsky,et al.  A Review of Cross Organizational Healthcare Data Sharing , 2015, EUSPN/ICTH.

[114]  Bernd Blobel,et al.  Policy Management Standards Enabling Trustworthy pHealth. , 2014, Studies in health technology and informatics.

[115]  Arthur L Kellermann,et al.  What it will take to achieve the as-yet-unfulfilled promises of health information technology. , 2013, Health affairs.

[116]  Electronic tools for health information exchange: an evidence-based analysis. , 2013, Ontario health technology assessment series.

[117]  Ken Eason,et al.  Using HIT to deliver integrated care for the frail elderly in the UK: current barriers and future challenges. , 2012, Work.

[118]  D. Bates,et al.  What Affects Clinicians’ Usage of Health Information Exchange? , 2011, Applied Clinical Informatics.

[119]  Werner Ceusters,et al.  ARGOS policy brief on semantic interoperability. , 2011, Studies in health technology and informatics.

[120]  Steven R. Simon,et al.  Case Report: Community-wide Implementation of Health Information Technology: The Massachusetts eHealth Collaborative Experience , 2009, J. Am. Medical Informatics Assoc..

[121]  Mary Hawking,et al.  The Single Shared Electronic Patient Record (SSEPR): problems with functionality and governance. , 2008, Informatics in primary care.

[122]  K. Hutchinson Economics, errors, and emergencies: the case for e-prescribing and "pharmacy interoperability". , 2007, MedGenMed : Medscape general medicine.

[123]  Ray Pawson,et al.  Evidence-based policy: a realist perspective. , 2006 .