A theory-based meta-regression of factors influencing clinical decision support adoption and implementation

OBJECTIVE The purpose of the study was to explore the theoretical underpinnings of effective clinical decision support (CDS) factors using the comparative effectiveness results. MATERIALS AND METHODS We leveraged search results from a previous systematic literature review and updated the search to screen articles published from January 2017 to January 2020. We included randomized controlled trials and cluster randomized controlled trials that compared a CDS intervention with and without specific factors. We used random effects meta-regression procedures to analyze clinician behavior for the aggregate effects. The theoretical model was the Unified Theory of Acceptance and Use of Technology (UTAUT) model with motivational control. RESULTS Thirty-four studies were included. The meta-regression models identified the importance of effort expectancy (estimated coefficient = -0.162; P = .0003); facilitating conditions (estimated coefficient = 0.094; P = .013); and performance expectancy with motivational control (estimated coefficient = 1.029; P = .022). Each of these factors created a significant impact on clinician behavior. The meta-regression model with the multivariate analysis explained a large amount of the heterogeneity across studies (R2 = 88.32%). DISCUSSION Three positive factors were identified: low effort to use, low controllability, and providing more infrastructure and implementation strategies to support the CDS. The multivariate analysis suggests that passive CDS could be effective if users believe the CDS is useful and/or social expectations to use the CDS intervention exist. CONCLUSIONS Overall, a modified UTAUT model that includes motivational control is an appropriate model to understand psychological factors associated with CDS effectiveness and to guide CDS design, implementation, and optimization.

[1]  Linn Brandt,et al.  A systematic review of trials evaluating success factors of interventions with computerised clinical decision support , 2018, Implementation Science.

[2]  Kensaku Kawamoto,et al.  The perils of meta-regression to identify clinical decision support system success factors , 2015, J. Biomed. Informatics.

[3]  M. Johnston,et al.  From Theory to Intervention: Mapping Theoretically Derived Behavioural Determinants to Behaviour Change Techniques , 2008 .

[4]  Original Investigation.  Effect of Behavioral Interventions on Inappropriate Antibiotic Prescribing Among Primary Care Practices A Randomized Clinical Trial , 2016 .

[5]  L. Moja,et al.  Effectiveness of computerized decision support systems linked to electronic health records: a systematic review and meta-analysis. , 2014, American journal of public health.

[6]  Gillian D Sanders,et al.  Enabling health care decisionmaking through clinical decision support and knowledge management. , 2012, Evidence report/technology assessment.

[7]  Dean F. Sittig,et al.  Order sets in computerized physician order entry systems: an analysis of seven sites. , 2010, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[8]  Christian Lovis,et al.  Preparation and use of preconstructed orders, order sets, and order menus in a computerized provider order entry system. , 2003, Journal of the American Medical Informatics Association : JAMIA.

[9]  Dean F Sittig,et al.  Reducing warfarin medication interactions: an interrupted time series evaluation. , 2006, Archives of internal medicine.

[10]  Thomas J. Reese,et al.  Toward Optimized Clinical Decision Support: A Theory-Based Approach , 2020, 2020 IEEE International Conference on Healthcare Informatics (ICHI).

[11]  S. Michie,et al.  The behaviour change wheel: A new method for characterising and designing behaviour change interventions , 2011, Implementation science : IS.

[12]  M. Borenstein,et al.  Publication Bias in Meta-Analysis , 2006 .

[13]  C. M. Cullen,et al.  Template-guided versus undirected written medical documentation: a prospective, randomized trial in a family medicine residency clinic. , 2005, The Journal of the American Board of Family Practice.

[14]  Guilherme Del Fiol,et al.  A systematic review of theoretical constructs in CDS literature , 2021, BMC Medical Informatics and Decision Making.

[15]  Natalie S Blencowe,et al.  RoB 2: a revised tool for assessing risk of bias in randomised trials , 2019, BMJ.

[16]  D. Altman,et al.  Measuring inconsistency in meta-analyses , 2003, BMJ : British Medical Journal.

[17]  Monique W. M. Jaspers,et al.  Factors influencing implementation success of guideline-based clinical decision support systems: A systematic review and gaps analysis , 2017, Int. J. Medical Informatics.

[18]  E. Balas,et al.  Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success , 2005, BMJ : British Medical Journal.

[19]  R Brian Haynes,et al.  Features of effective computerised clinical decision support systems: meta-regression of 162 randomised trials , 2013, BMJ : British Medical Journal.

[20]  H. Bloomfield,et al.  A trial of education, prompts, and opinion leaders to improve prescription of lipid modifying therapy by primary care physicians for patients with ischemic heart disease , 2005, Quality and Safety in Health Care.

[21]  H. Sox.  Defining Comparative Effectiveness Research: The Importance of Getting It Right , 2010, Medical care.

[22]  Jeremy M. Grimshaw,et al.  A guide to using the Theoretical Domains Framework of behaviour change to investigate implementation problems , 2017, Implementation Science.

[23]  R. Platt,et al.  Computerized Prescribing Alerts and Group Academic Detailing to Reduce the Use of Potentially Inappropriate Medications in Older People , 2006, Journal of the American Geriatrics Society.

[24]  Paul Kolm,et al.  An intervention to overcome clinical inertia and improve diabetes mellitus control in a primary care setting: Improving Primary Care of African Americans with Diabetes (IPCAAD) 8. , 2006, Archives of internal medicine.

[25]  Adam Wright,et al.  White paper: A Roadmap for National Action on Clinical Decision Support , 2007, J. Am. Medical Informatics Assoc..

[26]  Shobha Phansalkar,et al.  Best Practices in Clinical Decision Support , 2010, Applied Clinical Informatics.

[27]  Cynthia A. Beck,et al.  Strategies for improving physician documentation in the emergency department: a systematic review , 2018, BMC Emergency Medicine.

[28]  Kensaku Kawamoto,et al.  Clinical Decision Support Provided within Physician Order Entry Systems: A Systematic Review of Features Effective for Changing Clinician Behavior , 2003, AMIA.

[29]  Anastasia Papazafeiropoulou,et al.  An evaluation framework for Health Information Systems: human, organization and technology-fit factors (HOT-fit) , 2008, Int. J. Medical Informatics.

[30]  J. Ioannidis,et al.  Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials , 2011, BMJ : British Medical Journal.

[31]  E. Fineout-Overholt,et al.  Teaching EBP: asking searchable, answerable clinical questions. , 2005, Worldviews on evidence-based nursing.

[32]  Mary K Goldstein,et al.  Patient education and provider decision support to control blood pressure in primary care: a cluster randomized trial. , 2009, American heart journal.

[33]  Erik Korsten,et al.  Physicians' responses to clinical decision support on an intensive care unit - Comparison of four different alerting methods , 2013, Artif. Intell. Medicine.

[34]  I. J. P. Howard.  Meta-Analysis withR , 2015 .

[35]  H. Mcdonald,et al.  Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. , 2005, JAMA.

[36]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[37]  Katharine E H Thomas,et al.  Electronic Heath Record Prompts May Increase Screening for Secondhand Smoke Exposure , 2018, Clinical pediatrics.

[38]  M. Johnston,et al.  Identifying active ingredients in complex behavioural interventions for obese adults with obesity-related co-morbidities or additional risk factors for co-morbidities: a systematic review , 2012 .

[39]  Guilherme Del Fiol,et al.  Towards an on-demand peer feedback system for a clinical knowledge base: A case study with order sets , 2008, J. Biomed. Informatics.

[40]  P. Shekelle,et al.  Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation , 2015, BMJ : British Medical Journal.

[41]  Ling Li,et al.  Feedback and Training to Improve Use of an Electronic Prescribing System: A Randomised Controlled Trial , 2017, HIC.

[42]  J. Franciosi,et al.  Promoting Adherence to Influenza Vaccination Recommendations in Pediatric Practice , 2019, Journal of primary care & community health.

[43]  P. Sandercock,et al.  Framework for design and evaluation of complex interventions to improve health , 2000, BMJ : British Medical Journal.

[44]  Keith J. Petrie,et al.  Patients and computers as reminders to screen for diabetes in family practice , 2005, Journal of General Internal Medicine.

[45]  D. Lavallee,et al.  Efficacy of physical activity interventions in post-natal populations: systematic review, meta-analysis and content coding of behaviour change techniques , 2015, Health psychology review.

[46]  J. Kirchner,et al.  A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project , 2015, Implementation Science.

[47]  Laura M. Curtis,et al.  A Multifaceted Intervention to Improve Patient Knowledge and Safe Use of Opioids: Results of the ED EMC2 Randomized Controlled Trial. , 2019, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.