Challenges of implementation and implementation research: Learning from an intervention study designed to improve tumor registry reporting

Objectives: Implementation of interventions designed to improve the quality of medical care often proceeds differently from what is planned. Improving existing conceptual models to better understand the sources of these differences can help future projects avoid these pitfalls and achieve desired effectiveness. To inform an adaptation of an existing theoretical model, we examined unanticipated changes that occurred in an intervention designed to improve reporting of adjuvant therapies for breast cancer patients at a large, urban academic medical center. Methods: Guided by the complex innovation implementation conceptual framework, our study team observed and evaluated the implementation of an intervention designed to improve reporting to a tumor registry. Findings were assessed against the conceptual framework to identify boundary conditions and modifications that could improve implementation effectiveness. Results: The intervention successfully increased identification of the managing medical oncologist and treatment reporting. During implementation, however, unexpected external challenges including hospital acquisitions of community practices and practices’ responses to government incentives to purchase electronic medical record systems led to unanticipated changes and associated threats to implementation. We present a revised conceptual model that incorporates the sources of these unanticipated challenges. Conclusion: This report of our experience highlights the importance of monitoring implementation over time and accounting for changes that affect both implementation and measurement of intervention impact. In this article, we use our study to examine the challenges of implementation research in health care, and our experience can help future implementation efforts.

[1]  R. Sanson-Fisher,et al.  Examining and addressing evidence-practice gaps in cancer care: a systematic review , 2014, Implementation Science.

[2]  Bryan J Weiner,et al.  Organizational readiness for implementing change: a psychometric assessment of a new measure , 2014, Implementation Science.

[3]  A. McAlearney,et al.  Understanding the Challenges of Adjuvant Treatment Measurement and Reporting in Breast Cancer: Cancer Treatment Measuring and Reporting , 2013, Medical care.

[4]  A. McAlearney,et al.  How to Improve Breast Cancer Care Measurement and Reporting: Suggestions from a Complex Urban Hospital , 2013, Journal of healthcare management / American College of Healthcare Executives.

[5]  A. McAlearney,et al.  New accountability, new challenges: improving treatment reporting to a tumor registry. , 2013, Journal of oncology practice.

[6]  Richard Baker,et al.  A checklist for identifying determinants of practice: A systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice , 2013, Implementation Science.

[7]  M. Chin,et al.  Improving the Effectiveness of Health Care Innovation Implementation , 2013, Medical care research and review : MCRR.

[8]  J. Grimshaw,et al.  Knowledge translation of research findings , 2012, Implementation Science.

[9]  Geoffrey M. Curran,et al.  Effectiveness-implementation Hybrid Designs: Combining Elements of Clinical Effectiveness and Implementation Research to Enhance Public Health Impact , 2012, Medical care.

[10]  Jeremy M Grimshaw,et al.  A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations , 2010, Implementation science : IS.

[11]  B. Weiner,et al.  Implementation Science a Theory of Organizational Readiness for Change , 2009 .

[12]  J. Lowery,et al.  Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science , 2009, Implementation science : IS.

[13]  B. Mittman,et al.  An organizational framework and strategic implementation for system-level change to enhance research-based practice: QUERI Series , 2008, Implementation science : IS.

[14]  Russell E Glasgow,et al.  A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. , 2008, Joint Commission journal on quality and patient safety.

[15]  J. Ploeg,et al.  Factors influencing best-practice guideline implementation: lessons learned from administrators, nursing staff, and project leaders. , 2007, Worldviews on evidence-based nursing.

[16]  J. Reschovsky,et al.  Effects of compensation methods and physician group structure on physicians' perceived incentives to alter services to patients. , 2006, Health services research.

[17]  Russell E. Glasgow,et al.  Evaluating the Relevance, Generalization, and Applicability of Research , 2006, Evaluation & the health professions.

[18]  Laura Kochevar,et al.  Models, strategies, and tools. Theory in implementing evidence-based findings into health care practice. , 2006, Journal of general internal medicine.

[19]  Geoffrey M. Curran,et al.  Lessons learned about implementing research evidence into clinical practice. Experiences from VA QUERI. , 2006 .

[20]  Candice Bowman,et al.  The role of formative evaluation in implementation research and the QUERI experience , 2006, Journal of General Internal Medicine.

[21]  Deborah Schrag,et al.  Annual report to the nation on the status of cancer, 1975-2002, featuring population-based trends in cancer treatment. , 2005, Journal of the National Cancer Institute.

[22]  R. Glasgow,et al.  Why don't we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. , 2003, American journal of public health.

[23]  Lisa M Klesges,et al.  Behavior change intervention research in healthcare settings: a review of recent reports with emphasis on external validity. , 2002, American journal of preventive medicine.

[24]  M. Chassin,et al.  Determining the Quality of Breast Cancer Care: Do Tumor Registries Measure Up? , 2000, Annals of Internal Medicine.

[25]  N. Hoffart Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory , 2000 .

[26]  M. Cabana,et al.  Why don't physicians follow clinical practice guidelines? A framework for improvement. , 1999, JAMA.

[27]  R. Glasgow,et al.  Evaluating the public health impact of health promotion interventions: the RE-AIM framework. , 1999, American journal of public health.

[28]  K. Klein,et al.  The Challenge of Innovation Implementation , 1996 .

[29]  Mark A. Constas,et al.  Qualitative Analysis as a Public Event: The Documentation of Category Development Procedures , 1992 .

[30]  M. Chin,et al.  From strategy to action: how top managers' support increases middle managers' commitment to innovation implementation in health care organizations. , 2015, Health care management review.

[31]  S. Flottorp,et al.  Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. , 2005, The Cochrane database of systematic reviews.