A Framework for Enhancing the Value of Research for Dissemination and Implementation.

A comprehensive guide that identifies critical evaluation and reporting elements necessary to move research into practice is needed. We propose a framework that highlights the domains required to enhance the value of dissemination and implementation research for end users. We emphasize the importance of transparent reporting on the planning phase of research in addition to delivery, evaluation, and long-term outcomes. We highlight key topics for which well-established reporting and assessment tools are underused (e.g., cost of intervention, implementation strategy, adoption) and where such tools are inadequate or lacking (e.g., context, sustainability, evolution) within the context of existing reporting guidelines. Consistent evaluation of and reporting on these issues with standardized approaches would enhance the value of research for practitioners and decision-makers.

[1]  G. Sanders,et al.  Cost-Effectiveness in Health and Medicine , 2016 .

[2]  Kathleen D. Vohs,et al.  Out of Control , 2015 .

[3]  W. Nilsen,et al.  Understanding the Context of Health for Persons With Multiple Chronic Conditions: Moving From What Is the Matter to What Matters , 2014, The Annals of Family Medicine.

[4]  J. Wyatt,et al.  Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide , 2014, BMJ : British Medical Journal.

[5]  Hilary Pinnock,et al.  Phase IV implementation studies. The forgotten finale to the complex intervention methodology framework. , 2014, Annals of the American Thoracic Society.

[6]  Enola K Proctor,et al.  Implementation strategies: recommendations for specifying and reporting , 2013, Implementation Science.

[7]  Omar Hasan,et al.  Doctors’ health: taking the lifecycle approach , 2013, BMJ.

[8]  Nhan Tran,et al.  Republished research: Implementation research: what it is and how to do it , 2013, British Journal of Sports Medicine.

[9]  K. McDonald Considering context in quality improvement interventions and implementation: concepts, frameworks, and application. , 2013, Academic pediatrics.

[10]  J. Grimshaw,et al.  Systematic reviews of complex interventions: framing the review question. , 2013, Journal of clinical epidemiology.

[11]  G. Meyer,et al.  Quality of reporting of complex healthcare interventions and applicability of the CReDECI list - a survey of publications indexed in PubMed , 2013, BMC Medical Research Methodology.

[12]  David A. Chambers,et al.  The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change , 2013, Implementation Science.

[13]  E. Mayo-Wilson,et al.  Protocol for CONSORT-SPI: an extension for social and psychological interventions , 2013, Implementation Science.

[14]  Ross C Brownson,et al.  Designing for dissemination among public health researchers: findings from a national survey in the United States. , 2013, American journal of public health.

[15]  Jason Rho,et al.  A decade of reversal: an analysis of 146 contradicted medical practices. , 2013, Mayo Clinic proceedings.

[16]  M. Hornbrook,et al.  A standardized relative resource cost model for medical care: application to cancer control programs. , 2013, Journal of the National Cancer Institute. Monographs.

[17]  L. Gilson,et al.  Actor interfaces and practices of power in a community health worker programme: a South African study of unintended policy outcomes. , 2013, Health policy and planning.

[18]  Shannon Wiltsey Stirman,et al.  Development of a framework and coding system for modifications and adaptations of evidence-based interventions , 2013, Implementation Science.

[19]  S. Scott,et al.  Development of a checklist to assess the quality of reporting of knowledge translation interventions using the Workgroup for Intervention Development and Evaluation Research (WIDER) recommendations , 2013, Implementation Science.

[20]  Amy P Abernethy,et al.  Rapid, responsive, relevant (R3) research: a call for a rapid learning health research enterprise , 2013, Clinical and Translational Medicine.

[21]  R. Glasgow,et al.  The RE-AIM framework: a systematic review of use over time. , 2013, American journal of public health.

[22]  Diane Hauser,et al.  Context Matters: The Experience of 14 Research Teams in Systematically Reporting Contextual Factors Important for Practice Change , 2013, The Annals of Family Medicine.

[23]  P. Donnan,et al.  Making clinical trials more relevant: improving and validating the PRECIS tool for matching trial design decisions to trial purpose , 2013, Trials.

[24]  J. Selby,et al.  The patient-centered outcomes research institute: a 2013 agenda for "research done differently". , 2013, Population health management.

[25]  M. Drummond,et al.  Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement , 2013, International Journal of Technology Assessment in Health Care.

[26]  Lisa M Klesges,et al.  What Does It Mean to “Employ” the RE-AIM Model? , 2013, Evaluation & the health professions.

[27]  C. Yancy,et al.  How the Patient-Centered Outcomes Research Institute is engaging patients and others in shaping its research agenda. , 2013, Health affairs.

[28]  David Moher,et al.  PRISMA-Equity 2012 Extension: Reporting Guidelines for Systematic Reviews with a Focus on Health Equity , 2012, PLoS medicine.

[29]  H. Krumholz,et al.  Seeing Through the Eyes of Patients: The Patient-Centered Outcomes Research Institute Funding Announcements , 2012, Annals of Internal Medicine.

[30]  G. Piaggio,et al.  Consort 2010 statement: extension to cluster randomised trials , 2012, BMJ : British Medical Journal.

[31]  David A Chambers,et al.  Bridging research and practice: models for dissemination and implementation research. , 2012, American journal of preventive medicine.

[32]  M. Naylor,et al.  Unintended consequences of steps to cut readmissions and reform payment may threaten care of vulnerable older adults. , 2012, Health affairs.

[33]  David A. Chambers,et al.  National Institutes of Health approaches to dissemination and implementation science: current and future directions. , 2012, American journal of public health.

[34]  Karen M. Emmons,et al.  Fidelity and its relationship to implementation effectiveness, adaptation, and dissemination , 2012 .

[35]  R. Glasgow,et al.  State-of-the-art and future directions in multilevel interventions across the cancer control continuum. , 2012, Journal of the National Cancer Institute. Monographs.

[36]  J. Grimshaw,et al.  Developing theory-informed behaviour change interventions to implement evidence into practice: a systematic approach using the Theoretical Domains Framework , 2012, Implementation Science.

[37]  Anne C. Beal,et al.  The Patient-Centered Outcomes Research Institute (PCORI) national priorities for research and initial research agenda. , 2012, JAMA.

[38]  Bryan Hartzler,et al.  Contingency management in substance abuse treatment: a structured review of the evidence for its transportability. , 2012, Drug and alcohol dependence.

[39]  Jon B. Christianson,et al.  Unintended Consequences of Implementing a National Performance Measurement System into Local Practice , 2012, Journal of General Internal Medicine.

[40]  Ross C. Brownson,et al.  Dissemination and implementation research in health : translating science to practice , 2012 .

[41]  Vicki L. Plano Clark,et al.  Best practices in mixed methods for quality of life research , 2012, Quality of Life Research.

[42]  David A. Chambers,et al.  Developing Robust, Sustainable, Implementation Systems Using Rigorous, Rapid and Relevant Science , 2012, Clinical and translational science.

[43]  David Moher,et al.  From QUOROM to PRISMA: A Survey of High-Impact Medical Journals' Instructions to Authors and a Review of Systematic Reviews in Anesthesia Literature , 2011, PloS one.

[44]  M. A. Scheirer,et al.  An agenda for research on the sustainability of public health programs. , 2011, American journal of public health.

[45]  Bryan J Weiner,et al.  The meaning and measurement of implementation climate , 2011, Implementation science : IS.

[46]  M. Petticrew,et al.  Disseminating research findings: what should researchers do? A systematic scoping review of conceptual frameworks , 2010, Implementation science : IS.

[47]  Sandra A Mitchell,et al.  A thematic analysis of theoretical models for translational science in nursing: mapping the field. , 2010, Nursing outlook.

[48]  Alicia C. Bunger,et al.  Outcomes for Implementation Research: Conceptual Distinctions, Measurement Challenges, and Research Agenda , 2010, Administration and Policy in Mental Health and Mental Health Services Research.

[49]  K. Hoagwood,et al.  Treatment research for children and youth exposed to traumatic events: moving beyond efficacy to amp up public health impact. , 2010, General hospital psychiatry.

[50]  John P. A. Ioannidis,et al.  American Journal of Epidemiology Commentary the Emergence of Translational Epidemiology: from Scientific Discovery to Population Health Impact , 2022 .

[51]  F. Collins,et al.  The path to personalized medicine. , 2010, The New England journal of medicine.

[52]  D. Moher,et al.  Transparent and accurate reporting increases reliability, utility, and impact of your research: reporting guidelines and the EQUATOR Network , 2010, BMC medicine.

[53]  Debra Rog,et al.  Evaluability assessment to improve public health policies, programs, and practices. , 2010, Annual review of public health.

[54]  D. Moher,et al.  CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials , 2010, Journal of pharmacology & pharmacotherapeutics.

[55]  J. Bernstein,et al.  A preliminary report of knowledge translation: lessons from taking screening and brief intervention techniques from the research setting into regional systems of care. , 2009, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[56]  Susan Michie,et al.  Specifying and reporting complex behaviour change interventions: the need for a scientific method , 2009, Implementation science : IS.

[57]  C. Furberg,et al.  A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers. , 2009, Journal of clinical epidemiology.

[58]  R. Glasgow,et al.  Costing Behavioral Interventions: A Practical Guide to Enhance Translation , 2009, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[59]  Trisha Greenhalgh,et al.  Role of routines in collaborative work in healthcare organisations , 2008, BMJ : British Medical Journal.

[60]  D. Moher,et al.  Improving the reporting of pragmatic trials: an extension of the CONSORT statement , 2008, BMJ : British Medical Journal.

[61]  Greg Ogrinc,et al.  Publication guidelines for improvement studies in health care: evolution of the SQUIRE Project. , 2008, Annals of internal medicine.

[62]  S. Henggeler,et al.  Statewide adoption and initial implementation of contingency management for substance-abusing adolescents. , 2008, Journal of consulting and clinical psychology.

[63]  Trish Groves,et al.  Enhancing the quality and transparency of health research , 2008, BMJ : British Medical Journal.

[64]  Iveta Simera,et al.  Helping editors, peer reviewers and authors improve the clarity, completeness and transparency of reporting health research , 2008, BMC medicine.

[65]  J. Kaiser Departing U.S. Genome Institute Director Takes Stock of Personalized Medicine , 2008, Science.

[66]  N. Haug,et al.  Adoption of Evidence-Based Practices among Substance Abuse Treatment Providers , 2008, Journal of drug education.

[67]  Iveta Simera,et al.  EQUATOR: reporting guidelines for health research , 2008, Open medicine : a peer-reviewed, independent, open-access journal.

[68]  Ross C Brownson,et al.  A glossary for dissemination and implementation research in health. , 2008, Journal of public health management and practice : JPHMP.

[69]  David Moher,et al.  Methods and processes of the CONSORT Group: example of an extension for trials assessing nonpharmacologic treatments. , 2008, Annals of internal medicine.

[70]  Matthias Egger,et al.  The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: Guidelines for Reporting Observational Studies , 2007, PLoS medicine.

[71]  K. Emmons,et al.  How can we increase translation of research into practice? Types of evidence needed. , 2007, Annual review of public health.

[72]  S. Eckenrode,et al.  The application of genomic and proteomic technologies in predictive, preventive and personalized medicine. , 2006, Vascular pharmacology.

[73]  Thomas M Vogt,et al.  Evaluating the impact of health promotion programs: using the RE-AIM framework to form summary measures for decision making involving complex issues. , 2006, Health education research.

[74]  Russell E. Glasgow,et al.  External validity: We need to do more , 2006 .

[75]  S. Pocock,et al.  Reporting of noninferiority and equivalence randomized trials: extension of the CONSORT 2010 statement. , 2006, JAMA.

[76]  David Moher,et al.  Reporting Randomized, Controlled Trials of Herbal Interventions: An Elaborated CONSORT Statement , 2006, Annals of Internal Medicine.

[77]  Maria E. Fernandez,et al.  Planning Health Promotion Programs: An Intervention Mapping Approach , 2006 .

[78]  Russell E. Glasgow,et al.  Evaluating the Relevance, Generalization, and Applicability of Research , 2006, Evaluation & the health professions.

[79]  Laura Kochevar,et al.  Models, strategies, and tools. Theory in implementing evidence-based findings into health care practice. , 2006, Journal of general internal medicine.

[80]  J. Ioannidis,et al.  Why Most Published Research Findings Are False , 2005, PLoS medicine.

[81]  T. Greenhalgh,et al.  Realist review - a new method of systematic review designed for complex policy interventions , 2005, Journal of health services research & policy.

[82]  S. Bull,et al.  Beginning with the application in mind: Designing and planning health behavior change interventions to enhance dissemination , 2005, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[83]  P. Rothwell External validity of randomised controlled trials: “To whom do the results of this trial apply?” , 2005, The Lancet.

[84]  J. Ioannidis,et al.  Better Reporting of Harms in Randomized Trials: An Extension of the CONSORT Statement , 2004, Annals of Internal Medicine.

[85]  Barbara Resnick,et al.  Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH Behavior Change Consortium. , 2004, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[86]  Alan Shiell,et al.  Complex interventions: how “out of control” can a randomised controlled trial be? , 2004, BMJ : British Medical Journal.

[87]  S. Schoenwald,et al.  Transportability of Multisystemic Therapy: Evidence for Multilevel Influences , 2003, Mental health services research.

[88]  David Moher,et al.  The STARD Statement for Reporting Studies of Diagnostic Accuracy: Explanation and Elaboration , 2003, Annals of Internal Medicine [serial online].

[89]  D. Stokols,et al.  Social Ecology and Behavioral Medicine: Implications for Training, Practice, and Policy , 2000, Behavioral medicine.

[90]  J. Mckinlay Paradigmatic obstacles to improving the health of populations--implications for health policy. , 1998, Salud publica de Mexico.

[91]  J Lomas,et al.  Diffusion, Dissemination, and Implementation: Who Should Do What? , 1993, Annals of the New York Academy of Sciences.

[92]  G. Recchia,et al.  Quality of life measurement. , 1993, Monaldi archives for chest disease = Archivio Monaldi per le malattie del torace.

[93]  P. Karoly Measurement Strategies in Health Psychology , 1991 .

[94]  K. Glanz,et al.  An Ecological Perspective on Health Promotion Programs , 1988, Health education quarterly.

[95]  V. Bykerk,et al.  Consensus Statement , 2004, Pediatric Clinical Practice Guidelines & Policies.

[96]  D. Moher,et al.  The CARE guidelines: consensus-based clinical case report guideline development. , 2014, Journal of clinical epidemiology.

[97]  William C. Klein,et al.  More Is Not Always Better: Intuitions About Effective Public Policy Can Lead to Unintended Consequences. , 2013, Social issues and policy review.

[98]  黄亚明(整理),et al.  Equator network , 2012 .

[99]  Általános társadalom tudományok,et al.  Diffusion of Innovations , 2011 .

[100]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. , 2009, Journal of clinical epidemiology.

[101]  R. Kaplan,et al.  Health-Related Quality of Life Measurement for Evaluation Research and Policy Analysis , 1982 .

[102]  Saleh As-Saleh What Does It Mean? , 1907, California state journal of medicine.

[103]  A. Siriwardena Title: Normalization Process Theory: a Framework for Developing, Evaluating and Implementing Complex Interventions , 2022 .