Criteria for evaluating transferability of health interventions: a systematic review and thematic synthesis

BackgroundImproving the public’s health in different countries requires the consideration of diverse health care systems and settings. For evidence-based public health, decision-makers need to consider the transferability of effective health interventions from a primary context to their specific target context. The aim of this systematic review was to develop a model for the assessment of transferability of health interventions through identification and systematization of influencing criteria, including facilitators and barriers.MethodsA systematic literature search was performed in the databases PubMed, Embase, CINAHL, and PsycINFO. Articles were eligible if they were published in English or German and provided a description of transferability criteria. Included articles were ranked based on their thematic relevance and methodological support of transferability criteria. Using a qualitative approach, a thematic synthesis was conducted.ResultsThirty-seven articles were included in the review. The thematic synthesis revealed 44 criteria, covered by 4 overarching themes, which influence transferability of health interventions: The population (P), the intervention (I), and the environment (E) represent 30 conditional transferability criteria, and the transfer of the intervention (T) represents 14 process criteria for transferring the intervention to the target context. Transferability (-T) depends on the dynamic interaction of conditional criteria in the primary and target context as well as on the process of transfer. The description of facilitators and barriers deepens the understanding of the criteria. The synthesis resulted in two related models: the conceptual PIET-T model explains the underlying mechanism of transferability of health interventions and the PIET-T process model provides practical guidance for a transferability assessment.ConclusionsTransferability of health interventions is a complex concept, which needs systematic consideration of the primary and target context. It should be anticipated before and evaluated after an intervention is implemented in the target context. Therefore, decision-makers need systematic and practically relevant knowledge on transferability. The synthesized PIET-T conceptual and process models with systematized criteria, facilitators, and barriers are intended as a theoretical basis to determine transferability of health interventions. Further research is needed to develop a practical tool for the PIET-T models and to evaluate the tool’s usefulness for decision-making processes and intervention transfer.

[1]  M. Petticrew,et al.  Developing and evaluating complex interventions: the new Medical Research Council guidance , 2008, BMJ : British Medical Journal.

[2]  Paul Glasziou,et al.  Better duplicate detection for systematic reviewers: evaluation of Systematic Review Assistant-Deduplication Module , 2015, Systematic Reviews.

[3]  E. Robertson,et al.  Preventing Drug Use among Children and Adolescents: A Research-Based Guide for Parents, Educators, and Community Leaders. Second Edition. , 1997 .

[4]  P. Greenwald,et al.  The new emphasis in cancer control. , 1985, Journal of the National Cancer Institute.

[5]  P. Bebbington,et al.  The REACT study: randomised evaluation of assertive community treatment in north London , 2006, BMJ : British Medical Journal.

[6]  R. Brownson,et al.  Evidence-based public health: a fundamental concept for public health practice. , 2009, Annual review of public health.

[7]  J. Schreyögg Gerechtigkeit in Gesundheitssystemen aus ökonomischer Perspektive* , 2004 .

[8]  Richard A. Goodman,et al.  What is “community health”? Examining the meaning of an evolving field in public health☆ , 2014, Preventive medicine.

[9]  James Thomas,et al.  Bmc Medical Research Methodology Methods for the Synthesis of Qualitative Research: a Critical Review , 2022 .

[10]  K. Wegscheider Übertragung von Studienergebnissen auf den Versorgungsalltag: Beitrag unterschiedlicher qualitativer und quantitativer Forschungsansätze , 2009 .

[11]  B. Flay Efficacy and effectiveness trials (and other phases of research) in the development of health promotion programs. , 1986, Preventive medicine.

[12]  M. Marshall,et al.  WITHDRAWN: Assertive community treatment for people with severe mental disorders. , 2011, The Cochrane database of systematic reviews.

[13]  Rinad S. Beidas,et al.  Methods to Improve the Selection and Tailoring of Implementation Strategies , 2017, The Journal of Behavioral Health Services & Research.

[14]  Paul N Williams,et al.  Transfer of research-based HIV prevention interventions to community service providers: fidelity and adaptation. , 2000, AIDS education and prevention : official publication of the International Society for AIDS Education.

[15]  Evidence-based public health: an evolving concept. , 2004 .

[16]  P. Bebbington,et al.  Randomised evaluation of assertive community treatment: 3-year outcomes , 2009, British Journal of Psychiatry.

[17]  Mickael Bech,et al.  A MODEL FOR ASSESSMENT OF TELEMEDICINE APPLICATIONS: MAST , 2012, International Journal of Technology Assessment in Health Care.

[18]  W. Gaebel,et al.  [Team-based community psychiatry: importance of context factors and transferability of evidence from studies]. , 2012, Der Nervenarzt.

[19]  P. Glasziou,et al.  Evidence‐based public health practice , 1999, Australian and New Zealand journal of public health.

[20]  M. Eccles,et al.  Tailored interventions to address determinants of practice. , 2015, The Cochrane database of systematic reviews.

[21]  O. Gerke,et al.  Checklists for external validity: a systematic review. , 2014, Journal of evaluation in clinical practice.

[22]  F. Alla,et al.  Transferability of interventions in health education: a review , 2012, BMC Public Health.

[23]  David R. Jones,et al.  Synthesising qualitative and quantitative evidence: A review of possible methods , 2005 .

[24]  Ray Pawson,et al.  Nothing as Practical as a Good Theory , 2003 .

[25]  David B. Muhlhausen Evaluating Federal Social Programs , 2012 .

[26]  T. Greenhalgh,et al.  Effectiveness and efficiency of search methods in systematic reviews of complex evidence: audit of primary sources , 2005, BMJ : British Medical Journal.

[27]  Daniela Cruzes,et al.  Recommended Steps for Thematic Synthesis in Software Engineering , 2011, 2011 International Symposium on Empirical Software Engineering and Measurement.

[28]  D. Lyle,et al.  A transferable telepsychiatry model for improving access to emergency mental health care , 2014, Journal of telemedicine and telecare.

[29]  S. Parkin,et al.  Generalizing Applied Qualitative Research on Harm Reduction: The Example of a Public Injecting Typology , 2011 .

[30]  Astrid Grøttland,et al.  ASSESSMENT OF MAST IN EUROPEAN PATIENT-CENTERED TELEMEDICINE PILOTS , 2015, International Journal of Technology Assessment in Health Care.

[31]  Russell E Glasgow,et al.  A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. , 2008, Joint Commission journal on quality and patient safety.

[32]  J. Hiller,et al.  Applicability and transferability of interventions in evidence-based public health. , 2006, Health promotion international.

[33]  Pim Cuijpers,et al.  Adapting and disseminating effective public health interventions in another country: towards a systematic approach. , 2005, European journal of public health.

[34]  F. Alla,et al.  A tool to analyze the transferability of health promotion interventions , 2013, BMC Public Health.

[35]  M. Frommer,et al.  Criteria for evaluating evidence on public health interventions , 2002, Journal of epidemiology and community health.

[36]  M. Petticrew,et al.  The influence of environmental factors on the generalisability of public health research evidence: physical activity as a worked example , 2011, The international journal of behavioral nutrition and physical activity.

[37]  P. Groenewegen,et al.  Patient-centred interprofessional collaboration in primary care: challenges for clinical, educational and health services research. An EGPRN keynote paper , 2014, The European journal of general practice.

[38]  R. Glasgow,et al.  Evaluating the public health impact of health promotion interventions: the RE-AIM framework. , 1999, American journal of public health.

[39]  Helen E. D. Burchett,et al.  How do we know when research from one setting can be useful in another? A review of external validity, applicability and transferability frameworks , 2011, Journal of health services research & policy.

[40]  Arpana Verma,et al.  Critical appraisal for public health: a new checklist. , 2008, Public health.

[41]  R. Brownson,et al.  Evidence-Based Public Health , 2010 .

[42]  L. Chambers,et al.  Implementing a standardized community-based cardiovascular risk assessment program in 20 Ontario communities. , 2009, Health promotion international.

[43]  S. Schinke,et al.  Science-Based Prevention Programs and Principles, 2002. Effective Substance Abuse and Mental Health Programs for Every Community. , 2002 .

[44]  L. Kinsman,et al.  Study protocol: Evaluating the impact of a rural Australian primary health care service on rural health , 2011, BMC health services research.

[45]  Robert F. Boruch,et al.  Standards of Evidence: Criteria for Efficacy, Effectiveness and Dissemination , 2005, Prevention Science.

[46]  M. Perleth Bewertung der Übertragbarkeit von Studienergebnissen im Gemeinsamen Bundesausschuss , 2009 .

[47]  Mélanie Villeval,et al.  Enabling the transferability of complex interventions: exploring the combination of an intervention’s key functions and implementation , 2016, International Journal of Public Health.

[48]  L. Kirmayer,et al.  Evidence-Based Medicine: Opportunities and Challenges in a Diverse Society , 2011, Canadian journal of psychiatry. Revue canadienne de psychiatrie.

[49]  S. Oliver,et al.  Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ , 2012, BMC Medical Research Methodology.

[50]  S. Schoenwald,et al.  Effectiveness, transportability, and dissemination of interventions: what matters when? , 2001, Psychiatric services.

[51]  Peter J Pronovost,et al.  Explaining Michigan: developing an ex post theory of a quality improvement program. , 2011, The Milbank quarterly.

[52]  G H Land,et al.  Evidence-based decision making in public health. , 1999, Journal of public health management and practice : JPHMP.

[53]  T. Ashton Implementing integrated models of care: the importance of the macro-level context , 2015, International journal of integrated care.

[54]  M. Petticrew,et al.  Developing and evaluating complex interventions: reflections on the 2008 MRC guidance. , 2013, International journal of nursing studies.

[55]  E. Waters,et al.  Criteria for the systematic review of health promotion and public health interventions. , 2005, Health promotion international.

[56]  Alan Shiell,et al.  Theorising Interventions as Events in Systems , 2009, American journal of community psychology.

[57]  A. Harden,et al.  Methods for the thematic synthesis of qualitative research in systematic reviews , 2008, BMC medical research methodology.

[58]  D. Ciliska,et al.  Can I Use This Evidence in my Program Decision ? Assessing Applicability and Transferability of Evidence NOVEMBER 2007 , 2007 .

[59]  Andrew Booth,et al.  Implementation Science BioMed Central Debate A conceptual framework for implementation fidelity , 2007 .

[60]  F. Alla,et al.  Stakeholders’ perceptions of transferability criteria for health promotion interventions: a case study , 2014, BMC Public Health.

[61]  Natalie J Gould,et al.  Combined use of the Consolidated Framework for Implementation Research (CFIR) and the Theoretical Domains Framework (TDF): a systematic review , 2017, Implementation Science.

[62]  R. Glasgow,et al.  Why don't we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. , 2003, American journal of public health.

[63]  E. Mohammadi,et al.  Barriers and facilitators related to the implementation of a physiological track and trigger system: A systematic review of the qualitative evidence , 2017, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[64]  J. Bryce,et al.  Evidence-based public health: moving beyond randomized trials. , 2004, American journal of public health.

[65]  Hyung Min Kim,et al.  Efficacy vs effectiveness trial results of an indicated "model" substance abuse program: implications for public health. , 2006, American journal of public health.

[66]  G. Noblit,et al.  Meta-Ethnography: Synthesizing Qualitative Studies , 1988 .

[67]  Andrew Booth,et al.  Making sense of complexity in context and implementation: the Context and Implementation of Complex Interventions (CICI) framework , 2017, Implementation Science.

[68]  Nicholas J Hicks,et al.  Development of a toolkit and glossary to aid in the adaptation of health technology assessment (HTA) reports for use in different contexts. , 2009, Health technology assessment.

[69]  A. Bauman,et al.  Translating research for evidence-based public health: key concepts and future directions , 2012, Journal of Epidemiology & Community Health.

[70]  J. E. Lenz Mast , 1983 .

[71]  A. Kilbourne,et al.  Implementing evidence-based interventions in health care: application of the replicating effective programs framework , 2007, Implementation science : IS.

[72]  Ray Pawson,et al.  Nothing as Practical as a Good Theory , 2003 .

[73]  Andrew Booth,et al.  Context and implementation: A concept analysis towards conceptual maturity. , 2015, Zeitschrift fur Evidenz, Fortbildung und Qualitat im Gesundheitswesen.