Quasi-experimental study designs series-paper 12: strengthening global capacity for evidence synthesis of quasi-experimental health systems research.

Evidence from quasi-experimental studies is often excluded from systematic reviews of health systems research despite the fact that such studies can provide strong causal evidence when well conducted. This article discusses global coordination of efforts to institutionalize the inclusion of causal evidence from quasi-experiments in systematic reviews of health systems research. In particular, we are concerned with identifying opportunities for strengthening capacity at the global and local level for implementing protocols necessary to ensure that reviews that include quasi-experiments are consistently of the highest quality. We first describe the current state of the global infrastructure that facilitates the production of systematic reviews of health systems research. We identify five important types of actors operating within this infrastructure: review authors; synthesis collaborations that facilitate the review process; synthesis interest groups that supplement the work of the larger collaborations; review funders; and end users, including policymakers. Then, we examine opportunities for intervening to build the capacity of each type of actors to support the inclusion of quasi-experiments in reviews. Finally, we suggest practical next steps for proceeding with capacity building efforts. Because of the complexity and relative nascence of the field, we recommend a carefully planned and executed approach to strengthening global capacity for the inclusion of quasi-experimental studies in systematic reviews.

[1]  George Wells,et al.  Quasi-experimental study designs series-paper 6: risk of bias assessment. , 2017, Journal of clinical epidemiology.

[2]  J Thomas,et al.  Randomised controlled trials for policy interventions: a review of reviews and meta-regression. , 2010, Health technology assessment.

[3]  J. Robins,et al.  Instruments for Causal Inference: An Epidemiologist's Dream? , 2006, Epidemiology.

[4]  Till Bärnighausen,et al.  Study-design selection criteria in systematic reviews of effectiveness of health systems interventions and reforms: A meta-review. , 2012, Health policy.

[5]  Till Bärnighausen,et al.  Quasi-experimental study designs series-paper 7: assessing the assumptions. , 2017, Journal of clinical epidemiology.

[6]  S. Oliver,et al.  Policy-Relevant Systematic Reviews to Strengthen Health Systems: Models and Mechanisms to Support Their Production. , 2016 .

[7]  Ariel M. Aloe,et al.  Quasi-experimental study designs series-paper 10: synthesizing evidence for effects collected from quasi-experimental studies presents surmountable challenges. , 2017, Journal of clinical epidemiology.

[8]  Till Bärnighausen,et al.  Regression Discontinuity Designs in Epidemiology , 2014, Epidemiology.

[9]  W. Shadish,et al.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2001 .

[10]  S. Oliver,et al.  Capacity for conducting systematic reviews in low- and middle-income countries: a rapid appraisal , 2015, Health Research Policy and Systems.

[11]  P. Tugwell,et al.  Inclusion of quasi-experimental studies in systematic reviews of health systems research. , 2015, Health policy.

[12]  David Gough,et al.  The Evidence for Policy and Practice Information and Coordinating Centre , 2007 .

[13]  Till Bärnighausen,et al.  Quasi-experimental study designs series-paper 13: realizing the full potential of quasi-experiments for health research. , 2017, Journal of clinical epidemiology.

[14]  Hugh Waddington,et al.  Quasi-experimental study designs series – Paper 5: Classifying studies evaluating effects of health interventions – a taxonomy without labels , 2017 .

[15]  Andrew Booth,et al.  Using the Knowledge to Action Framework in practice: a citation analysis and systematic review , 2014, Implementation Science.

[16]  Andrew M Jones,et al.  Quasi-experimental study designs series-paper 8: identifying quasi-experimental studies to inform systematic reviews. , 2017, Journal of clinical epidemiology.

[17]  Till Bärnighausen,et al.  Quasi-experimental study designs series-paper 4: uses and value. , 2017, Journal of clinical epidemiology.

[18]  Peter Tugwell,et al.  How to do a good systematic review of effects in international development: a tool kit , 2012 .

[19]  Ariel M. Aloe,et al.  Quasi-experimental study designs series-paper 9: collecting data from quasi-experimental studies. , 2017, Journal of clinical epidemiology.

[20]  G. Guyatt,et al.  GRADE: an emerging consensus on rating quality of evidence and strength of recommendations , 2008, BMJ : British Medical Journal.

[21]  Don C Des Jarlais,et al.  Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions: the TREND statement. , 2004, American journal of public health.

[22]  John N Lavis,et al.  Quasi-experimental study designs series-paper 11: supporting the production and use of health systems research syntheses that draw on quasi-experimental study designs. , 2017, Journal of clinical epidemiology.