Complex interventions and their implications for systematic reviews: a pragmatic approach.

Complex interventions present unique challenges for systematic reviews. Current debates tend to center around describing complexity, rather than providing guidance on what to do about it. At a series of meetings during 2009-2012, we met to review the challenges and practical steps reviewer could take to incorporate a complexity perspective into systematic reviews. Based on this, we outline a pragmatic approach to dealing with complexity, beginning, as for any review, with clearly defining the research question(s). We argue that reviews of complex interventions can themselves be simple or complex, depending on the question to be answered. In systematic reviews and evaluations of complex interventions, it will be helpful to start by identifying the sources of complexity, then mapping aspects of complexity in the intervention onto the appropriate sources of evidence (such as specific types of quantitative or qualitative study). Although we focus on systematic reviews, the general approach is also applicable to primary research that is aimed at evaluating complex interventions. Although the examples are drawn from health care, the approach may also be applied to other sectors (e.g., social policy or international development). We end by concluding that systematic reviews should follow the principle of Occam's razor: explanations should be as complex as they need to be and no more.

[1]  D. Wiersma,et al.  Day hospital versus admission for acute psychiatric disorders. , 2003, The Cochrane database of systematic reviews.

[2]  Douglas G Altman,et al.  Validity of indirect comparison for estimating efficacy of competing interventions: empirical evidence from published meta-analyses , 2003, BMJ : British Medical Journal.

[3]  Alan Shiell,et al.  Complex interventions: how “out of control” can a randomised controlled trial be? , 2004, BMJ : British Medical Journal.

[4]  J. Lines,et al.  Evaluating delivery systems: complex evaluations and plausibility inference. , 2010, The American journal of tropical medicine and hygiene.

[5]  R. Hanka The Handbook of Research Synthesis , 1994 .

[6]  M. Petticrew,et al.  Public health evaluation in the twenty-first century: time to see the wood as well as the trees. , 2010, Journal of public health.

[7]  K. Soares-Weiser,et al.  Day hospital versus admission for acute psychiatric disorders. , 2011, The Cochrane database of systematic reviews.

[8]  T. Greenhalgh,et al.  Realist review - a new method of systematic review designed for complex policy interventions , 2005, Journal of health services research & policy.

[9]  Sandro Galea,et al.  Causal thinking and complex system approaches in epidemiology. , 2010, International journal of epidemiology.

[10]  Sandy Oliver,et al.  Integrating qualitative research with trials in systematic reviews , 2004, BMJ : British Medical Journal.

[11]  Richard Reading Realist review to understand the efficacy of school feeding programmes , 2008 .

[12]  P. Plsek,et al.  The challenge of complexity in health care , 2001, BMJ : British Medical Journal.

[13]  Keith R Abrams,et al.  Factors affecting uptake of childhood immunisation: a Bayesian synthesis of qualitative and quantitative evidence , 2002, The Lancet.

[14]  M. Petticrew,et al.  Understanding the Psychosocial Impacts of Housing Type: Qualitative Evidence from a Housing and Regeneration Intervention , 2011 .

[15]  W. M. Thorburn,et al.  THE MYTH OF OCCAM'S RAZOR , 1918 .

[16]  Richard Emsley,et al.  Ian R White interventions Mediation and moderation of treatment effects in randomised controlled trials of complex , 2010 .

[17]  Julian Sheather,et al.  Complex interventions or complex systems? Implications for health economic evaluation , 2008 .

[18]  Anne Mills,et al.  What do we mean by rigorous health-systems research? , 2008, The Lancet.

[19]  Alan Shiell,et al.  Theorising Interventions as Events in Systems , 2009, American journal of community psychology.

[20]  M. Petticrew,et al.  Systematic Reviews in the Social Sciences: A Practical Guide , 2005 .

[21]  Aziz Sheikh,et al.  Can We Systematically Review Studies That Evaluate Complex Interventions? , 2009, PLoS medicine.

[22]  M. Frommer,et al.  Criteria for evaluating evidence on public health interventions , 2002, Journal of epidemiology and community health.

[23]  Rebecca Armstrong,et al.  Using logic models to capture complexity in systematic reviews , 2011, Research synthesis methods.

[24]  S. Middeldorp,et al.  Clopidogrel plus aspirin versus aspirin alone for preventing cardiovascular disease. , 2011, Cochrane Database of Systematic Reviews.

[25]  L. Hedges,et al.  The Handbook of Research Synthesis , 1995 .

[26]  M. Petticrew,et al.  Developing and evaluating complex interventions: the new Medical Research Council guidance , 2008, BMJ : British Medical Journal.

[27]  P. Sandercock,et al.  Framework for design and evaluation of complex interventions to improve health , 2000, BMJ : British Medical Journal.

[28]  Kathleen D. Vohs,et al.  Out of Control , 2015 .

[29]  P. Byass Systems thinking for health systems strengthening , 2011 .