Emergent approaches to the meta-analysis of multiple heterogeneous complex interventions

BackgroundMultiple interventions meta-analysis has been recommended in the methodological literature as a tool for evidence synthesis when a heterogeneous set of interventions is included in the same review—and, more recently, when a heterogeneous set of complex interventions is included. However, there is little guidance on the use of this method with complex interventions. This article suggests two approaches to model complexity and heterogeneity through this method.Discussion‘Clinically meaningful units’ groups interventions by modality or similar theory of change, whereas ‘components and dismantling’ separates out interventions into combinations of components and either groups interventions by the combination of components they demonstrate or extracts effects for each identified component and, possibly, interactions between components. Future work in systematic review methodology should aim to understand how to develop taxonomies of components or theories of change that are internally relevant to the studies in these multiple interventions meta-analyses.SummaryDespite little meaningful prior guidance to its use in this context, multiple interventions meta-analysis has the potential to be a useful tool for synthesising heterogeneous sets of complex interventions. Researchers should choose an approach in accordance with their specific aims in their systematic review.

[1]  A Whitehead,et al.  Borrowing strength from external trials in a meta-analysis. , 1996, Statistics in medicine.

[2]  G. Lu,et al.  Assessing Evidence Inconsistency in Mixed Treatment Comparisons , 2006 .

[3]  H. Naci,et al.  Industry sponsorship bias in research findings: a network meta-analysis of LDL cholesterol reduction in randomised trials of statins , 2014, BMJ : British Medical Journal.

[4]  E. Mayo-Wilson,et al.  Psychological and pharmacological interventions for social anxiety disorder in adults: a systematic review and network meta-analysis , 2014, The lancet. Psychiatry.

[5]  S. Murphy,et al.  The multiphase optimization strategy (MOST) and the sequential multiple assignment randomized trial (SMART): new methods for more potent eHealth interventions. , 2007, American journal of preventive medicine.

[6]  Bruce F Chorpita,et al.  Identifying and Selecting the Common Elements of Evidence Based Interventions: A Distillation and Matching Model , 2005, Mental health services research.

[7]  Nicky J Welton,et al.  Mixed treatment comparison meta-analysis of complex interventions: psychological interventions in coronary heart disease. , 2009, American journal of epidemiology.

[8]  P. Tharyan Introducing conceptual and analytical clarity on dimensions of complexity in systematic reviews of complex interventions. , 2013, Journal of clinical epidemiology.

[9]  A. Beck,et al.  The empirical status of cognitive-behavioral therapy: a review of meta-analyses. , 2006, Clinical psychology review.

[10]  Randy W. Elder,et al.  Complex interventions and their implications for systematic reviews: a pragmatic approach. , 2013, Journal of clinical epidemiology.

[11]  T. Lumley Network meta‐analysis for indirect treatment comparisons , 2002, Statistics in medicine.

[12]  Georgia Salanti,et al.  Indirect and mixed‐treatment comparison, network, or multiple‐treatments meta‐analysis: many names, many benefits, many concerns for the next generation evidence synthesis tool , 2012, Research synthesis methods.

[13]  Joseph C Cappelleri,et al.  Interpreting indirect treatment comparisons and network meta-analysis for health-care decision making: report of the ISPOR Task Force on Indirect Treatment Comparisons Good Research Practices: part 1. , 2011, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[14]  Jeremy C Wyatt,et al.  Faculty Opinions recommendation of The multiphase optimization strategy (MOST) and the sequential multiple assignment randomized trial (SMART): new methods for more potent eHealth interventions. , 2013 .

[15]  Matt C. Howard,et al.  The multiphase optimization strategy (MOST) and the sequential multiple assignment randomized trial (SMART): two novel evaluation methods for developing optimal training programs , 2016 .

[16]  Terri D. Pigott,et al.  Identifying, documenting, and examining heterogeneity in systematic reviews of complex interventions. , 2013, Journal of clinical epidemiology.

[17]  D. Kendrick,et al.  Network meta-analysis to evaluate the effectiveness of interventions to increase the uptake of smoke alarms. , 2012, Epidemiologic reviews.

[18]  D. Kendrick,et al.  An exploration of synthesis methods in public health evaluations of interventions concludes that the use of modern statistical methods would be beneficial. , 2014, Journal of clinical epidemiology.

[19]  Jane Noyes,et al.  Synthesizing evidence on complex interventions: how meta-analytical, qualitative, and mixed-method approaches can contribute. , 2013, Journal of clinical epidemiology.

[20]  Alex J. Sutton,et al.  Evidence Synthesis for Decision Making 2 , 2013, Medical decision making : an international journal of the Society for Medical Decision Making.

[21]  R. Prinz,et al.  Adopting a population-level approach to parenting and family support interventions. , 2007, Clinical psychology review.

[22]  J. Connell,et al.  New Approaches to Evaluating Community Initiatives. Concepts, Methods, and Contexts. Roundtable on Comperhensive Community Initiatives for Children and Families. , 1995 .

[23]  Staffan Berglund,et al.  The background of adolescent pregnancies in Nicaragua: A qualitative approach , 1997 .

[24]  Nicky J Welton,et al.  Synthesis of evidence on heterogeneous interventions with multiple outcomes recorded over multiple follow‐up times reported inconsistently: a smoking cessation case‐study , 2014 .

[25]  Bruce F Chorpita,et al.  Understanding the common elements of evidence-based practice: misconceptions and clinical examples. , 2007, Journal of the American Academy of Child and Adolescent Psychiatry.

[26]  F. Song,et al.  Use of indirect comparison methods in systematic reviews: a survey of Cochrane review authors , 2012, Research synthesis methods.

[27]  Adam Fletcher,et al.  Realist randomised controlled trials: a new approach to evaluating complex public health interventions. , 2012, Social science & medicine.

[28]  Georgia Salanti,et al.  Graphical methods and numerical summaries for presenting results from multiple-treatment meta-analysis: an overview and tutorial. , 2011, Journal of clinical epidemiology.

[29]  M. Stoolmiller,et al.  Preventing conduct problems and improving school readiness: evaluation of the Incredible Years Teacher and Child Training Programs in high-risk schools. , 2008, Journal of child psychology and psychiatry, and allied disciplines.

[30]  Alan Shiell,et al.  Complex interventions: how “out of control” can a randomised controlled trial be? , 2004, BMJ : British Medical Journal.

[31]  G. Lu,et al.  Combination of direct and indirect evidence in mixed treatment comparisons , 2004, Statistics in medicine.

[32]  A. Beck The current state of cognitive therapy: a 40-year retrospective. , 2005, Archives of general psychiatry.

[33]  Danny C. Duke,et al.  Systematic review and meta-analysis of behavioral interventions for fecal incontinence with constipation. , 2014, Journal of pediatric psychology.

[34]  S. Michie,et al.  A refined taxonomy of behaviour change techniques to help people change their physical activity and healthy eating behaviours: The CALO-RE taxonomy , 2011, Psychology & health.

[35]  A E Ades,et al.  An evaluation of the feasibility, cost and value of information of a multicentre randomised controlled trial of intravenous immunoglobulin for sepsis (severe sepsis and septic shock): incorporating a systematic review, meta-analysis and value of information analysis. , 2012, Health technology assessment.

[36]  Peter Jüni,et al.  Comparative Efficacy of Seven Psychotherapeutic Interventions for Patients with Depression: A Network Meta-Analysis , 2013, PLoS medicine.

[37]  Tianjing Li,et al.  Network meta-analysis-highly attractive but more methodological research is needed , 2011, BMC medicine.

[38]  Georgia Salanti,et al.  Evaluation of networks of randomized trials , 2008, Statistical methods in medical research.

[39]  S Dias,et al.  Checking consistency in mixed treatment comparison meta‐analysis , 2010, Statistics in medicine.

[40]  David C Hoaglin,et al.  Conducting indirect-treatment-comparison and network-meta-analysis studies: report of the ISPOR Task Force on Indirect Treatment Comparisons Good Research Practices: part 2. , 2011, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[41]  L. Kriston,et al.  EFFICACY AND ACCEPTABILITY OF ACUTE TREATMENTS FOR PERSISTENT DEPRESSIVE DISORDER: A NETWORK META‐ANALYSIS , 2014, Depression and anxiety.

[42]  M. Petticrew,et al.  Developing and evaluating complex interventions: the new Medical Research Council guidance , 2008, BMJ : British Medical Journal.

[43]  Kristian Thorlund,et al.  Multiple treatment comparison meta-analyses: a step forward into complexity , 2011, Clinical epidemiology.

[44]  Eli S. Grant,et al.  Network Meta-Analysis for Complex Social Interventions: Problems and Potential , 2013, Journal of the Society for Social Work and Research.