AHRQ series on complex intervention systematic reviews-paper 5: advanced analytic methods.

BACKGROUND AND OBJECTIVE Advanced analytic methods for synthesizing evidence about complex interventions continue to be developed. In this paper, we emphasize that the specific research question posed in the review should be used as a guide for choosing the appropriate analytic method. METHODS We present advanced analytic approaches that address four common questions that guide reviews of complex interventions: (1) How effective is the intervention? (2) For whom does the intervention work and in what contexts? (3) What happens when the intervention is implemented? and (4) What decisions are possible given the results of the synthesis? CONCLUSION The analytic approaches presented in this paper are particularly useful when each primary study differs in components, mechanisms of action, context, implementation, timing, and many other domains.

[1]  Sandra Lowe,et al.  Redesigning Social Inquiry Fuzzy Sets And Beyond , 2016 .

[2]  Charles C. Ragin,et al.  Redesigning social inquiry , 2008 .

[3]  Nicky J Welton,et al.  Mixed treatment comparison meta-analysis of complex interventions: psychological interventions in coronary heart disease. , 2009, American journal of epidemiology.

[4]  Jodie Doyle,et al.  Slum upgrading review: methodological challenges that arise in systematic reviews of complex interventions. , 2013, Journal of public health.

[5]  David Rindskopf,et al.  Methods for evidence‐based practice: Quantitative synthesis of single‐subject designs , 2007 .

[6]  M. Dixon-Woods,et al.  Conducting a critical interpretive synthesis of the literature on access to healthcare by vulnerable groups , 2006 .

[7]  M. Sculpher,et al.  Using Value of Information Analysis to Prioritise Health Research , 2012, PharmacoEconomics.

[8]  Harold I Feldman,et al.  Individual patient‐ versus group‐level data meta‐regressions for the investigation of treatment effect modifiers: ecological bias rears its ugly head , 2002, Statistics in medicine.

[9]  Mary Butler,et al.  AHRQ Series on Complex Intervention Systematic Reviews , 2017 .

[10]  E. Myers,et al.  How much is another randomized trial of lymph node dissection in endometrial cancer worth? A value of information analysis. , 2013, Gynecologic oncology.

[11]  Andrew Booth,et al.  Current use was established and Cochrane guidance on selection of social theories for systematic reviews of complex interventions was developed. , 2016, Journal of clinical epidemiology.

[12]  Milton C Weinstein,et al.  Prioritizing HIV comparative effectiveness trials based on value of information: generic versus brand-name ART in the US , 2015, HIV clinical trials.

[13]  Mike W.-L. Cheung,et al.  Meta-Analysis: A Structural Equation Modeling Approach , 2015 .

[14]  Susan Michie,et al.  A research and development agenda for systematic reviews that ask complex questions about complex interventions. , 2013, Journal of clinical epidemiology.

[15]  Paul Landais,et al.  Meta-regression detected associations between heterogeneous treatment effects and study-level, but not patient-level, factors. , 2004, Journal of clinical epidemiology.

[16]  Claire Glenton,et al.  Barriers and facilitators to the implementation of lay health worker programmes to improve access to maternal and child health: qualitative evidence synthesis. , 2013, The Cochrane database of systematic reviews.

[17]  Jennie Popay,et al.  Chapter 20: Qualitative research and Cochrane reviews , 2008 .

[18]  S. Verweij.  Set-theoretic methods for the social sciences: a guide to qualitative comparative analysis , 2013 .

[19]  Laura M. Stapleton,et al.  Testing Latent Mean Differences Between Observed and Unobserved Groups Using Multilevel Factor Mixture Models , 2008 .

[20]  Meera Viswanathan,et al.  AHRQ series on complex intervention systematic reviews-paper 4: selecting analytic approaches. , 2017, Journal of clinical epidemiology.

[21]  Victoria Martínez,et al.  Introduction to Meta-Analysis , 2002 .

[22]  A. O’Cathain,et al.  Process evaluation of complex interventions: Medical Research Council guidance , 2015, BMJ : British Medical Journal.

[23]  Susan Michie,et al.  Investigating complexity in systematic reviews of interventions by using a spectrum of methods. , 2013, Journal of clinical epidemiology.

[24]  Dan Jackson,et al.  Multivariate meta-analysis: Potential and promise , 2011, Statistics in medicine.

[25]  Elizabeth Tipton,et al.  Robust variance estimation in meta‐regression with dependent effect size estimates , 2010, Research synthesis methods.

[26]  M. Sandelowski,et al.  Using qualitative metasummary to synthesize qualitative and quantitative descriptive findings. , 2007, Research in nursing & health.

[27]  J. Higgins,et al.  Cochrane Handbook for Systematic Reviews of Interventions , 2010, International Coaching Psychology Review.

[28]  Richard D Riley,et al.  Rejoinder to commentaries on ‘Multivariate meta‐analysis: Potential and promise’ , 2011 .

[29]  Sandy Oliver,et al.  An Emerging Framework for Including Different Types of Evidence in Systematic Reviews for Public Policy , 2005 .

[30]  J. Higgins,et al.  Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0. The Cochrane Collaboration , 2013 .

[31]  Claire Glenton,et al.  Lay health workers in primary and community health care for maternal and child health and the management of infectious diseases. , 2010, The Cochrane database of systematic reviews.

[32]  Dena A. Pastor,et al.  Mean and covariance structure mixture models. , 2013 .

[33]  Pedro Saramago,et al.  Cost-effectiveness of interventions for increasing the possession of functioning smoke alarms in households with pre-school children: a modelling study , 2014, BMC Public Health.

[34]  Mary Butler,et al.  AHRQ series on complex intervention systematic reviews-paper 1: an introduction to a series of articles that provide guidance and tools for reviews of complex interventions. , 2017, Journal of clinical epidemiology.

[35]  Joshua R Polanin,et al.  The use of meta‐analytic statistical significance testing , 2015, Research synthesis methods.

[36]  Karl Claxton,et al.  The Value of Implementation and the Value of Information: Combined and Uneven Development , 2008, Medical decision making : an international journal of the Society for Medical Decision Making.

[37]  Jane Noyes,et al.  Synthesizing evidence on complex interventions: how meta-analytical, qualitative, and mixed-method approaches can contribute. , 2013, Journal of clinical epidemiology.

[38]  Jennie Popay,et al.  Guidance on the conduct of narrative synthesis in systematic Reviews. A Product from the ESRC Methods Programme. Version 1 , 2006 .

[39]  D J Spiegelhalter,et al.  Bayesian approaches to random-effects meta-analysis: a comparative study. , 1995, Statistics in medicine.

[40]  Gregory R. Hancock,et al.  Structural equation modeling : a second course , 2006 .

[41]  John M Ferron,et al.  From a single-level analysis to a multilevel analysis of single-case experimental designs. , 2014, Journal of school psychology.

[42]  John B. Wong,et al.  Decision making in health and medicine: Integrating evidence and values, second edition , 2014 .

[43]  T. Greenhalgh,et al.  Realist review - a new method of systematic review designed for complex policy interventions , 2005, Journal of health services research & policy.

[44]  Michele Tarsilla.  Cochrane Handbook for Systematic Reviews of Interventions , 2010, Journal of MultiDisciplinary Evaluation.

[45]  Carsten Q. Schneider,et al.  Standards of Good Practice in Qualitative Comparative Analysis (QCA) and Fuzzy-Sets , 2010 .

[46]  Georgia Salanti,et al.  Indirect and mixed‐treatment comparison, network, or multiple‐treatments meta‐analysis: many names, many benefits, many concerns for the next generation evidence synthesis tool , 2012, Research synthesis methods.