AHRQ series on complex intervention systematic reviews-paper 4: selecting analytic approaches.

BACKGROUND Systematic reviews of complex interventions can vary widely in purpose, data availability and heterogeneity, and stakeholder expectations. RATIONALE This article addresses the uncertainty that systematic reviewers face in selecting methods for reviews of complex interventions. Specifically, it lays out parameters for systematic reviewers to consider when selecting analytic approaches that best answer the questions at hand and suggests analytic techniques that may be appropriate in different circumstances. DISCUSSION Systematic reviews of complex interventions comprising multiple questions may use multiple analytic approaches. Parameters to consider when choosing analytic methods for complex interventions include nature and timing of the decision (clinical practice guideline, policy, or other); purpose of the review; extent of existing evidence; logistic factors such as the timeline, process, and resources for deciding the scope of the review; and value of information to be obtained from choosing specific systematic review methods. Reviewers may elect to revise their analytic approach based on new or changing considerations during the course of the review but should guard against bias through transparency of reporting.

[1]  N. Mutrie,et al.  The clinical effectiveness and cost-effectiveness of exercise referral schemes: a systematic review and economic evaluation. , 2011, Health technology assessment.

[2]  Sarah P Zuber,et al.  Interventions to Prevent Falls in Older Adults , 2010 .

[3]  C. Pope,et al.  Evaluating meta-ethnography: systematic analysis and synthesis of qualitative research. , 2011, Health technology assessment.

[4]  A. B. Hill The Environment and Disease: Association or Causation? , 1965, Proceedings of the Royal Society of Medicine.

[5]  Elizabeth Waters,et al.  Assessing the applicability of findings in systematic reviews of complex interventions can enhance the utility of reviews for decision making. , 2013, Journal of clinical epidemiology.

[6]  Meera Viswanathan,et al.  Agency for Healthcare Research and Quality Evidence-based Practice Center methods for systematically reviewing complex multicomponent health care interventions. , 2014, Journal of clinical epidemiology.

[7]  G. Guyatt,et al.  How to read a systematic review and meta-analysis and apply the results to patient care: users' guides to the medical literature. , 2014, JAMA.

[8]  Trisha Greenhalgh,et al.  Assessing the benefits of participatory research: a rationale for a realist review , 2011, Global health promotion.

[9]  S. Oliver,et al.  Community engagement to reduce inequalities in health: a systematic review, meta-analysis and economic analysis , 2013 .

[10]  Alain Mayhew,et al.  Decisions about lumping vs. splitting of the scope of systematic reviews of complex interventions are not well justified: a case study in systematic reviews of health care professional reminders. , 2012, Journal of clinical epidemiology.

[11]  Leila C. Kahwati,et al.  Strategies to improve mental health care for children and adolescents: Comparative effectiveness review No. 181 , 2016 .

[12]  Jane Noyes,et al.  Synthesizing evidence on complex interventions: how meta-analytical, qualitative, and mixed-method approaches can contribute. , 2013, Journal of clinical epidemiology.

[13]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[14]  Rachel Churchill,et al.  Introducing a series of methodological articles on considering complexity in systematic reviews of interventions. , 2013, Journal of clinical epidemiology.

[15]  S. Verweij Set-theoretic methods for the social sciences: a guide to qualitative comparative analysis , 2013 .

[16]  Susan Michie,et al.  A research and development agenda for systematic reviews that ask complex questions about complex interventions. , 2013, Journal of clinical epidemiology.

[17]  A. Harden,et al.  The school environment and student health: a systematic review and meta-ethnography of qualitative research , 2013, BMC Public Health.

[18]  Jeremy Grimshaw,et al.  Complex interventions and their implications for systematic reviews: A pragmatic approach. , 2015, International journal of nursing studies.

[19]  Claire Glenton,et al.  Barriers and facilitators to the implementation of lay health worker programmes to improve access to maternal and child health: qualitative evidence synthesis. , 2013, The Cochrane database of systematic reviews.

[20]  S. S. George,et al.  Clients' relational conceptions of conjoint couple and family therapy quality: a grounded formal theory. , 2012, Journal of marital and family therapy.

[21]  P. Kearney,et al.  The effect of moderate gestational alcohol consumption during pregnancy on speech and language outcomes in children: a systematic review , 2014, Systematic Reviews.

[22]  J. Knottnerus,et al.  Complex interventions-how should systematic reviews of their impact differ from reviews of simple or complicated interventions? , 2013, Journal of clinical epidemiology.

[23]  S Natasha Beretvas,et al.  AHRQ series on complex intervention systematic reviews-paper 5: advanced analytic methods. , 2017, Journal of clinical epidemiology.

[24]  Mary Butler,et al.  AHRQ series on complex intervention systematic reviews-paper 1: an introduction to a series of articles that provide guidance and tools for reviews of complex interventions. , 2017, Journal of clinical epidemiology.

[25]  P. Tharyan Introducing conceptual and analytical clarity on dimensions of complexity in systematic reviews of complex interventions. , 2013, Journal of clinical epidemiology.

[26]  Susan Michie,et al.  Investigating complexity in systematic reviews of interventions by using a spectrum of methods. , 2013, Journal of clinical epidemiology.

[27]  Monika Kastner,et al.  Conceptual recommendations for selecting the most appropriate knowledge synthesis method to answer research questions related to complex evidence. , 2016, Journal of clinical epidemiology.

[28]  Ginny Brunton,et al.  Using qualitative comparative analysis (QCA) in systematic reviews of complex interventions: a worked example , 2014, Systematic Reviews.

[29]  Janet E Squires,et al.  Systematic reviews of complex interventions: framing the review question. , 2013, Journal of clinical epidemiology.

[30]  Mary Butler,et al.  AHRQ Series on Complex Intervention Systematic Reviews , 2017 .