Using logic models to capture complexity in systematic reviews

Logic models have long been used to understand complex programs to improve social and health outcomes. They illustrate how a program is designed to achieve its intended outcomes. They also can be used to describe connections between determinants of outcomes, for example, low high-school graduation rates or spiraling obesity rates, thus aiding the development of interventions that target causal factors. However, these models have not often been used in systematic reviews. This paper argues that logic models can be valuable in the systematic review process. First, they can aid in the conceptualization of the review focus and illustrate hypothesized causal links, identify effect mediators or moderators, specify intermediate outcomes and potential harms, and justify a priori subgroup analyses when differential effects are anticipated. Second, logic models can be used to direct the review process more specifically. They can help justify narrowing the scope of a review, identify the most relevant inclusion criteria, guide the literature search, and clarify interpretation of results when drawing policy-relevant conclusions about review findings. We present examples that explain how logic models have been used and how they can be applied at different stages in a systematic review. Copyright © 2011 John Wiley & Sons, Ltd.

[1]  A. Masten Ordinary magic. Resilience processes in development. , 2001, The American psychologist.

[2]  A. Drewnowski The cost of US foods as related to their nutritive value. , 2010, The American journal of clinical nutrition.

[3]  Taghreed Adam,et al.  Systems thinking for health systems strengthening. , 2009 .

[4]  Evelyn P. Whitlock,et al.  Screening and Interventions for Childhood Overweight: A Summary of Evidence for the US Preventive Services Task Force , 2005, Pediatrics.

[5]  L. Bickman The functions of program theory , 1987 .

[6]  Josiane Bonnefoy,et al.  Assessing equity in systematic reviews: realising the recommendations of the Commission on Social Determinants of Health , 2010, BMJ : British Medical Journal.

[7]  M. Petticrew,et al.  Systematic Reviews in the Social Sciences: A Practical Guide , 2005 .

[8]  Alan Shiell,et al.  Theorising Interventions as Events in Systems , 2009, American journal of community psychology.

[9]  Deborah Helitzer,et al.  Evaluation for community-based programs: the integration of logic models and factor analysis. , 2010, Evaluation and program planning.

[10]  Patricia Chamberlain,et al.  Multidimensional treatment foster care as a preventive intervention to promote resiliency among youth in the child welfare system. , 2009, Journal of personality.

[11]  William N. Dunn,et al.  Public Policy Analysis , 1981 .

[12]  Annie Millar,et al.  Logic models: a systems tool for performance management , 2001 .

[13]  B. Popkin Agricultural policies, food and public health , 2011, EMBO reports.

[14]  J. Glanville,et al.  Searching for Studies , 2008 .

[15]  D. Rog,et al.  Reasoning in evaluation: Challenges for the practitioner , 1995 .

[16]  S. Woolf,et al.  Developing evidence-based clinical practice guidelines: lessons learned by the US Preventive Services Task Force. , 1996, Annual review of public health.

[17]  T. Greenhalgh,et al.  Realist review - a new method of systematic review designed for complex policy interventions , 2005, Journal of health services research & policy.

[18]  Wendy Wood,et al.  Advantages of certainty and uncertainty , 2009 .

[19]  C. Mulrow,et al.  Current methods of the US Preventive Services Task Force: a review of the process. , 2001, American journal of preventive medicine.

[20]  Michael Joffe,et al.  Complex causal process diagrams for analyzing the health impacts of policy interventions. , 2006, American journal of public health.

[21]  Evelyn P. Whitlock,et al.  Effectiveness of Weight Management Interventions in Children: A Targeted Systematic Review for the USPSTF , 2010, Pediatrics.

[22]  L. Hedges,et al.  Improving meta-analysis for policy purposes. , 1997, NIDA research monograph.

[23]  G. Patterson,et al.  Coercive Family Process , 1982 .

[24]  C. Weiss How Can Theory-Based Evaluation Make Greater Headway? , 1997 .

[25]  Aziz Sheikh,et al.  Can We Systematically Review Studies That Evaluate Complex Interventions? , 2009, PLoS medicine.

[26]  Joy A. Frechtling Logic Modeling Methods in Program Evaluation , 2007 .

[27]  Mindy Thompson Fullilove,et al.  Root shock: The consequences of African American dispossession , 2001, Journal of Urban Health.

[28]  Harris Cooper,et al.  Evaluating and Interpreting Research Syntheses in Adult Learning and Literacy. NCSALL Occasional Paper. , 2007 .

[29]  R. Maynard,et al.  Impacts of After-School Programs on Student Outcomes: A Systematic Review , 2006 .

[30]  M. Petticrew,et al.  Developing and evaluating complex interventions: the new Medical Research Council guidance , 2008, BMJ : British Medical Journal.

[31]  Alan Shiell,et al.  Complex interventions or complex systems? Implications for health economic evaluation , 2008, BMJ : British Medical Journal.

[32]  Adam Drewnowski,et al.  Can Low-Income Americans Afford a Healthy Diet? , 2009, Nutrition today.

[33]  Pau Klein,et al.  San Francisco, California , 2007 .

[34]  Mary Dozier,et al.  Effects of Therapeutic Interventions for Foster Children on Behavioral Problems, Caregiver Attachment, and Stress Regulatory Neural Systems , 2006, Annals of the New York Academy of Sciences.