The evolution of a new publication type: Steps and challenges of producing overviews of reviews

BACKGROUND To date, the Cochrane Child Health Field has published 18 overviews of reviews in our journal, Evidence-based Child Health: A Cochrane Review Journal. In this article, we highlight some of the logistical and methodological challenges of producing such syntheses. As this is a new and evolving publication type, we hope that our experience will benefit others who engage in this process. Current Methods: We discuss the process we have developed to produce overviews of reviews relevant to our mandate, including identification of the research question, establishment of the author team, selection of outcomes and included SRs, and presentation of findings. Ongoing Development: We discuss the lessons we have learned, outstanding challenges for overview authors, and the limitations of overviews. CONCLUSIONS Overviews of reviews are only as good as the SRs and primary studies on which they are based; gaps or lack of currency in this evidence will weaken the overview of reviews. Future directions in this work must address questions of bias and loss of information. Methods for overviews of reviews targeted for specific groups, such as children, need more elaboration. Copyright © 2011 John Wiley & Sons, Ltd.

[1]  J. Stockman.  Carvedilol for Children and Adolescents With Heart Failure: A Randomized Controlled Trial , 2009 .

[2]  M. Petticrew,et al.  Psychosocial risk factors in home and community settings and their associations with population health and health inequalities: A systematic meta-review , 2008, BMC public health.

[3]  John N. Lavis,et al.  How Can We Support the Use of Systematic Reviews in Policymaking? , 2009, PLoS medicine.

[4]  G. Lu,et al.  Combination of direct and indirect evidence in mixed treatment comparisons , 2004, Statistics in medicine.

[5]  A. Hrõbjartsson,et al.  Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. , 2004, JAMA.

[6]  M. Petticrew,et al.  What are the most effective ways of improving population health through transport interventions? Evidence from systematic reviews , 2003, Journal of epidemiology and community health.

[7]  John P.A. Ioannidis,et al.  Integration of evidence from multiple meta-analyses: a primer on umbrella reviews, treatment networks and multiple treatments meta-analyses , 2009, Canadian Medical Association Journal.

[8]  J. Lavis,et al.  How can research organizations more effectively transfer research knowledge to decision makers? , 2003, The Milbank quarterly.

[9]  Deborah M Caldwell,et al.  Mixed treatment comparison analysis provides internally coherent treatment effect estimates based on overviews of reviews and can reveal inconsistency. , 2010, Journal of clinical epidemiology.

[10]  G. Swingler,et al.  Children in reviews: Methodological issues in child-relevant evidence syntheses , 2005, BMC pediatrics.

[11]  Lisa Hartling,et al.  Systematic reviews of psychosocial interventions for autism: an umbrella review , 2009, Developmental medicine and child neurology.

[12]  J. PérezMartín,et al.  [International Committee of Medical Journal Editors]. , 2008, Revista alergia Mexico.

[13]  M. Suarez‐Almazor,et al.  Biologics for rheumatoid arthritis: an overview of Cochrane reviews , 2009, The Cochrane database of systematic reviews.

[14]  L. Becker,et al.  The Cochrane Library and bronchiolitis: an umbrella review , 2006 .

[15]  A. Oxman,et al.  Overviews of Reviews , 2008 .

[16]  Carl Heneghan,et al.  What is missing from descriptions of treatment in trials and reviews? , 2008, BMJ : British Medical Journal.

[17]  M. Suarez‐Almazor,et al.  Biologics for rheumatoid arthritis , 2009 .

[18]  M. Petticrew,et al.  Working for health? Evidence from systematic reviews on the effects on health and health inequalities of organisational changes to the psychosocial work environment. , 2009, Preventive medicine.

[19]  M. Petticrew,et al.  Population tobacco control interventions and their effects on social inequalities in smoking: placing an equity lens on existing systematic reviews , 2008, BMC public health.

[20]  G. Guyatt,et al.  GRADE: an emerging consensus on rating quality of evidence and strength of recommendations , 2008, BMJ : British Medical Journal.

[21]  David Moher,et al.  Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews , 2007, BMC medical research methodology.

[22]  L. Hartling,et al.  Children Are Not Just Small Adults: The Urgent Need for High-Quality Trial Evidence in Children , 2008, PLoS medicine.

[23]  B. Rowe,et al.  The Cochrane Library and Long-Acting Beta-agonist Treatment for Childhood Asthma: An Overview of Reviews , 2008 .

[24]  Phyllis N Butow,et al.  Clinical trials in children , 2004, The Lancet.

[25]  G. Jamtvedt,et al.  Effectiveness of Nonpharmacological and Nonsurgical Interventions for Hip Osteoarthritis: An Umbrella Review of High-Quality Systematic Reviews , 2007, Physical Therapy.

[26]  R. Fernandes,et al.  The Cochrane Library and the Treatment of Bronchiolitis in Children: An Overview of Reviews , 2011 .

[27]  Allan House,et al.  Meta-review of high-quality systematic reviews of interventions in key areas of liaison psychiatry. , 2005, The British journal of psychiatry : the journal of mental science.

[28]  Inger Holm,et al.  Physical Therapy Interventions for Patients With Osteoarthritis of the Knee: An Overview of Systematic Reviews , 2008, Physical Therapy.

[29]  D. Altman,et al.  Outcome reporting bias in randomized trials funded by the Canadian Institutes of Health Research , 2004, Canadian Medical Association Journal.