[Practical experience with overviews of reviews--valuable decision aid or academic exercise?].

The "overview of reviews" has evolved as a method to aggregate information from systematic reviews. Based on research projects conducted by two Austrian institutions, this article aims to point out methods and perceived strengths and limitations of overviews of reviews and to discuss their application and constraints for different healthcare settings. The six analysed projects differed in their objectives as well as in the corresponding methodology. We identified the following strengths of the overviews of reviews performed: the overview of the evidence base on an issue, the rapid detection of the results of numerous reviews, the demonstration of evidence gaps and potential savings in time and resources. At the same time, the methodology could lead to a loss of information, limited relevance and to uncertainties regarding the robustness of the overall results. However, the heterogeneity of the methods used shows that the development of methods for overviews of reviews is still ongoing. Whether overviews of reviews provide valuable decision support depends on the research question and realistic expectations towards the method.

[1]  G. Guyatt,et al.  GRADE: an emerging consensus on rating quality of evidence and strength of recommendations , 2008, BMJ : British Medical Journal.

[2]  G H Guyatt,et al.  Agreement among reviewers of review articles. , 1991, Journal of clinical epidemiology.

[3]  W. Gaus Anmerkungen zum Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen (IQWiG) , 2006 .

[4]  M. Clarke,et al.  Methodology in conducting a systematic review of systematic reviews of healthcare interventions , 2011, BMC medical research methodology.

[5]  I. Zechmeister-Koss,et al.  Antenatal interventions to reduce preterm birth: an overview of Cochrane systematic reviews , 2014, BMC Research Notes.

[6]  H. Bastian,et al.  Seventy-Five Trials and Eleven Systematic Reviews a Day: How Will We Ever Keep Up? , 2010, PLoS medicine.

[7]  Jennifer S. Lin,et al.  Integration of Existing Systematic Reviews. Research White Paper (Prepared by the Scientific Resource Center under Contract No. 290-2012-00004-C) , 2014 .

[8]  Dawid Pieper,et al.  Overviews of reviews often have limited rigor: a systematic review. , 2012, Journal of clinical epidemiology.

[9]  L. Hemkens,et al.  Benefit assessment of salt reduction in patients with hypertension: systematic overview , 2011, Journal of hypertension.

[10]  D. Pieper,et al.  Systematic review finds overlapping reviews were not mentioned in every other overview. , 2014, Journal of clinical epidemiology.

[11]  G. Guyatt,et al.  Validation of an index of the quality of review articles. , 1991, Journal of clinical epidemiology.

[12]  I. Zechmeister-Koss,et al.  Affordability of programmes to prevent spontaneous preterm birth in Austria: a budget impact analysis. , 2014, European journal of public health.

[13]  Building blocks for meta-synthesis: data integration tables for summarising, mapping, and synthesising evidence on interventions for communicating with health consumers , 2009, BMC medical research methodology.

[14]  Denise Thomson,et al.  A Descriptive Analysis of Overviews of Reviews Published between 2000 and 2011 , 2012, PloS one.