BackgroundCochrane systematic reviews aim to provide readers with the most up-to-date evidence on the effects of healthcare interventions. The policy of updating Cochrane reviews every two years consumes valuable time and resources and may not be appropriate for all reviews. The objective of this study was to examine the effect of updating Cochrane systematic reviews over a four year period.MethodsThis descriptive study examined all completed systematic reviews in the Cochrane Database of Systematic Reviews (CDSR) Issue 2, 1998. The latest version of each of these reviews was then identified in CDSR Issue 2, 2002 and changes in the review were described. For reviews that were updated within this time period and had additional studies, we determined whether their conclusion had changed and if there were factors that were predictive of this change.ResultsA total of 377 complete reviews were published in CDSR Issue 2, 1998. In Issue 2, 2002, 14 of these reviews were withdrawn and one was split, leaving 362 reviews to examine for the purpose of this study. Of these reviews, 254 (70%) were updated. Of these updated reviews, 23 (9%) had a change in conclusion. Both an increase in precision and a change in statistical significance of the primary outcome were predictive of a change in conclusion of the review.ConclusionThe concerns around a lack of updating for some reviews may not be justified considering the small proportion of updated reviews that resulted in a changed conclusion. A priority-setting approach to the updating of Cochrane systematic reviews may be more appropriate than a time-based approach. Updating all reviews as frequently as every two years may not be necessary, however some reviews may need to be updated more often than every two years.
[1]
Sally Hopewell,et al.
Publishing protocols of systematic reviews: comparing what was done to what was planned.
,
2002,
JAMA.
[2]
Cindy Farquhar,et al.
3 The Cochrane Library
,
1996
.
[3]
R. Newcombe,et al.
Interval estimation for the difference between independent proportions: comparison of eleven methods.
,
1998,
Statistics in medicine.
[4]
D. Moher,et al.
Identifying null meta-analyses that are ripe for updating
,
2003,
BMC medical research methodology.
[5]
B. Haynes,et al.
Systematic Reviews: Reporting, updating, and correcting systematic reviews of the effects of health care
,
1994
.
[6]
L. Stewart,et al.
Time to publication for results of clinical trials.
,
2007,
The Cochrane database of systematic reviews.