The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration

Editor's Note: In order to encourage dissemination of the PRISMA explanatory paper, this article is freely accessible on the Annals of Internal Medicine, PLoS Medicine, and BMJ Web sites. The authors jointly hold the copyright of this article. For details on further use, see the PRISMA Web site (www.prisma-statement.org). Systematic reviews and meta-analyses are essential tools for summarizing evidence accurately and reliably. They help clinicians keep up-to-date; provide evidence for policy makers to judge risks, benefits, and harms of health care behaviors and interventions; gather together and summarize related research for patients and their carers; provide a starting point for clinical practice guideline developers; provide summaries of previous research for funders wishing to support new research (1); and help editors judge the merits of publishing reports of new studies (2). Recent data suggest that at least 2,500 new systematic reviews reported in English are indexed in MEDLINE annually (3). Unfortunately, there is considerable evidence that key information is often poorly reported in systematic reviews, thus diminishing their potential usefulness (36). As is true for all research, systematic reviews should be reported fully and transparently to allow readers to assess the strengths and weaknesses of the investigation (7). That rationale led to the development of the QUOROM (QUality Of Reporting Of Meta-analysis) Statement; those detailed reporting recommendations were published in 1999 (8). In this paper we describe the updating of that guidance. Our aim is to ensure clear presentation of what was planned, done, and found in a systematic review. Terminology used to describe systematic reviews and meta-analyses has evolved over time and varies across different groups of researchers and authors (see Box 1). In this document we adopt the definitions used by the Cochrane Collaboration (9). A systematic review attempts to collate all empirical evidence that fits pre-specified eligibility criteria to answer a specific research question. It uses explicit, systematic methods that are selected to minimize bias, thus providing reliable findings from which conclusions can be drawn and decisions made. Meta-analysis is the use of statistical methods to summarize and combine the results of independent studies. Many systematic reviews contain meta-analyses, but not all. Box 1. Terminology. The QUOROM Statement and Its Evolution Into PRISMA The QUOROM Statement, developed in 1996 and published in 1999 (8), was conceived as a reporting guidance for authors reporting a meta-analysis of randomized trials. Since then, much has happened. First, knowledge about the conduct and reporting of systematic reviews has expanded considerably. For example, The Cochrane Library's Methodology Register (which includes reports of studies relevant to the methods for systematic reviews) now contains more than 11,000 entries (March 2009). Second, there have been many conceptual advances, such as outcome-level assessments of the risk of bias (10, 11), that apply to systematic reviews. Third, authors have increasingly used systematic reviews to summarize evidence other than that provided by randomized trials. However, despite advances, the quality of the conduct and reporting of systematic reviews remains well short of ideal (36). All of these issues prompted the need for an update and expansion of the QUOROM Statement. Of note, recognizing that the updated statement now addresses the above conceptual and methodological issues and may also have broader applicability than the original QUOROM Statement, we changed the name of the reporting guidance to PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses). Development of PRISMA The PRISMA Statement was developed by a group of 29 review authors, methodologists, clinicians, medical editors, and consumers (12). They attended a three-day meeting in 2005 and participated in extensive post-meeting electronic correspondence. A consensus process that was informed by evidence, whenever possible, was used to develop a 27-item checklist (Table 1; see also Table S1, for a downloadable template checklist for researchers to re-use) and a four-phase flow diagram (Figure 1; see also Figure S1, for a downloadable template document for researchers to re-use). Items deemed essential for transparent reporting of a systematic review were included in the checklist. The flow diagram originally proposed by QUOROM was also modified to show numbers of identified records, excluded articles, and included studies. After 11 revisions the group approved the checklist, flow diagram, and this explanatory paper. Table S1. Template checklist Figure S1. Template document Table 1. Checklist of Items to Include When Reporting a Systematic Review (With or Without Meta-Analysis) Figure 1. Flow of information through the different phases of a systematic review. The PRISMA Statement itself provides further details regarding its background and development (12). This accompanying Explanation and Elaboration document explains the meaning and rationale for each checklist item. A few PRISMA Group participants volunteered to help draft specific items for this document, and four of these (DGA, AL, DM, and JT) met on several occasions to further refine the document, which was circulated and ultimately approved by the larger PRISMA Group. Scope of PRISMA PRISMA focuses on ways in which authors can ensure the transparent and complete reporting of systematic reviews and meta-analyses. It does not address directly or in a detailed manner the conduct of systematic reviews, for which other guides are available (1316). We developed the PRISMA Statement and this explanatory document to help authors report a wide array of systematic reviews to assess the benefits and harms of a health care intervention. We consider most of the checklist items relevant when reporting systematic reviews of non-randomized studies assessing the benefits and harms of interventions. However, we recognize that authors who address questions relating to etiology, diagnosis, or prognosis, for example, and who review epidemiological or diagnostic accuracy studies may need to modify or incorporate additional items for their systematic reviews. How To Use This Paper We modeled this Explanation and Elaboration document after those prepared for other reporting guidelines (1719). To maximize the benefit of this document, we encourage people to read it in conjunction with the PRISMA Statement (11). We present each checklist item and follow it with a published exemplar of good reporting for that item. (We edited some examples by removing citations or Web addresses, or by spelling out abbreviations.) We then explain the pertinent issue, the rationale for including the item, and relevant evidence from the literature, whenever possible. No systematic search was carried out to identify exemplars and evidence. We also include seven Boxes that provide a more comprehensive explanation of certain thematic aspects of the methodology and conduct of systematic reviews. Although we focus on a minimal list of items to consider when reporting a systematic review, we indicate places where additional information is desirable to improve transparency of the review process. We present the items numerically from 1 to 27; however, authors need not address items in this particular order in their reports. Rather, what is important is that the information for each item is given somewhere within the report. The PRISMA Checklist Title and Abstract Item 1: Title Identify the report as a systematic review, meta-analysis, or both. Examples Recurrence rates of video-assisted thoracoscopic versus open surgery in the prevention of recurrent pneumothoraces: a systematic review of randomised and non-randomised trials (20). Mortality in randomized trials of antioxidant supplements for primary and secondary prevention: systematic review and meta-analysis (21). Explanation Authors should identify their report as a systematic review or meta-analysis. Terms such as review or overview do not describe for readers whether the review was systematic or whether a meta-analysis was performed. A recent survey found that 50% of 300 authors did not mention the terms systematic review or meta-analysis in the title or abstract of their systematic review (3). Although sensitive search strategies have been developed to identify systematic reviews (22), inclusion of the terms systematic review or meta-analysis in the title may improve indexing and identification. We advise authors to use informative titles that make key information easily accessible to readers. Ideally, a title reflecting the PICOS approach (participants, interventions, comparators, outcomes, and study design) (see Item 11 and Box 2) may help readers as it provides key information about the scope of the review. Specifying the design(s) of the studies included, as shown in the examples, may also help some readers and those searching databases. Box 2. Helping To Develop the Research Question(s): The PICOS Approach. Some journals recommend indicative titles that indicate the topic matter of the review, while others require declarative titles that give the review's main conclusion. Busy practitioners may prefer to see the conclusion of the review in the title, but declarative titles can oversimplify or exaggerate findings. Thus, many journals and methodologists prefer indicative titles as used in the examples above. Item 2: Structured Summary Provide a structured summary including, as applicable: background; objectives; data sources; study eligibility criteria, participants, and interventions; study appraisal and synthesis methods; results; limitations; conclusions and implications of key findings; funding for the systematic review; and systematic review registration number. Example Context: The role and dose of oral vitamin D supplementation in nonvert

[1]  D. Moher,et al.  Chapter 10: Addressing reporting biases , 2011 .

[2]  J. Higgins Cochrane handbook for systematic reviews of interventions. Version 5.1.0 [updated March 2011]. The Cochrane Collaboration , 2011 .

[3]  M Alan Brookhart,et al.  Meta-analyses involving cross-over trials: methodological issues. , 2011, International journal of epidemiology.

[4]  J. Prego Use of antiemetic agents in acute gastroenteritis: A systematic review and meta-analysis DeCamp LR, Byerley JS, Doshi N, Steiner MJ , 2010 .

[5]  Michele Tarsilla Cochrane Handbook for Systematic Reviews of Interventions , 2010, Journal of MultiDisciplinary Evaluation.

[6]  Howard Balshem,et al.  AHRQ series paper 2: principles for developing guidance: AHRQ and the effective health-care program. , 2010, Journal of clinical epidemiology.

[7]  E. Tacconelli Systematic reviews: CRD's guidance for undertaking reviews in health care , 2010 .

[8]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. , 2010, International journal of surgery.

[9]  V. Torri,et al.  Antibiotic prophylaxis to reduce respiratory tract infections and mortality in adults receiving intensive care. , 2009, The Cochrane database of systematic reviews.

[10]  D. Moher,et al.  Reprint--preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. , 2009, Physical therapy.

[11]  David Moher,et al.  An evidence-based practice guideline for the peer review of electronic search strategies. , 2009, Journal of clinical epidemiology.

[12]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement , 2009, BMJ : British Medical Journal.

[13]  E. Faerstein,et al.  A DICTIONARY OF EPIDEMIOLOGY , 2016 .

[14]  M. Schulzer,et al.  Effect of school-based physical activity interventions on body mass index in children: a meta-analysis , 2009, Canadian Medical Association Journal.

[15]  D. Harnois Meta-analysis: Combination Endoscopic and Drug Therapy to Prevent Variceal Rebleeding in Cirrhosis , 2009 .

[16]  M. Helfand,et al.  Principles for developing guidance: AHRQ and the effective health care program , 2009 .

[17]  C. Merkley Evidence Based Library and Information Practice , 2009 .

[18]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. , 2009, Journal of clinical epidemiology.

[19]  D. Altman,et al.  Assessing Risk of Bias in Included Studies , 2008 .

[20]  David Moher,et al.  Addressing Reporting Biases , 2008 .

[21]  D. Altman,et al.  Chapter 8: Assessing risk of bias in included studies , 2008 .

[22]  Denise O'Connor,et al.  Chapter 5: Defining the review question and developing criteria for including studies , 2008 .

[23]  M. Steiner,et al.  Use of antiemetic agents in acute gastroenteritis: a systematic review and meta-analysis. , 2008, Archives of pediatrics & adolescent medicine.

[24]  J. Ioannidis,et al.  Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias , 2008, PloS one.

[25]  Youping Li,et al.  The reporting quality of meta-analyses improves: a random sampling study. , 2008, Journal of clinical epidemiology.

[26]  J. Zamora,et al.  Meta-analysis: Combination Endoscopic and Drug Therapy to Prevent Variceal Rebleeding in Cirrhosis , 2008, Annals of Internal Medicine.

[27]  Miquel Porta,et al.  A Dictionary of Epidemiology , 2008 .

[28]  Carl Heneghan,et al.  What is missing from descriptions of treatment in trials and reviews? , 2008, BMJ : British Medical Journal.

[29]  Iveta Simera,et al.  Helping editors, peer reviewers and authors improve the clarity, completeness and transparency of reporting health research , 2008, BMC medicine.

[30]  Sally Hopewell,et al.  Reporting of adverse events in systematic reviews can be improved: survey results. , 2008, Journal of clinical epidemiology.

[31]  Georgia Salanti,et al.  Evaluation of networks of randomized trials , 2008, Statistical methods in medical research.

[32]  D. Moher,et al.  Guidelines for Reporting Health Research: The EQUATOR Network's Survey of Guideline Authors , 2008, PLoS medicine.

[33]  Sarah J. Kattau The Wood and the Trees , 2008 .

[34]  G. Guyatt,et al.  GRADE: an emerging consensus on rating quality of evidence and strength of recommendations , 2008, BMJ : British Medical Journal.

[35]  M. Tonelli,et al.  Meta-analysis: Antibiotics for Prophylaxis against Hemodialysis CatheterRelated Infections , 2008, Annals of Internal Medicine.

[36]  E. von Elm,et al.  Publication and non-publication of clinical trials: longitudinal study of applications submitted to a research ethics committee. , 2008, Swiss medical weekly.

[37]  Iveta Simera,et al.  EQUATOR: reporting guidelines for health research , 2008, Open medicine : a peer-reviewed, independent, open-access journal.

[38]  M. Al-mallah,et al.  Safety and tolerability of angiotensin-converting enzyme inhibitor versus the combination of angiotensin-converting enzyme inhibitor and angiotensin receptor blocker in patients with left ventricular dysfunction: a systematic review and meta-analysis of randomized controlled trials. , 2008, Journal of cardiac failure.

[39]  Douglas G. Altman,et al.  Statistical Methods for Examining Heterogeneity and Combining Results from Several Studies in Meta‐Analysis , 2008 .

[40]  Douglas G. Altman,et al.  Effect Measures for Meta‒Analysis of Trials with Binary Outcomes , 2008 .

[41]  L. Leibovici,et al.  Treatment of human brucellosis: systematic review and meta-analysis of randomised controlled trials , 2008, BMJ : British Medical Journal.

[42]  Blair T. Johnson,et al.  Initial Severity and Antidepressant Benefits: A Meta-Analysis of Data Submitted to the Food and Drug Administration , 2008, PLoS medicine.

[43]  R. Rosenthal,et al.  Selective publication of antidepressant trials and its influence on apparent efficacy. , 2008, The New England journal of medicine.

[44]  D. Moher,et al.  CONSORT for Reporting Randomized Controlled Trials in Journal and Conference Abstracts: Explanation and Elaboration , 2008, PLoS medicine.

[45]  T. Wachs,et al.  CONSORT for reporting randomised trials in journal and conference abstracts , 2008 .

[46]  J. Barkin The Use of Aspirin for Primary Prevention of Colorectal Cancer: A Systematic Review Prepared for the U.S. Preventive Services Task Force , 2008 .

[47]  S. Berney Meta-analysis: Chondroitin for Osteoarthritis of the Knee or Hip , 2008 .

[48]  J. Pelletier Chondroitin for osteoarthritis of the knee or hip. , 2007, Annals of internal medicine.

[49]  A. Booth,et al.  Do health technology assessments comply with QUOROM diagram guidance? An empirical study , 2007, BMC medical research methodology.

[50]  Veronica Yank,et al.  Financial ties and concordance between results and conclusions in meta-analyses: retrospective cohort study , 2007, BMJ : British Medical Journal.

[51]  Nikolaos A Patsopoulos,et al.  Uncertainty in heterogeneity estimates in meta-analyses , 2007, BMJ : British Medical Journal.

[52]  S. Pocock,et al.  The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies , 2007, The Lancet.

[53]  F. Bazzoli,et al.  Meta-analysis: Duration of First-Line Proton-Pump InhibitorBased Triple Therapy for Helicobacter pylori Eradication , 2007, Annals of Internal Medicine.

[54]  S. Pocock,et al.  Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and Elaboration , 2007, PLoS medicine.

[55]  B. Thiers Dressings for venous leg ulcers: systematic review and meta-analysis , 2008 .

[56]  K. Shojania,et al.  How Quickly Do Systematic Reviews Go Out of Date? A Survival Analysis , 2007, Annals of Internal Medicine.

[57]  J. Hilden,et al.  Impact of allocation concealment on conclusions drawn from meta-analyses of randomized trials. , 2007, International journal of epidemiology.

[58]  E. Lim,et al.  Recurrence rates of video-assisted thoracoscopic versus open surgery in the prevention of recurrent pneumothoraces: a systematic review of randomised and non-randomised trials , 2007, The Lancet.

[59]  Peter C Gøtzsche,et al.  Data extraction errors in meta-analyses that use standardized mean differences. , 2007, JAMA.

[60]  D. Cook,et al.  Surfactant therapy for acute respiratory failure in children: a systematic review and meta-analysis , 2007, Critical care.

[61]  M. Sydes,et al.  Practical methods for incorporating summary time-to-event data into meta-analysis , 2007, Trials.

[62]  J. Ioannidis,et al.  An exploratory test for an excess of significant findings , 2007, Clinical trials.

[63]  J. Higgins,et al.  Tools for assessing quality and susceptibility to bias in observational studies in epidemiology: a systematic review and annotated bibliography. , 2007, International journal of epidemiology.

[64]  E. von Elm,et al.  Full publication of results initially presented in abstracts. , 2007, The Cochrane database of systematic reviews.

[65]  M Egger,et al.  Grey literature in meta-analyses of randomized trials of health care interventions. , 2007, The Cochrane database of systematic reviews.

[66]  Thomas A Trikalinos,et al.  The appropriateness of asymmetry tests for publication bias in meta-analyses: a large survey , 2007, Canadian Medical Association Journal.

[67]  E. Winer,et al.  Association between pharmaceutical involvement and outcomes in breast cancer clinical trials , 2007, Cancer.

[68]  M. Clarke,et al.  How useful are Cochrane reviews in identifying research needs? , 2007, Journal of health services research & policy.

[69]  M. Clarke,et al.  Reports of clinical trials should begin and end with up-to-date systematic reviews of other relevant evidence: a status report , 2007, Journal of the Royal Society of Medicine.

[70]  David Moher,et al.  Epidemiology and Reporting Characteristics of Systematic Reviews , 2007, PLoS medicine.

[71]  Christian Gluud,et al.  Mortality in randomized trials of antioxidant supplements for primary and secondary prevention: systematic review and meta-analysis. , 2007, JAMA.

[72]  Wolfgang Viechtbauer,et al.  Publication bias in meta-analysis: Prevention, assessment and adjustments , 2007, Psychometrika.

[73]  Douglas G Altman,et al.  Ghost Authorship in Industry-Initiated Randomised Trials , 2007, PLoS medicine.

[74]  P. Major,et al.  Benchmarking of reported search and selection methods of systematic reviews by dental speciality , 2007, Evidence-Based Dentistry.

[75]  A Eisinga,et al.  Compression stockings for preventing deep vein thrombosis in airline passengers. , 2006, The Cochrane database of systematic reviews.

[76]  J. Lau,et al.  Effectiveness of Management Strategies for Renal Artery Stenosis: A Systematic Review , 2006, Annals of Internal Medicine.

[77]  Li Zhang,et al.  Reporting of the Role of the Expert Searcher in Cochrane Reviews , 2006 .

[78]  T. Peters,et al.  Effects of n-3 long-chain polyunsaturated fatty acids on depressed mood: systematic review of published trials. , 2006, The American journal of clinical nutrition.

[79]  Roger M Harbord,et al.  A modified test for small‐study effects in meta‐analyses of controlled trials with binary endpoints , 2006, Statistics in medicine.

[80]  C. André,et al.  Rimonabant for overweight or obesity. , 2006, The Cochrane database of systematic reviews.

[81]  P. Mistiaen,et al.  Telephone follow-up, initiated by a hospital-based health professional, for postdischarge problems in patients discharged from hospital to home. , 2006, The Cochrane database of systematic reviews.

[82]  Peter C Gøtzsche,et al.  Cochrane reviews compared with industry supported meta-analyses and other meta-analyses of the same drugs: systematic review , 2006, BMJ : British Medical Journal.

[83]  I. Olkin,et al.  The case of the misleading funnel plot , 2006, BMJ : British Medical Journal.

[84]  P. Major,et al.  An evaluation of search and selection methods used in dental systematic reviews published in English. , 2006, Journal of the American Dental Association.

[85]  D. Moher,et al.  Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review , 2006, The Medical journal of Australia.

[86]  P. Major,et al.  Search and selection methodology of systematic reviews in orthodontics (2000-2004). , 2006, American journal of orthodontics and dentofacial orthopedics : official publication of the American Association of Orthodontists, its constituent societies, and the American Board of Orthodontics.

[87]  Peter C Gøtzsche,et al.  Believability of relative risks and odds ratios in abstracts: cross sectional study , 2006, BMJ : British Medical Journal.

[88]  V. Montori,et al.  Testosterone use in men and its effects on bone health. A systematic review and meta-analysis of randomized placebo-controlled trials. , 2006, Journal of Clinical Endocrinology and Metabolism.

[89]  Tania B. Huedo-Medina,et al.  Assessing heterogeneity in meta-analysis: Q statistic or I2 index? , 2006, Psychological methods.

[90]  M. Borenstein,et al.  Publication Bias in Meta-Analysis: Prevention, Assessment and Adjustments , 2006 .

[91]  Kay Dickersin,et al.  Publication Bias: Recognizing the Problem, Understanding Its Origins and Scope, and Preventing Harm , 2006 .

[92]  J. D. de Lemos,et al.  Effects of early treatment with statins on short-term clinical outcomes in acute coronary syndromes: a meta-analysis of randomized controlled trials. , 2006, JAMA.

[93]  Ben Vandermeer,et al.  A systematic review identifies a lack of standardization in methods for handling missing variance data. , 2006, Journal of clinical epidemiology.

[94]  P. Armstrong,et al.  Transition from meeting abstract to full-length journal article for randomized controlled trials. , 2006, JAMA.

[95]  L. Gluud Bias in clinical intervention research. , 2006, American journal of epidemiology.

[96]  S. Golder,et al.  Developing efficient search strategies to identify reports of adverse effects in MEDLINE and EMBASE. , 2006, Health information and libraries journal.

[97]  Russell E. Glasgow,et al.  Evaluating the Relevance, Generalization, and Applicability of Research , 2006, Evaluation & the health professions.

[98]  A. Sutton,et al.  Comparison of two methods to detect publication bias in meta-analysis. , 2006, JAMA.

[99]  F. McAlister,et al.  Acetylcysteine in the prevention of contrast-induced nephropathy: a case study of the pitfalls in the evolution of evidence. , 2006, Archives of internal medicine.

[100]  E. Romagnoli,et al.  Compliance with QUOROM and quality of reporting of overlapping meta-analyses on the role of acetylcysteine in the prevention of contrast associated nephropathy: case study , 2006, BMJ : British Medical Journal.

[101]  D. Ghersi Issues in the design, conduct and reporting of clinical trials that impact on the quality of decision making , 2006 .

[102]  Douglas G. Altman,et al.  Elaboración de directrices para la publicación de investigación biomédica: proceso y fundamento científico , 2005 .

[103]  J. Critchley,et al.  Haemoglobin colour scale for anaemia diagnosis where there is no laboratory: a systematic review. , 2005, International journal of epidemiology.

[104]  W. Moss,et al.  Safety and efficacy of zinc supplementation for children with HIV-1 infection in South Africa: a randomised double-blind placebo-controlled trial , 2005, The Lancet.

[105]  J. Ioannidis,et al.  Local Literature Bias in Genetic Epidemiology: An Empirical Evaluation of the Chinese Literature , 2005, PLoS medicine.

[106]  Gordon H Guyatt,et al.  Randomized trials stopped early for benefit: a systematic review. , 2005, JAMA.

[107]  How Strong Is the Evidence for the Use of Perioperative &bgr; Blockers in Noncardiac Surgery? Systematic Review and Meta-Analysis of Randomized Controlled Trials , 2005 .

[108]  Vic Hasselblad,et al.  Impact of the pulmonary artery catheter in critically ill patients: meta-analysis of randomized clinical trials. , 2005, JAMA.

[109]  D. Altman,et al.  Outcome selection bias in meta-analysis , 2005, Statistical methods in medical research.

[110]  Douglas G Altman,et al.  Bayesian random effects meta‐analysis of trials with binary outcomes: methods for the absolute risk difference and relative risk scales by D. E. Warn, S. G. Thompson and D. J. Spiegelhalter, Statistics in Medicine 2002; 21: 1601–1623 , 2005, Statistics in medicine.

[111]  Anthony Delaney,et al.  A systematic evaluation of the quality of meta-analyses in the critical care literature , 2005, Critical care.

[112]  Christopher H Schmid,et al.  In an empirical evaluation of the funnel plot, researchers could not visually identify publication bias. , 2005, Journal of clinical epidemiology.

[113]  Richard Horton,et al.  Putting clinical trials into context , 2005, The Lancet.

[114]  Gordon H Guyatt,et al.  How strong is the evidence for the use of perioperative β blockers in non-cardiac surgery? Systematic review and meta-analysis of randomised controlled trials , 2005, BMJ : British Medical Journal.

[115]  Paula R Williamson,et al.  High prevalence but low impact of data extraction and reporting errors were found in Cochrane systematic reviews. , 2005, Journal of clinical epidemiology.

[116]  Trisha Greenhalgh,et al.  Storylines of research in diffusion of innovation: a meta-narrative approach to systematic review. , 2005, Social science & medicine.

[117]  T. Greenhalgh,et al.  Realist review - a new method of systematic review designed for complex policy interventions , 2005, Journal of health services research & policy.

[118]  David Atkins,et al.  Better Information for Better Health Care: The Evidence-based Practice Center Program and the Agency for Healthcare Research and Quality , 2005, Annals of Internal Medicine.

[119]  C. Gamble,et al.  Identification and impact of outcome selection bias in meta‐analysis , 2005, Statistics in medicine.

[120]  Bess Dawson-Hughes,et al.  Fracture prevention with vitamin D supplementation: a meta-analysis of randomized controlled trials. , 2005, JAMA.

[121]  Matthew E Falagas,et al.  From conference abstract to full paper: differences between data presented in conferences and journals , 2005, FASEB journal : official publication of the Federation of American Societies for Experimental Biology.

[122]  Alessandro Liberati,et al.  Assessment of methodological quality of primary studies by systematic reviews: results of the metaquality cross sectional study , 2005, BMJ : British Medical Journal.

[123]  D. Cook,et al.  Evaluating Meta-analyses in the General Surgical Literature: A Critical Appraisal , 2005, Annals of surgery.

[124]  D. Altman,et al.  Identifying outcome reporting bias in randomised trials on PubMed: review of publications and survey of authors , 2005, BMJ : British Medical Journal.

[125]  Simon G Thompson,et al.  Can meta-analysis help target interventions at individuals most likely to benefit? , 2005, The Lancet.

[126]  Stefan Michiels,et al.  Meta-analysis when only the median survival times are known: A comparison with individual patient data results , 2005, International Journal of Technology Assessment in Health Care.

[127]  G. Guyatt,et al.  “Double blind, you are the weakest link — goodbye!” , 2002, ACP journal club.

[128]  A. Prentice,et al.  Non-steroidal anti-inflammatory drugs for pain in women with endometriosis. , 2005, The Cochrane database of systematic reviews.

[129]  D. Moher,et al.  [Developing guidelines for reporting healthcare research: scientific rationale and procedures]. , 2005, Medicina clinica.

[130]  A. Webster,et al.  Antiviral medications for preventing cytomegalovirus disease in solid organ transplant recipients. , 2005, The Cochrane database of systematic reviews.

[131]  J M Grimshaw,et al.  Interventions to improve outpatient referrals from primary care to secondary care. , 2005, The Cochrane database of systematic reviews.

[132]  E. Ventureyra,et al.  Radioisotope shuntograms at the Children’s Hospital of Eastern Ontario , 2005, Child's Nervous System.

[133]  P. Grossman,et al.  Mindfulness-based stress reduction and health benefits. A meta-analysis. , 2004, Journal of psychosomatic research.

[134]  M. Briel,et al.  Effects of statins on stroke prevention in patients with and without coronary heart disease: a meta-analysis of randomized controlled trials. , 2004, The American journal of medicine.

[135]  R. Haynes,et al.  Optimal search strategies for retrieving systematic reviews from Medline: analytical survey , 2004, BMJ : British Medical Journal.

[136]  Gordon H Guyatt,et al.  An observational study found that authors of randomized controlled trials frequently use concealment of randomization and blinding, despite the failure to report these methods. , 2004, Journal of clinical epidemiology.

[137]  J. Ioannidis,et al.  Radiotherapy vs. nonsteroidal anti-inflammatory drugs for the prevention of heterotopic ossification after major hip procedures: a meta-analysis of randomized trials. , 2004, International journal of radiation oncology, biology, physics.

[138]  John P A Ioannidis,et al.  Availability of large-scale evidence on specific harms from systematic reviews of randomized trials. , 2004, The American journal of medicine.

[139]  L. Fallowfield,et al.  Epoetin alfa improves quality of life in patients with cancer , 2004, Cancer.

[140]  J. Lau,et al.  Insulin therapy for critically ill hospitalized patients: a meta-analysis of randomized controlled trials. , 2004, Archives of internal medicine.

[141]  D. Altman,et al.  Outcome reporting bias in randomized trials funded by the Canadian Institutes of Health Research , 2004, Canadian Medical Association Journal.

[142]  J. Bensing,et al.  Psychosocial interventions for patients with advanced cancer – a systematic review of the literature , 2004, British Journal of Cancer.

[143]  S. Taback,et al.  Hepatitis B vaccination for patients with chronic renal failure. , 2004, The Cochrane database of systematic reviews.

[144]  M. Maglione,et al.  Pharmacological and surgical treatment of obesity. , 2004, Evidence report/technology assessment.

[145]  K. Broadley,et al.  Systematic review of bisphosphonates for hypercalcaemia of malignancy , 2004, Palliative medicine.

[146]  Paul Landais,et al.  Meta-regression detected associations between heterogeneous treatment effects and study-level, but not patient-level, factors. , 2004, Journal of clinical epidemiology.

[147]  Julian P T Higgins,et al.  Controlling the risk of spurious findings from meta‐regression , 2004, Statistics in medicine.

[148]  A. Hrõbjartsson,et al.  Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. , 2004, JAMA.

[149]  Erik von Elm,et al.  Different patterns of duplicate publication: an analysis of articles used in systematic reviews. , 2004, JAMA.

[150]  T. Einarson,et al.  Quality assessment of meta-analyses of RCTs of pharmacotherapy in major depressive disorder , 2004, Current medical research and opinion.

[151]  B. Djulbegovic,et al.  Bad reporting does not mean bad methods for randomised trials: observational study of randomised controlled trials performed by the Radiation Therapy Oncology Group , 2004, BMJ : British Medical Journal.

[152]  Christiane,et al.  World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. , 2004, Journal international de bioethique = International journal of bioethics.

[153]  A. Hrõbjartsson,et al.  Placebo interventions for all clinical conditions. , 2004, The Cochrane database of systematic reviews.

[154]  P. Gøtzsche,et al.  Multiple publication of reports of drug trials , 2004, European Journal of Clinical Pharmacology.

[155]  D. Altman,et al.  Measuring inconsistency in meta-analyses , 2003, BMJ : British Medical Journal.

[156]  Christian Gluud,et al.  Association of funding and conclusions in randomized drug trials: a reflection of treatment effect or adverse events? , 2003, JAMA.

[157]  Ian F Tannock,et al.  Factors associated with failure to publish large randomized trials presented at an oncology meeting. , 2003, JAMA.

[158]  B. Beermann,et al.  Evidence b(i)ased medicine—selective reporting from studies sponsored by pharmaceutical industry: review of studies in new drug applications , 2003, BMJ : British Medical Journal.

[159]  B. Djulbegovic,et al.  Pharmaceutical industry sponsorship and research outcome and quality: systematic review , 2003, BMJ : British Medical Journal.

[160]  David Moher,et al.  The STARD Statement for Reporting Studies of Diagnostic Accuracy: Explanation and Elaboration , 2003, Annals of Internal Medicine [serial online].

[161]  D. Rennie,et al.  The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. , 2003, Annals of internal medicine.

[162]  T. Lumley Network meta‐analysis for indirect treatment comparisons , 2002, Statistics in medicine.

[163]  John P A Ioannidis,et al.  Commentary: meta-analysis of individual participants' data in genetic epidemiology. , 2002, American journal of epidemiology.

[164]  Phil Edwards,et al.  Identification of randomized controlled trials in systematic reviews: accuracy and reliability of screening records , 2002, Statistics in medicine.

[165]  Jonathan J Deeks,et al.  Issues in the selection of a summary statistic for meta‐analysis of clinical trials with binary outcomes , 2002, Statistics in medicine.

[166]  S. Thompson,et al.  Quantifying heterogeneity in a meta‐analysis , 2002, Statistics in medicine.

[167]  S. Thompson,et al.  How should meta‐regression analyses be undertaken and interpreted? , 2002, Statistics in medicine.

[168]  Ethan M Balk,et al.  Correlation of quality measures with estimates of treatment effect in meta-analyses of randomized controlled trials. , 2002, JAMA.

[169]  Sally Hopewell,et al.  Publishing protocols of systematic reviews: comparing what was done to what was planned. , 2002, JAMA.

[170]  D. Fong,et al.  Users' Guides to the Medical Literature , 2002 .

[171]  G. Guyatt,et al.  “Double blind, you are the weakest link — goodbye!” , 2002, ACP journal club.

[172]  Marc F. Swiontkowski,et al.  An Observational Study of Orthopaedic Abstracts and Subsequent Full-Text Publications , 2002, The Journal of bone and joint surgery. American volume.

[173]  Peter Jüni,et al.  Direction and impact of language bias in meta-analyses of controlled trials: empirical study. , 2002, International journal of epidemiology.

[174]  Wolzt,et al.  World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. , 2003, The Journal of the American College of Dentists.

[175]  A Donner,et al.  Meta‐analyses in systematic reviews of randomized controlled trials in perinatal medicine: comparison of fixed and random effects models , 2001, Statistics in medicine.

[176]  R M Turner,et al.  Multilevel models for meta-analysis, and their application to absolute risk differences , 2001, Statistical methods in medical research.

[177]  S Greenland,et al.  On the bias produced by quality scores in meta-analysis, and a hierarchical view of proposed solutions. , 2001, Biostatistics.

[178]  P Middleton,et al.  Quality of Cochrane reviews: assessment of sample from 1998 , 2001, BMJ : British Medical Journal.

[179]  M. Clarke,et al.  METHODOLOGISTS AND THEIR METHODS , 2001, International Journal of Technology Assessment in Health Care.

[180]  J. Sterne,et al.  Funnel plots for detecting bias in meta-analysis: guidelines on choice of axis. , 2001, Journal of clinical epidemiology.

[181]  R. Boruch,et al.  The Campbell Collaboration , 2001, BMJ : British Medical Journal.

[182]  F. V. van Tiel,et al.  Relationship between methodological trial quality and the effects of selective digestive decontamination on pneumonia and mortality in critically ill patients. , 2001, JAMA.

[183]  Steff Lewis,et al.  Forest plots: trying to see the wood and the trees , 2001, BMJ : British Medical Journal.

[184]  D. Moher,et al.  The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration , 2001, Annals of Internal Medicine.

[185]  N. N. Available World medical association declaration of Helsinki , 2000, Chinese Journal of Integrative Medicine.

[186]  D. Cook,et al.  Assessing the Quality of Reports of Randomised Trials Included in Meta-Analyses: Attitudes, Practice, Evidence and Guides , 2001 .

[187]  L. Dans,et al.  Intravenous immunoglobulin for treating sepsis and septic shock. , 2002, The Cochrane database of systematic reviews.

[188]  J L Hutton,et al.  Assessing the potential for bias in meta-analysis due to selective reporting of subgroup analyses within studies. , 2000, Statistics in medicine.

[189]  I. Olkin,et al.  Improving the Quality of Reports of Meta-Analyses of Randomised Controlled Trials: The QUOROM Statement , 2000, Oncology Research and Treatment.

[190]  John E. Hunter,et al.  Fixed Effects vs. Random Effects Meta‐Analysis Models: Implications for Cumulative Research Knowledge , 2000 .

[191]  J Hartley,et al.  Clarifying the abstracts of systematic literature reviews. , 2000, Bulletin of the Medical Library Association.

[192]  P. Gøtzsche,et al.  Why we need a broad perspective on meta-analysis , 2000, BMJ : British Medical Journal.

[193]  A R Jadad,et al.  What contributions do languages other than English make on the results of meta-analyses? , 2000, Journal of clinical epidemiology.

[194]  Alex J. Sutton,et al.  Publication and related biases: a review , 2000 .

[195]  I Olkin,et al.  Heterogeneity and statistical significance in meta-analysis: an empirical study of 125 meta-analyses. , 2000, Statistics in medicine.

[196]  G. Guyatt,et al.  Percutaneous transluminal coronary angioplasty versus medical treatment for non-acute coronary heart disease: meta-analysis of randomised controlled trials , 2000, BMJ : British Medical Journal.

[197]  David R. Jones,et al.  Empirical assessment of effect of publication bias on meta-analyses , 2000, BMJ : British Medical Journal.

[198]  A J Sutton,et al.  Publication and related biases. , 2000, Health technology assessment.

[199]  S. Golder,et al.  The effectiveness and cost-effectiveness of prophylactic removal of wisdom teeth. , 2000, Health technology assessment.

[200]  M. McDonagh,et al.  A Systematic Review of Public Water Fluoridation , 2000 .

[201]  I. Olkin,et al.  Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement , 1999, The Lancet.

[202]  M. Egger,et al.  The hazards of scoring the quality of clinical trials for meta-analysis. , 1999, JAMA.

[203]  D. Cook,et al.  Assessing the quality of reports of randomised trials: implications for the conduct of meta-analyses. , 1999, Health technology assessment.

[204]  A D Oxman,et al.  The unpredictability paradox: review of empirical comparisons of randomised and non-randomised clinical trials , 1998, BMJ.

[205]  V Torri,et al.  Effectiveness of antibiotic prophylaxis in critically ill adult patients: systematic review of randomised controlled trials , 1998, BMJ.

[206]  J P Vandenbroucke,et al.  Bias in meta-analysis detected by a simple, graphical test , 1998 .

[207]  Christopher H Schmid,et al.  Summing up evidence: one answer is not always enough , 1998, The Lancet.

[208]  George Davey Smith,et al.  meta-analysis bias in location and selection of studies , 1998 .

[209]  M. Egger,et al.  Bias in location and selection of studies. , 1998, BMJ.

[210]  David R. Jones,et al.  Systematic reviews of trials and other studies. , 1998, Health technology assessment.

[211]  M. Tramèr,et al.  Impact of covert duplicate publication on meta-analysis: a case study , 1997, BMJ.

[212]  C. Counsell,et al.  Formulating Questions and Locating Primary Studies for Inclusion in Systematic Reviews , 1997, Annals of Internal Medicine.

[213]  C. Lengeler,et al.  Language bias in randomised controlled trials published in English and German , 1997, The Lancet.

[214]  Jesse A Berlin,et al.  Does blinding of readers affect the results of meta-analyses? , 1997, The Lancet.

[215]  D. Cook,et al.  A guide to interpreting discordant systematic reviews. , 1997, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[216]  James Hartley,et al.  Obtaining information accurately and quickly: are structured abstracts more efficient? , 1996, J. Inf. Sci..

[217]  A R Jadad,et al.  Assessing the Quality of Randomized Controlled Trials: Current Issues and Future Directions , 1996, International Journal of Technology Assessment in Health Care.

[218]  K W Kizer,et al.  From the Veterans Health Administration. , 1996, JAMA.

[219]  A R Jadad,et al.  Assessing the quality of reports of randomized clinical trials: is blinding necessary? , 1996, Controlled clinical trials.

[220]  G. Guyatt,et al.  Stress ulcer prophylaxis in critically ill patients. Resolving discordant meta-analyses. , 1996, JAMA.

[221]  M. Gardner,et al.  More informative abstracts revisited. , 1990, The Cleft palate-craniofacial journal : official publication of the American Cleft Palate-Craniofacial Association.

[222]  L. Stewart,et al.  Practical methodology of meta-analyses (overviews) using updated individual patient data. Cochrane Working Group. , 1995, Statistics in medicine.

[223]  A R Jadad,et al.  Assessing the quality of randomized controlled trials: an annotated bibliography of scales and checklists. , 1995, Controlled clinical trials.

[224]  G. Grégoire,et al.  Selecting the language of the publications included in a meta-analysis: is there a Tower of Babel bias? , 1995, Journal of clinical epidemiology.

[225]  S Greenland,et al.  Invited commentary: a critical look at some popular meta-analytic methods. , 1994, American journal of epidemiology.

[226]  T R Einarson,et al.  Quality of nonstructured and structured abstracts of original research articles in the British Medical Journal, the Canadian Medical Association Journal and the Journal of the American Medical Association. , 1994, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[227]  G. Guyatt,et al.  The Science of Reviewing Research a , 1993, Annals of the New York Academy of Sciences.

[228]  Jack Froom,et al.  Presentation Deficiencies in structured medical abstracts , 1993 .

[229]  J. Fleiss,et al.  The statistical basis of meta-analysis. , 1993, Statistical methods in medical research.

[230]  J Froom,et al.  Deficiencies in structured medical abstracts. , 1993, Journal of clinical epidemiology.

[231]  G. Guyatt,et al.  Users' guides to the medical literature. , 1993, JAMA.

[232]  F. Mosteller,et al.  A comparison of results of meta-analyses of randomized control trials and recommendations of clinical experts. Treatments for myocardial infarction. , 1992, JAMA.

[233]  U. Ravnskov,et al.  Cholesterol lowering trials in coronary heart disease: frequency of citation and outcome. , 1992, BMJ.

[234]  J. Cutler,et al.  Variance imputation for overviews of clinical trials with continuous response. , 1992, Journal of clinical epidemiology.

[235]  STRESS ULCER PROPHYLAXIS IN CRITICALLY ILL PATIENTS , 1989, The Lancet.

[236]  Harris Cooper,et al.  Influences on the Outcome of Literature Searches for Integrative Research Reviews , 1989 .

[237]  S B Thacker,et al.  A proposal for more informative abstracts of review articles. , 1988, Annals of internal medicine.

[238]  S. Pocock,et al.  Statistical problems in the reporting of clinical trials. A survey of three medical journals. , 1987, The New England journal of medicine.

[239]  T. Chalmers,et al.  Meta-analyses of randomized controlled trials. , 1987, The New England journal of medicine.

[240]  N. Laird,et al.  Meta-analysis in clinical trials. , 1986, Controlled clinical trials.

[241]  A Liberati,et al.  A quality assessment of randomized control trials of primary treatment of breast cancer. , 1986, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[242]  Randomized controlled trials in perinatal medicine , 1983 .

[243]  D. Sackett,et al.  Controversy in counting and attributing events in clinical trials. , 1979, The New England journal of medicine.

[244]  Douglas G. Altman,et al.  Explanation and Elaboration , 2022 .