Abstract reporting in randomized clinical trials of acute lung injury: An audit and assessment of a quality of reporting score*

Objectives:To evaluate the quality of reporting among abstracts of randomized controlled trials (RCTs) in acute lung injury and to highlight important trial information for abstract inclusion. Design:Audit of published RCT abstracts. Sample:A total of 56 RCTs, identified in MEDLINE, EMBASE, HEALTHSTAR, CINAHL, and the Cochrane Central Register of Controlled Trials. Measurements and Main Results:We used a research focus group and published literature on suggested content for abstracts of original articles to generate a list of 32 recommended items. The focus group reduced this list to a 20-item long form list of highly relevant criteria and a 12-item short form list of essential criteria for inclusion in abstracts of RCTs in acute lung injury. After pilot testing the abstract appraisal form, we evaluated abstracts independently and in duplicate. We scored the quality of reporting of each abstract by dividing the number of criteria fulfilled by the number applicable. Although abstracts described the study objectives and interventions well and the participants, outcomes, and conclusions to an intermediate extent, key deficiencies were noted in reporting the study methods, setting, and results. Mean quality of reporting scores were significantly higher for structured compared with unstructured abstracts using the 32-item, 20-item, and 12-item lists (p = .008, .014, and <.0001, respectively), especially for abstracts published after 1990 (p = .004, .017, and .001, respectively). The 20-item and 12-item lists correlated well with the 32-item list (r = .89 and .62, respectively) and with one another (r = .73). Conclusions:Key design features and results are frequently under-reported in RCT abstracts, particularly among unstructured abstracts. Checklists may aid authors and editors in prioritizing important criteria for inclusion in RCT abstracts.

[1]  David Moher,et al.  The CONSORT statement: revised recommendations for improving the quality of reports of parallel group randomized trials , 2001, Annals of Internal Medicine.

[2]  B. Cuthbertson,et al.  Effect of inhaled nitric oxide on key mediators of the inflammatory response in patients with acute lung injury , 2000, Critical care medicine.

[3]  K. Steinberg,et al.  Bovine surfactant therapy for patients with acute respiratory distress syndrome. , 1997, American journal of respiratory and critical care medicine.

[4]  D. Moher,et al.  The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. , 2001, Journal of the American Podiatric Medical Association.

[5]  J. Vincent,et al.  A multi-centre, double-blind, placebo-controlled study of liposomal prostaglandin E1 (TLC C-53) in patients with acute respiratory distress syndrome , 2001, Intensive Care Medicine.

[6]  Karen A Robinson,et al.  Development of a highly sensitive search strategy for the retrieval of reports of controlled trials using PubMed. , 2002, International journal of epidemiology.

[7]  J. Weigelt,et al.  Early steroid therapy for respiratory failure. , 1986, Archives of surgery.

[8]  I. Tannock,et al.  Quality of abstracts describing randomized trials in the proceedings of American Society of Clinical Oncology meetings: guidelines for improved reporting. , 2004, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[9]  J. Costantino,et al.  A randomized, prospective evaluation of noninvasive ventilation for acute respiratory failure. , 2000, American journal of respiratory and critical care medicine.

[10]  L. Nelson,et al.  Liposomal prostaglandin E1 (TLC C-53) in acute respiratory distress syndrome: a controlled, randomized, double-blind, multicenter clinical trial. TLC C-53 ARDS Study Group. , 1999, Critical care medicine.

[11]  Joseph Smith,et al.  Impact of blinded versus unblinded abstract review on scientific program content. , 2002, The Journal of urology.

[12]  F. Gordo,et al.  Prospective randomized trial comparing pressure-controlled ventilation and volume-controlled ventilation in ARDS. For the Spanish Lung Failure Collaborative Group. , 2000, Chest.

[13]  M. Evans,et al.  Trials on trial. A review of trials of antibiotic prophylaxis. , 1984, Archives of surgery.

[14]  N. Black,et al.  Effect of blinding and unmasking on the quality of peer review: a randomized trial. , 1998, JAMA.

[15]  A. Meyer,et al.  Safety and potential efficacy of an aerosolized surfactant in human sepsis-induced adult respiratory distress syndrome. , 1994, JAMA.

[16]  R. F. Johnston,et al.  Recombinant Human Interleukin 1 Receptor Antagonist in the Treatment of Patients With Sepsis Syndrome: Results From a Randomized, Double-blind, Placebo-Controlled Trial , 1994 .

[17]  D. Rennie,et al.  Does masking author identity improve peer review quality? A randomized controlled trial. PEER Investigators. , 1998, JAMA.

[18]  T R Einarson,et al.  Quality of nonstructured and structured abstracts of original research articles in the British Medical Journal, the Canadian Medical Association Journal and the Journal of the American Medical Association. , 1994, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[19]  J Froom,et al.  Deficiencies in structured medical abstracts. , 1993, Journal of clinical epidemiology.

[20]  I. Olkin,et al.  Improving the quality of reporting of randomized controlled trials. The CONSORT statement. , 1996, JAMA.

[21]  F. Godlee,et al.  Effect on the quality of peer review of blinding reviewers and asking them to sign their reports: a randomized controlled trial. , 1998, JAMA.

[22]  Alan H. Morris,et al.  Efficacy of computerized decision support for mechanical ventilation: results of a prospective multi-center randomized trial , 1999, AMIA.

[23]  David M. Shade,et al.  Prospective, randomized, controlled clinical trial comparing traditional versus reduced tidal volume ventilation in acute respiratory distress syndrome patients. , 1999, Critical care medicine.

[24]  M. Antonelli,et al.  Noninvasive ventilation for treatment of acute respiratory failure in patients undergoing solid organ transplantation: a randomized trial. , 2000, JAMA.

[25]  J. Zimmerman,et al.  Effects of inhaled nitric oxide in patients with acute respiratory distress syndrome: results of a randomized phase II trial. Inhaled Nitric Oxide in ARDS Study Group. , 1998, Critical care medicine.

[26]  T. Fabian,et al.  Partial liquid ventilation decreases the inflammatory response in the alveolar environment of trauma patients. , 1997, The Journal of trauma.

[27]  Marc F. Swiontkowski,et al.  An Observational Study of Orthopaedic Abstracts and Subsequent Full-Text Publications , 2002, The Journal of bone and joint surgery. American volume.

[28]  R. Bartlett,et al.  Prospective, randomized, controlled pilot study of partial liquid ventilation in adult acute respiratory distress syndrome. , 2002, American journal of respiratory and critical care medicine.

[29]  C. Sprung,et al.  HA-1A in septic patients with ARDS: Results from the pivotal trial , 1994, Intensive Care Medicine.

[30]  M. Vassar,et al.  Prostaglandin E1 and Survival in Patients with the Adult Respiratory Distress Syndrome: A Prospective Trial , 1986, Annals of surgery.

[31]  P. Suter,et al.  Treatment with N-acetylcysteine during acute respiratory distress syndrome: a randomized, double-blind, placebo-controlled clinical study. , 1997, Journal of critical care.

[32]  J. I. Iribarren Sarrías,et al.  [The administration of 20 ppm of inhaled nitric oxide produces a faster response than the inhalation of 5 ppm in adult respiratory distress syndrome]. , 2000, Revista espanola de anestesiologia y reanimacion.

[33]  A. Anzueto,et al.  Aerosolized Surfactant in Adults with Sepsis-Induced Acute Respiratory Distress Syndrome , 1996 .

[34]  F. Cosentino,et al.  Continuous arteriovenous hemofiltration in the adult respiratory distress syndrome. A randomized trial. , 1991, Contributions to nephrology.

[35]  S. B. Friedman,et al.  The effects of blinding on acceptance of research papers by peer review. , 1994, JAMA.

[36]  Frederick Mosteller,et al.  Reporting on methods in clinical trials. , 1982, The New England journal of medicine.

[37]  S B Thacker,et al.  A proposal for more informative abstracts of review articles. , 1988, Annals of internal medicine.

[38]  S. Barni,et al.  Respiratory distress syndrome in patients with advanced cancer treated with pentoxifylline: a randomized study , 1993, Supportive Care in Cancer.

[39]  G. Meduri,et al.  Effect of prolonged methylprednisolone therapy in unresolving acute respiratory distress syndrome: a randomized controlled trial. , 1998, JAMA.

[40]  Y. Hirata,et al.  Beneficial effect of atrial natriuretic peptide on pulmonary gas exchange in patients with acute lung injury. , 1998, Chest.

[41]  P. Gøtzsche Methodology and overt and hidden bias in reports of 196 double-blind trials of nonsteroidal antiinflammatory drugs in rheumatoid arthritis. , 1989, Controlled clinical trials.

[42]  Gordon H. Guyatt,et al.  Presentation structured abstracts of proposals for clinical and epidemiological studies , 1991 .

[43]  R. Fletcher,et al.  The effects of blinding on the quality of peer review. A randomized trial. , 1990, JAMA.

[44]  Jack Froom,et al.  Presentation Deficiencies in structured medical abstracts , 1993 .

[45]  E. Troncy,et al.  Inhaled nitric oxide in acute respiratory distress syndrome: a pilot randomized controlled study. , 1998, American journal of respiratory and critical care medicine.

[46]  G. Bernard,et al.  A trial of antioxidants N-acetylcysteine and procysteine in ARDS. The Antioxidant in ARDS Study Group. , 1997, Chest.

[47]  K. Falke Randomized clinical trial of pressure-controlled inverse ratio ventilation and extracorporeal CO2 removal for adult respiratory distress syndrome. , 1997, American journal of respiratory and critical care medicine.

[48]  J. Cade,et al.  Prevention of lower respiratory herpes simplex virus infection with acyclovir in patients with adult respiratory distress syndrome. , 1994, Chest.

[49]  T R Einarson,et al.  Quality of abstracts of original research articles in CMAJ in 1989. , 1991, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[50]  J. Saffle,et al.  Inhaled nitric oxide versus conventional therapy: effect on oxygenation in ARDS. , 1998, American journal of respiratory and critical care medicine.

[51]  R. Horton,et al.  Uniform Requirements for Manuscripts Submitted to Biomedical Journals , 1989 .

[52]  S. Lundin,et al.  Inhalation of nitric oxide in acute lung injury: results of a European multicentre study , 1999, Intensive Care Medicine.

[53]  ntonio,et al.  EFFECT OF PRONE POSITIONING ON THE SURVIVAL OF PATIENTS WITH ACUTE RESPIRATORY FAILURE , 2001 .

[54]  Arthur S Slutsky,et al.  Effect of mechanical ventilation on inflammatory mediators in patients with acute respiratory distress syndrome: a randomized controlled trial. , 1999, JAMA.

[55]  T. Einarson,et al.  Quality Assessment of Pharmacoeconomic Abstracts of Original Research Articles in Selected Journals , 1997, The Annals of pharmacotherapy.

[56]  P. Suter,et al.  N-acetylcysteine enhances recovery from acute lung injury in man. A randomized, double-blind, placebo-controlled clinical study. , 1994, Chest.

[57]  S. Pocock,et al.  Statistical problems in the reporting of clinical trials. A survey of three medical journals. , 1987, The New England journal of medicine.

[58]  P. Halushka,et al.  Dazoxiben in human sepsis and adult respiratory distress syndrome , 1985, Clinical pharmacology and therapeutics.

[59]  K. A. McKibbon,et al.  Online access to MEDLINE in clinical settings. A study of use and usefulness. , 1990, Annals of internal medicine.

[60]  P. Herlevsen,et al.  Antioxidant treatment with N‐acetylcysteine during adult respiratory distress syndrome: A prospective, randomized, placebo‐controlled study , 1992, Critical care medicine.

[61]  R. Wunderink,et al.  Filgrastim in patients with pneumonia and severe sepsis or septic shock. , 2001, Chest.

[62]  H. Rubin,et al.  More Informative Abstracts of Articles Describing Clinical Practice Guidelines , 1993, Annals of Internal Medicine.

[63]  F Lemaire,et al.  Treatment of acute hypoxemic nonhypercapnic respiratory insufficiency with continuous positive airway pressure delivered by a face mask: A randomized controlled trial. , 2000, JAMA.

[64]  F Lemaire,et al.  Tidal volume reduction for prevention of ventilator-induced lung injury in acute respiratory distress syndrome. The Multicenter Trail Group on Tidal Volume reduction in ARDS. , 1998, American journal of respiratory and critical care medicine.

[65]  J. Bazin,et al.  Combined nitric oxide inhalation, prone positioning and almitrine infusion improve oxygenation in severe ARDS , 1998, Canadian journal of anaesthesia = Journal canadien d'anesthesie.

[66]  S. Patrick Critical Appraisal of the Medical Literature , 1994 .

[67]  C. Carvalho,et al.  Effect of a protective-ventilation strategy on mortality in the acute respiratory distress syndrome. , 1998, The New England journal of medicine.

[68]  A. Overbeke,et al.  [The structured summary: a tool for reader and author]. , 1990, Nederlands tijdschrift voor geneeskunde.

[69]  M. Gardner,et al.  More informative abstracts revisited. , 1990, The Cleft palate-craniofacial journal : official publication of the American Cleft Palate-Craniofacial Association.

[70]  D. Schuster,et al.  Clinical correlation with changing radiographic appearance during partial liquid ventilation. , 2001, Chest.

[71]  Rupert G. Miller,et al.  Extracorporeal membrane oxygenation in severe acute respiratory failure. A randomized prospective study. , 1979, JAMA.

[72]  Comans Ml,et al.  [The structured summary: a tool for reader and author]. , 1990 .

[73]  R M Pitkin,et al.  Accuracy of data in abstracts of published research articles. , 1999, JAMA.

[74]  J. Fleiss,et al.  Statistical methods for rates and proportions , 1973 .

[75]  G. Guyatt,et al.  Structured abstracts of proposals for clinical and epidemiological studies. , 1991, Journal of clinical epidemiology.

[76]  K. Laczika,et al.  Comparison of prone positioning and continuous rotation of patients with adult respiratory distress syndrome: Results of a pilot study , 2001, Critical care medicine.

[77]  Arthur S Slutsky,et al.  Evaluation of a ventilation strategy to prevent barotrauma in patients at high risk for acute respiratory distress syndrome. Pressure- and Volume-Limited Ventilation Strategy Group. , 1998, The New England journal of medicine.

[78]  M. Knoch,et al.  Progress in Veno-Venous Long-Term Bypass Techniques for the Treatment of Ards , 1992, The International journal of artificial organs.

[79]  C. Sprung,et al.  High-dose corticosteroids in patients with the adult respiratory distress syndrome. , 1987, The New England journal of medicine.