Registration and design alterations of clinical trials in critical care: a cross-sectional observational study

PurposeIn 2005 the International Committee of Medical Journal Editors issued a requirement that all randomized controlled trials (RCTs) be registered primarily to prevent selective reporting (publication bias). However, registries allow for alterations in study protocol. Changes occurring before (or after) study completion could invalidate the original study intent, leading to publication of misleading conclusions. In RCTs involving critically ill patients, these concerns may be particularly acute because mortality is high and conditions investigated are usually syndromes rather than specific diseases. This study was conducted to estimate the registration rate of RCTs in critical care; and, among registered RCTs, to determine timing of registration and whether sample size or primary outcome were altered.MethodsWe searched the MEDLINE database for RCTs that began after or continued through July 2005. We determined whether each trial had been registered and, for registered trials, compared registry data to data in the published manuscript.ResultsApproximately two-thirds (66 %) of trials were registered. Of these, 66 % of registrations occurred after enrolment had commenced. Overall, 6 % (5/90) of trials appropriately registered a sample size which was unchanged from the interval between registration and publication, and only 12 % (11/90) reported primary outcomes that were both appropriately registered and unchanged.ConclusionsNon-registration, or registration after trial initiation, are common in RCTs of critically ill patients. Among registered trials important protocol changes are often made between trial commencement and publication. This study identifies and quantifies the extent of this serious—but correctable—problem for RCTs in critically ill patients.

[1]  P. Pronovost,et al.  Depressive symptoms and impaired physical function after acute lung injury: a 2-year longitudinal study. , 2012, American journal of respiratory and critical care medicine.

[2]  S. Zanotti-Cavazzoni Long-term Cognitive Impairment and Functional Disability Among Survivors of Severe Sepsis , 2011 .

[3]  M. Rovers,et al.  Comparison of Registered and Published Primary Outcomes in Randomized Clinical Trials of Surgical Interventions , 2013, Annals of surgery.

[4]  S. Aberegg,et al.  Delta inflation: a bias in the design of randomized controlled trials in critical care medicine , 2010, Critical care.

[5]  Shannon S Carson,et al.  One-Year Trajectories of Care and Resource Utilization for Recipients of Prolonged Mechanical Ventilation , 2010, Annals of Internal Medicine.

[6]  T C Chalmers,et al.  Randomized versus historical controls for clinical trials. , 1982, The American journal of medicine.

[7]  M. Strosberg,et al.  Protecting Participants of Clinical Trials Conducted in the Intensive Care Unit , 2011, Journal of intensive care medicine.

[8]  Nicholas C. Ide,et al.  Trial Registration at ClinicalTrials.gov between May and October 2005. , 2005, The New England journal of medicine.

[9]  H. Silverman Protecting Vulnerable Research Subjects in Critical Care Trials: Enhancing the Informed Consent Process and Recommendations for Safeguards , 2011, Annals of intensive care.

[10]  G. Guyatt,et al.  Stopping randomized trials early for benefit and estimation of treatment effects: systematic review and meta-regression analysis. , 2010, JAMA.

[11]  J. Kirk-Bayley,et al.  Functional Disability 5 Years after Acute Respiratory Distress Syndrome , 2011 .

[12]  W. Silverman Personal reflections on lessons learned from randomized trials involving newborn infants from 1951 to 1967 , 2004, Clinical trials.

[13]  David Moher,et al.  Poor Reporting of Scientific Leadership Information in Clinical Trial Registers , 2008, PloS one.

[14]  Matthias Briel,et al.  Early stopping of randomized clinical trials for overt efficacy is problematic. , 2008, Journal of clinical epidemiology.

[15]  Toshimitsu Hamasaki,et al.  Sample size determination in clinical trials with multiple co‐primary binary endpoints , 2010, Statistics in medicine.

[16]  David Moher,et al.  Comparison of registered and published primary outcomes in randomized controlled trials. , 2009, JAMA.

[17]  George Tomlinson,et al.  Has mortality from acute respiratory distress syndrome decreased over time?: A systematic review. , 2009, American journal of respiratory and critical care medicine.

[18]  B. Thombs,et al.  Transparency of outcome reporting and trial registration of randomized controlled trials in top psychosomatic and behavioral health journals: A systematic review. , 2011, Journal of psychosomatic research.

[19]  S. Halpern Prospective preference assessment: a method to enhance the ethics and efficiency of randomized controlled trials. , 2002, Controlled clinical trials.

[20]  John Hoey,et al.  Clinical trial registration: a statement from the International Committee of Medical Journal Editors. , 2004, JAMA.

[21]  Nicole M. Benson,et al.  Long-term acute care hospital utilization after critical illness. , 2010, JAMA.

[22]  O. Kirillova Results and Outcome Reporting In ClinicalTrials.gov, What Makes it Happen? , 2012, PloS one.

[23]  J. Vincent,et al.  Multicenter, randomized, controlled trials evaluating mortality in intensive care: Doomed to fail? , 2008, Critical care medicine.

[24]  T. Iwashyna Survivorship Will Be the Defining Challenge of Critical Care in the 21st Century , 2010, Annals of Internal Medicine.

[25]  H. Silverman The Acute Respiratory Distress Syndrome Network controversy: lessons and legacy , 2004, Current opinion in critical care.