Time to stop randomized and large pragmatic trials for intensive care medicine syndromes: the case of sepsis and acute respiratory distress syndrome.

In this paper we discuss the limitations of large randomized controlled trials with mortality endpoints in patients with critical illness associated diagnoses such as sepsis. When patients with the same syndrome diagnosis do not share the pathways that lead to death (the attributable risk), any therapy can only lead to small effects in these populations. Using Monte Carlo simulations, we show how the syndrome-attributable risks of critical illness-associated diagnoses are likely overestimated using common statistical methods. This overestimation of syndrome-attributable risks leads to a corresponding overestimation of attainable treatment effects and an underestimation of required sample sizes. We demonstrate that larger and more 'pragmatic' randomized trials are not the solution because they decrease therapeutic and diagnostic precision, the therapeutic effect size and the probability of finding a beneficial effect. Finally, we argue that the most logical solution is a renewed focus on mechanistic research into the complexities of critical illness syndromes.

[1]  Ning Liu,et al.  Scientific evidence underlying the recommendations of critical care clinical practice guidelines: a lack of high level evidence , 2018, Intensive Care Medicine.

[2]  M. Meade,et al.  Low Tidal Volume versus Non‐Volume‐Limited Strategies for Patients with Acute Respiratory Distress Syndrome. A Systematic Review and Meta‐Analysis , 2017, Annals of the American Thoracic Society.

[3]  Francesco Santini,et al.  Mortality in Multicenter Critical Care Trials: An Analysis of Interventions With a Significant Effect* , 2015, Critical care medicine.

[4]  S. Walter The estimation and interpretation of attributable risk in health research. , 1976, Biometrics.

[5]  D. Schoenfeld,et al.  Ventilation with lower tidal volumes as compared with traditional tidal volumes for acute lung injury and the acute respiratory distress syndrome. , 2000, The New England journal of medicine.

[6]  J. Laffey,et al.  Negative trials in critical care: why most research is probably wrong. , 2018, The Lancet. Respiratory medicine.

[7]  James F Burke,et al.  Implications of Heterogeneity of Treatment Effect for Reporting and Analysis of Randomized Trials in Critical Care. , 2015, American journal of respiratory and critical care medicine.

[8]  J. Neoptolemos,et al.  Acute pancreatitis as a model of sepsis. , 1998, The Journal of antimicrobial chemotherapy.

[9]  G. Rubenfeld,et al.  Interobserver variability in applying a radiographic definition for ARDS. , 1999, Chest.

[10]  M. Shankar-Hari,et al.  Estimating attributable fraction of mortality from sepsis to inform clinical trials , 2018, Journal of critical care.

[11]  M. Balaan,et al.  Acute Respiratory Distress Syndrome , 2016, Critical care nursing quarterly.

[12]  Anders Larsson,et al.  Epidemiology, Patterns of Care, and Mortality for Patients With Acute Respiratory Distress Syndrome in Intensive Care Units in 50 Countries. , 2016, JAMA.

[13]  Y. An,et al.  Does training improve diagnostic accuracy and inter-rater agreement in applying the Berlin radiographic definition of acute respiratory distress syndrome? A multicenter prospective study , 2017, Critical Care.

[14]  C. Coopersmith,et al.  Pathophysiology of septic shock: From bench to bedside. , 2016, Presse medicale.

[15]  J. Hall Respiratory system mechanics in adult respiratory distress syndrome. Stretching our understanding. , 1998, American journal of respiratory and critical care medicine.

[16]  L. Trinquart,et al.  Influence of trial sample size on treatment effect estimates: meta-epidemiological study , 2013, BMJ : British Medical Journal.

[17]  L. Steuten,et al.  Effect of a Low vs Intermediate Tidal Volume Strategy on Ventilator-Free Days in Intensive Care Unit Patients Without ARDS: A Randomized Clinical Trial , 2018, JAMA.

[18]  G. Decavalas,et al.  Severe Sepsis and Septic Shock , 2018 .

[19]  M. Netea,et al.  Immunotherapy for the adjunctive treatment of sepsis: from immunosuppression to immunostimulation. Time for a paradigm change? , 2013, American journal of respiratory and critical care medicine.

[20]  Klaus Ulrich Klein,et al.  Faculty of 1000 evaluation for Epidemiology, patterns of care, and mortality for patients with acute respiratory distress syndrome in intensive care units in 50 countries. , 2018 .