The Decline of the Experimental Paradigm During the COVID-19 Pandemic: A Template for the Future

The current COVID-19 pandemic has exerted an unprecedented impact across the globe. As a consequence of this overwhelming catastrophe, long established prevailing medical and scientific paradigms have been disrupted. The response of the scientific community, medical journals, media and some politicians, has been far from ideal. The present manuscript discusses the failure of the scientific enterprise in its initiatives to address the COVID-19 outbreak, as a consequence of the disarray attributable to haste and urgency. To enhance conveying our message, this manuscript is organized in three interrelated sections: 1) the accelerated pace of publications coupled with a dysfunctional review process; 2) failure of the clinical trial enterprise; 3) propagation of misleading information by the media. In response we propose a template comprising a focus on randomized-controlled clinical trials, and an insistence on responsible journal publication, and enumeration of policies to deal with social media-propagated news. We conclude with a reconsideration of the appropriate role of academic medicine and journals.

[1]  L. Dodd,et al.  Remdesivir for the Treatment of Covid-19 - Preliminary Report. Reply. , 2020, The New England journal of medicine.

[2]  Jing Yuan,et al.  Treatment of 5 Critically Ill Patients With COVID-19 With Convalescent Plasma. , 2020, JAMA.

[3]  L. Ren,et al.  Effect of Convalescent Plasma Therapy on Time to Clinical Improvement in Patients With Severe and Life-threatening COVID-19: A Randomized Clinical Trial. , 2020, JAMA.

[4]  L. Papazian,et al.  Use of Prone Positioning in Nonintubated Patients With COVID-19 and Hypoxemic Acute Respiratory Failure. , 2020, JAMA.

[5]  A. Zangrillo,et al.  Respiratory Parameters in Patients With COVID-19 After Using Noninvasive Ventilation in the Prone Position Outside the Intensive Care Unit. , 2020, JAMA.

[6]  Emily G McDonald,et al.  A Randomized Trial of Hydroxychloroquine as Postexposure Prophylaxis for Covid-19 , 2020, The New England journal of medicine.

[7]  Jacques LeLorier,et al.  Head to head comparison of the propensity score and the high-dimensional propensity score matching methods , 2016, BMC Medical Research Methodology.

[8]  Sinan Aral,et al.  The spread of true and false news online , 2018, Science.

[9]  H. Larson Blocking information on COVID-19 can fuel the spread of misinformation , 2020, Nature.

[10]  Matthew J. Salganik,et al.  Strengthening the Reporting of Observational Studies in Epidemiology for respondent-driven sampling studies: “STROBE-RDS” statement , 2015, Journal of clinical epidemiology.

[11]  K. Schulz,et al.  Bias and causal associations in observational research , 2002, The Lancet.

[12]  David A Chambers,et al.  Big Data and Large Sample Size: A Cautionary Note on the Potential for Bias , 2014, Clinical and Translational Science.

[13]  C. Naylor,et al.  Counteracting Health Misinformation: A Role for Medical Journals? , 2019, JAMA.

[14]  Kwok-Hung Chan,et al.  Triple combination of interferon beta-1b, lopinavir–ritonavir, and ribavirin in the treatment of patients admitted to hospital with COVID-19: an open-label, randomised, phase 2 trial , 2020, The Lancet.

[15]  L. Rodríguez-Mañas,et al.  Use of renin–angiotensin–aldosterone system inhibitors and risk of COVID-19 requiring admission to hospital: a case-population study , 2020, The Lancet.

[16]  R. Wenzel Medical Education in the Era of Alternative Facts. , 2017, The New England journal of medicine.

[17]  Raina M. Merchant,et al.  Protecting the Value of Medical Science in the Age of Social Media and “Fake News” , 2018, JAMA.

[18]  A. Fauci,et al.  Research in the Context of a Pandemic , 2020, The New England journal of medicine.

[19]  Deepak L. Bhatt,et al.  Twitter-based learning for continuing medical education? , 2020, European heart journal.

[20]  Sanjay Kumar In India, Hindu pride boosts pseudoscience. , 2019, Science.

[21]  Spiros C. Denaxas,et al.  Avoidable flaws in observational analyses: an application to statins and cancer , 2019, Nature Medicine.

[22]  W. Alhazzani,et al.  COVID-19 coronavirus research has overall low methodological quality thus far: case in point for chloroquine/hydroxychloroquine , 2020, Journal of Clinical Epidemiology.

[23]  S. Barton,et al.  Which clinical studies provide the best evidence? , 2000, BMJ : British Medical Journal.

[24]  Yuan Wei,et al.  A Trial of Lopinavir–Ritonavir in Adults Hospitalized with Severe Covid-19 , 2020, The New England journal of medicine.

[25]  Lee-Jen Wei,et al.  Remdesivir for the Treatment of Covid-19 - Preliminary Report. , 2020, The New England journal of medicine.

[26]  M. Dougan,et al.  Improving Clinical Trial Enrollment - In the Covid-19 Era and Beyond. , 2020, The New England journal of medicine.

[27]  David R. Holtgrave,et al.  Association of Treatment With Hydroxychloroquine or Azithromycin With In-Hospital Mortality in Patients With COVID-19 in New York State , 2020, The Journal of Emergency Medicine.

[28]  G. Guyatt,et al.  Grading quality of evidence and strength of recommendations , 2004, BMJ : British Medical Journal.

[29]  R. Thaler,et al.  Nudge: Improving Decisions About Health, Wealth, and Happiness , 2008 .

[30]  A. Caplan,et al.  Adverse Consequences of Rushing a SARS-CoV-2 Vaccine: Implications for Public Trust. , 2020, JAMA.

[31]  A. Hackshaw,et al.  Small studies: strengths and limitations , 2008, European Respiratory Journal.

[32]  D. Raoult,et al.  New insights on the antiviral effects of chloroquine against coronavirus: what to expect for COVID-19? , 2020, International Journal of Antimicrobial Agents.

[33]  Y. Hu,et al.  On the use of corticosteroids for 2019-nCoV pneumonia , 2020, The Lancet.

[34]  P. Rosenbaum Discussing hidden bias in observational studies. , 1991, Annals of internal medicine.

[35]  M. Pencina,et al.  Understanding Observational Treatment Comparisons in the Setting of Coronavirus Disease 2019 (COVID-19). , 2020, JAMA cardiology.

[36]  G. Hripcsak,et al.  Observational Study of Hydroxychloroquine in Hospitalized Patients with Covid-19 , 2020, The New England journal of medicine.

[37]  R. Bruno,et al.  Remdesivir for 5 or 10 Days in Patients with Severe Covid-19 , 2020, The New England journal of medicine.

[38]  Minzhang Zheng,et al.  The online competition between pro- and anti-vaccination views , 2020, Nature.

[39]  C. White,et al.  Hydroxychloroquine or Chloroquine for Treatment or Prophylaxis of COVID-19 , 2020, Annals of Internal Medicine.

[40]  J. Peabody An organizational analysis of the World Health Organization: narrowing the gap between promise and performance. , 1995, Social science & medicine.

[41]  Anthony F. J. van Raan,et al.  Citation Analysis May Severely Underestimate the Impact of Clinical Research as Compared to Basic Research , 2012, PloS one.

[42]  Thomas Jaki,et al.  Dexamethasone in Hospitalized Patients with Covid-19 — Preliminary Report , 2020, The New England journal of medicine.

[43]  A. Phelan,et al.  Baricitinib as potential treatment for 2019-nCoV acute respiratory disease , 2020, The Lancet.

[44]  G. Gamble,et al.  Media Coverage, Journal Press Releases and Editorials Associated with Randomized and Observational Studies in High-Impact Medical Journals: A Cohort Study , 2015, PloS one.

[45]  Wen-Ying Sylvia Chou,et al.  Addressing Health-Related Misinformation on Social Media. , 2018, JAMA.

[46]  P. Farmer,et al.  WHO's Next - The United States and the World Health Organization. , 2020, New England Journal of Medicine.

[47]  D. Rubin The design versus the analysis of observational studies for causal effects: parallels with the design of randomized trials , 2007, Statistics in medicine.

[48]  Erwan L'Her,et al.  Compassionate Use of Remdesivir for Patients with Severe Covid-19 , 2020, The New England journal of medicine.

[49]  David A. Broniatowski,et al.  Weaponized Health Communication: Twitter Bots and Russian Trolls Amplify the Vaccine Debate , 2018, American journal of public health.

[50]  Amit N. Patel,et al.  RETRACTED: Hydroxychloroquine or chloroquine with or without a macrolide for treatment of COVID-19: a multinational registry analysis , 2020, The Lancet.

[51]  Christopher J. Rush,et al.  Association is not causation: treatment effects cannot be estimated from observational data in heart failure , 2018, European heart journal.

[52]  Amit N. Patel,et al.  Cardiovascular Disease, Drug Therapy, and Mortality in Covid-19 , 2020, The New England journal of medicine.

[53]  Y. Hu,et al.  Safety, tolerability, and immunogenicity of a recombinant adenovirus type-5 vectored COVID-19 vaccine: a dose-escalation, open-label, non-randomised, first-in-human trial , 2020, The Lancet.

[54]  Jeffrey Brainard,et al.  Scientists are drowning in COVID-19 papers. Can new tools keep them afloat? , 2020 .

[55]  John S. Brownstein,et al.  Predicting social response to infectious disease outbreaks from internet-based news streams , 2017, Ann. Oper. Res..

[56]  R. Collins,et al.  Reliable assessment of the effects of treatment on mortality and major morbidity, I: clinical trials , 2001, The Lancet.

[57]  N. Freemantle,et al.  Making inferences on treatment effects from real world data: propensity scores, confounding by indication, and other perils for the unwary in observational research , 2013, BMJ.

[58]  Yi Wang,et al.  Remdesivir in adults with severe COVID-19: a randomised, double-blind, placebo-controlled, multicentre trial , 2020, The Lancet.

[59]  T. Fojo,et al.  Hazard ratios in cancer clinical trials—a primer , 2012, Nature Reviews Clinical Oncology.

[60]  T. Lüscher,et al.  Twitter promotion predicts citation rates of cardiovascular articles: a preliminary analysis from the ESC Journals Randomized Study. , 2020, European heart journal.

[61]  Medical Misinformation: Vet the Message! , 2019, European heart journal.

[62]  M. Hernán,et al.  Win-win: Reconciling Social Epidemiology and Causal Inference. , 2019, American journal of epidemiology.

[63]  C. Torp‐Pedersen,et al.  Association of Angiotensin-Converting Enzyme Inhibitor or Angiotensin Receptor Blocker Use With COVID-19 Diagnosis and Mortality. , 2020, JAMA.

[64]  G. Koh,et al.  Faculty Opinions recommendation of Hydroxychloroquine or chloroquine with or without a macrolide for treatment of COVID-19: a multinational registry analysis. , 2020 .