How evidence-based medicine is failing due to biased trials and selective publication.

Evidence-based medicine (EBM) was announced in the early 1990s as a 'new paradigm' for improving patient care. Yet there is currently little evidence that EBM has achieved its aim. Since its introduction, health care costs have increased while there remains a lack of high-quality evidence suggesting EBM has resulted in substantial population-level health gains. In this paper we suggest that EBM's potential for improving patients' health care has been thwarted by bias in the choice of hypotheses tested, manipulation of study design and selective publication. Evidence for these flaws is clearest in industry-funded studies. We argue EBM's indiscriminate acceptance of industry-generated 'evidence' is akin to letting politicians count their own votes. Given that most intervention studies are industry funded, this is a serious problem for the overall evidence base. Clinical decisions based on such evidence are likely to be misinformed, with patients given less effective, harmful or more expensive treatments. More investment in independent research is urgently required. Independent bodies, informed democratically, need to set research priorities. We also propose that evidence rating schemes are formally modified so research with conflict of interest bias is explicitly downgraded in value.

[1]  J. Lieberman,et al.  Effectiveness of antipsychotic drugs in patients with chronic schizophrenia. , 2005, The New England journal of medicine.

[2]  Rebecca S. Graves,et al.  Users' Guides to the Medical Literature: A Manual for Evidence-Based Clinical Practice. , 2002 .

[3]  Blair T. Johnson,et al.  Initial Severity and Antidepressant Benefits: A Meta-Analysis of Data Submitted to the Food and Drug Administration , 2008, PLoS medicine.

[4]  R. McLean,et al.  Life-threatening clozapine-induced gastrointestinal hypomotility: an analysis of 102 cases. , 2008, The Journal of clinical psychiatry.

[5]  Cr Sridhar,et al.  Bad Pharma: How drug companies mislead doctors and harm patients , 2013, Journal of Cancer Research and Therapeutics.

[6]  Z. Kmietowicz.  Johnson & Johnson to pay $2.2bn to settle charges of false marketing on three drugs , 2013, BMJ.

[7]  James Le Fanu,et al.  The Rise and Fall of Modern Medicine , 1999 .

[8]  J. Fins.  White Coat, Black Hat: Adventures on the Dark Side of Medicine , 2011 .

[9]  J. Ioannidis,et al.  Effectiveness of antidepressants: an evidence myth constructed from a thousand randomized trials? , 2008, Philosophy, ethics, and humanities in medicine : PEHM.

[10]  Michael G. Samarkos,et al.  The philosophy of Evidence-based Medicine , 2006 .

[11]  I. Olkin,et al.  The case of the misleading funnel plot , 2006, BMJ : British Medical Journal.

[12]  D B Matchar,et al.  What role do neurologists play in determining the costs and outcomes of stroke patients? , 1996, Stroke.

[13]  Heidi D Nelson,et al.  Postmenopausal hormone replacement therapy: scientific review. , 2002, JAMA.

[14]  V. Vaccarino,et al.  Beta-blockers for the acute treatment of elderly patients with myocardial infarction: experience from the national cooperative cardiovascular project , 1998 .

[15]  Laura Ahmad,et al.  Bad Pharma: How drug companies mislead doctors and harm patients , 2013 .

[16]  J. Sterne,et al.  Publication and related bias in meta-analysis: power of statistical tests and prevalence in the literature. , 2000, Journal of clinical epidemiology.

[17]  J. Ioannidis,et al.  Persistence of contradicted claims in the literature. , 2007, JAMA.

[18]  J. Brown.  Politics, Method, and Medical Research , 2008, Philosophy of Science.

[19]  E. Walters,et al.  What is evidence-based medicine and the role of the systematic review: the revolution coming your way. , 2001, Monaldi archives for chest disease = Archivio Monaldi per le malattie del torace.

[20]  D. Zuckerman.  Hype in Health Reporting: “Checkbook Science” Buys Distortion of Medical News , 2003, International journal of health services : planning, administration, evaluation.

[21]  D. Lawlor,et al.  Exercise for Depression. , 1978, The Physician and sportsmedicine.

[22]  K. Martin,et al.  Postmenopausal hormone-replacement therapy. , 2001, The New England journal of medicine.

[23]  J. Lacasse,et al.  Ghostwriting at Elite Academic Medical Centers in the United States , 2010, PLoS medicine.

[24]  J. Lenzer.  Manufacturer admits increase in suicidal behaviour in patients taking paroxetine , 2006, BMJ : British Medical Journal.

[25]  B. Knishkowy,et al.  The association between funding by commercial interests and study outcome in randomized controlled drug trials. , 2001, Family practice.

[26]  R. DeRubeis,et al.  Antidepressant drug effects and depression severity: a patient-level meta-analysis. , 2010, JAMA.

[27]  A. Nierenberg,et al.  Industry sponsorship and financial conflict of interest in the reporting of clinical trials in psychiatry. , 2005, The American journal of psychiatry.

[28]  Harlan M. Krumholz,et al.  Trial Publication after Registration in ClinicalTrials.Gov: A Cross-Sectional Analysis , 2009, PLoS medicine.

[29]  H. Krumholz,et al.  National use and effectiveness of beta-blockers for the treatment of elderly patients after acute myocardial infarction: National Cooperative Cardiovascular Project. , 1998, JAMA.

[30]  Richard Smith,et al.  Medical Journals Are an Extension of the Marketing Arm of Pharmaceutical Companies , 2005, PLoS medicine.

[31]  R. Rosenfeld.  Patients , 2012, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[32]  M Egger,et al.  Are randomised controlled trials in the BMJ different? , 2001, BMJ : British Medical Journal.

[33]  S. Chimonas,et al.  Exposing conflict of interest in psychiatry: does transparency matter? , 2012, International journal of law and psychiatry.

[34]  Sharon E Straus,et al.  Evidence-Based Medicine: How to Practice and Teach It , 2010 .

[35]  F. Song,et al.  Dissemination and publication of research findings: an updated review of related biases. , 2010, Health technology assessment.

[36]  B. Roehr.  Professor files complaint of scientific misconduct over allegation of ghostwriting , 2011, BMJ : British Medical Journal.

[37]  R. Haynes,et al.  What kind of evidence is it that Evidence-Based Medicine advocates want health care providers and consumers to pay attention to? , 2002, BMC health services research.

[38]  D. Sackett,et al.  Evidence based medicine: what it is and what it isn't , 1996, BMJ.

[39]  Thomas A Trikalinos,et al.  The appropriateness of asymmetry tests for publication bias in meta-analyses: a large survey , 2007, Canadian Medical Association Journal.

[40]  Q. Gu,et al.  Antidepressant use in persons aged 12 and over: United States, 2005-2008. , 2011, NCHS data brief.

[41]  C. Gross,et al.  Scope and impact of financial conflicts of interest in biomedical research: a systematic review. , 2003, JAMA.

[42]  A. Detsky,et al.  Evidence-based medicine. A new approach to teaching the practice of medicine. , 1992, JAMA.

[43]  B. Roehr.  GlaxoSmithKline is fined record $3bn in US , 2012, BMJ : British Medical Journal.

[44]  D. Altman,et al.  Assessing Risk of Bias in Included Studies , 2008 .

[45]  J. Bunker.  The Rise and Fall of Modern Medicine , 1999, BMJ.

[46]  Stefan Leucht,et al.  Why olanzapine beats risperidone, risperidone beats quetiapine, and quetiapine beats olanzapine: an exploratory analysis of head-to-head comparison studies of second-generation antipsychotics. , 2006, The American journal of psychiatry.

[47]  B. Djulbegovic,et al.  Pharmaceutical industry sponsorship and research outcome and quality: systematic review , 2003, BMJ : British Medical Journal.

[48]  R. Kerry.  The Philosophy of Evidence-Based Medicine , 2011 .

[49]  Peter C Gøtzsche,et al.  Cochrane reviews compared with industry supported meta-analyses and other meta-analyses of the same drugs: systematic review , 2006, BMJ : British Medical Journal.

[50]  S. Satya‐Murti.  Evidence-based Medicine: How to Practice and Teach EBM , 1997 .

[51]  R. Rosenthal,et al.  Selective publication of antidepressant trials and its influence on apparent efficacy. , 2008, The New England journal of medicine.

[52]  J. Tanne.  US judge fines Johnson & Johnson $1.1bn for misleading marketing of risperidone , 2012, BMJ : British Medical Journal.

[53]  J. Ioannidis,et al.  Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias , 2008, PloS one.

[54]  Naguib Hilmy.  Postmenopausal hormone-replacement therapy. , 2002, The New England journal of medicine.

[55]  A. Zimerman.  Evidence-based medicine: a short history of a modern medical movement. , 2013, The virtual mentor : VM.

[56]  S. Shott,et al.  Association Between Funding Source and Study Outcome in Orthopaedic Research , 2003, Clinical orthopaedics and related research.

[57]  C. Elliott.  White Coat, Black Hat: Adventures on the Dark Side of Medicine , 2010 .

[58]  L. Hranov,et al.  Effectiveness of antipsychotic drugs in first-episode schizophrenia and schizophreniform disorder: an open randomised clinical trial , 2008, The Lancet.

[59]  Peter B. Jones,et al.  Randomized controlled trial of the effect on Quality of Life of second- vs first-generation antipsychotic drugs in schizophrenia: Cost Utility of the Latest Antipsychotic Drugs in Schizophrenia Study (CUtLASS 1). , 2006, Archives of general psychiatry.

[60]  Daniel L. Sahling.  Pediatric Bipolar Disorder: Underdiagnosed or Fiction? , 2009, Ethical Human Psychology and Psychiatry.

[61]  J. Lieberman,et al.  Cost-effectiveness of second-generation antipsychotics and perphenazine in a randomized trial of treatment for chronic schizophrenia. , 2006, The American journal of psychiatry.

[62]  G. Guyatt,et al.  GRADE: an emerging consensus on rating quality of evidence and strength of recommendations , 2008, BMJ : British Medical Journal.

[63]  Tsuguya Fukui,et al.  Systematic Evaluation and Comparison of Statistical Tests for Publication Bias , 2005, Journal of epidemiology.