Evidence-based mechanistic reasoning

Systematic reviews of high quality randomized trials generally count as the ‘best evidence’. However, well-conducted randomized trials are sometimes unavailable, unfeasible, unethical or unnecessary. In such cases other forms of evidence must be considered. Many EBM proponents accept mechanistic reasoning (‘pathophysiologic rationale’) for generalizability, hypothesis generation, ruling out implausible hypotheses, and for supporting efficacy in the absence of other ‘stronger’ forms of evidence. Yet because mechanistic reasoning has often led us astray, most EBM proponents are justifiably sceptical about using mechanistic reasoning as evidence for efficacy. We suggest that the scepticism about the value of mechanistic reasoning should not extend to high quality mechanistic reasoning. Just as poor quality randomized trials (that are unblinded, underpowered or biased, that employ unconcealed allocation, or otherwise biased) will not provide high quality evidence for efficacy, so poor quality mechanistic reasoning will be unreliable. In this theoretical exploration we suggest that mechanistic reasoning involving a not incomplete inferential chain and that takes potential complexity into account can and should be used as evidence of efficacy. We support our rules for mechanistic evidence with three examples.

[1]  Sharon E Straus,et al.  Evidence-Based Medicine: How to Practice and Teach It , 2010 .

[2]  F. Miller Death and organ donation: back to the future , 2009, Journal of Medical Ethics.

[3]  J. Howick Questioning the Methodologic Superiority of ‘Placebo’ Over ‘Active’ Controlled Trials , 2009, The American journal of bioethics : AJOB.

[4]  A. Osterhaus,et al.  On the relationship between mean antibody level, seroprotection and clinical protection from influenza. , 2009, Biologicals : journal of the International Association of Biological Standardization.

[5]  R. Truog,et al.  The Incoherence of Determining Death by Neurological Criteria: A Commentary on Controversies in the Determination of Death, A White Paper by the President’s Council on Bioethics , 2009, Kennedy Institute of Ethics journal.

[6]  J. Howick Escaping from placebo prison , 2009, BMJ : British Medical Journal.

[7]  Paul Glasziou,et al.  The evolution of evidence hierarchies: what can Bradford Hill's ‘guidelines for causation’ contribute? , 2009, Journal of the Royal Society of Medicine.

[8]  M. Kringelbach,et al.  Deep brain stimulation: avoiding the errors of psychosurgery. , 2009, JAMA.

[9]  Gordon H Guyatt,et al.  Epistemologic inquiries in evidence-based medicine. , 2009, Cancer control : journal of the Moffitt Cancer Center.

[10]  R. Prentice Surrogate and mediating endpoints: current status and future directions. , 2009, Journal of the National Cancer Institute.

[11]  G. Guyatt,et al.  GRADE: an emerging consensus on rating quality of evidence and strength of recommendations , 2008, BMJ : British Medical Journal.

[12]  Douglas G Altman,et al.  Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study , 2008, BMJ : British Medical Journal.

[13]  L. Hegedüs,et al.  Improvement of goiter volume reduction after 0.3 mg recombinant human thyrotropin-stimulated radioiodine therapy in patients with a very large goiter: a double-blinded, randomized trial. , 2007, The Journal of clinical endocrinology and metabolism.

[14]  Paul Glasziou,et al.  When are randomised trials unnecessary? Picking signal from noise , 2007, BMJ : British Medical Journal.

[15]  Manfred Hauben,et al.  Anecdotes that provide definitive evidence , 2006, BMJ : British Medical Journal.

[16]  Ike Iheanacho,et al.  Testing Treatments: Better Research for Better Healthcare , 2006, BMJ : British Medical Journal.

[17]  N. Shah,et al.  The true treatment benefit is unpredictable in clinical trials using surrogate outcome measured with diagnostic tests. , 2005, Journal of clinical epidemiology.

[18]  Donald Gillies,et al.  Hempelian and Kuhnian approaches in the philosophy of medicine: the Semmelweis case. , 2005, Studies in history and philosophy of biological and biomedical sciences.

[19]  V. Stenger,et al.  Retroactive prayer: lots of history, not much mystery, and no science , 2004, BMJ : British Medical Journal.

[20]  G. Lüchters,et al.  Seroprotection rate, mean fold increase, seroconversion rate: which parameter adequately expresses seroresponse to influenza vaccination? , 2004, Virus research.

[21]  C. Biscayart,et al.  Persistence of immunity and seroprotection 4 years after a primary vaccination schedule with a Hansenula polymorpha recombinant hepatitis B vaccine. , 2003, Vaccine.

[22]  John P A Ioannidis,et al.  Translation of highly promising basic science research into clinical applications. , 2003, The American journal of medicine.

[23]  B. Dikici,et al.  Accelerated hepatitis B vaccination schedule in childhood , 2002, Pediatrics international : official journal of the Japan Pediatric Society.

[24]  D. Moher,et al.  Funding source, trial outcome and reporting quality: are they related? Results of a pilot study , 2002, BMC health services research.

[25]  J. Karlawish,et al.  The continuing unethical conduct of underpowered clinical trials. , 2002, JAMA.

[26]  D. Altman Poor-quality medical research: what can journals do? , 2002, JAMA.

[27]  M. Dietrich,et al.  A new accelerated vaccination schedule for rapid protection against hepatitis A and B. , 2002, Vaccine.

[28]  H. Huikuri,et al.  Sudden death due to cardiac arrhythmias. , 2001, The New England journal of medicine.

[29]  P. Machamer,et al.  Thinking about Mechanisms , 2000, Philosophy of Science.

[30]  G. Gamble,et al.  Can medication packaging improve glycemic control and blood pressure in type 2 diabetes? Results from a randomized controlled trial. , 2000, Diabetes care.

[31]  R. Lilford,et al.  The ethics of randomised controlled trials from the perspectives of patients, the public, and healthcare professionals , 1998, BMJ.

[32]  R. Holman,et al.  Intensive blood-glucose control with sulphonylureas or insulin compared with conventional treatment and risk of complications in patients with type 2 diabetes (UKPDS 33). UK Prospective Diabetes Study (UKPDS) Group. , 1998 .

[33]  R. Holman,et al.  Tight blood pressure control and risk of macrovascular and microvascular complications in type 2 diabetes: UKPDS 38. UK Prospective Diabetes Study Group. , 1998 .

[34]  A. Paes,et al.  Impact of Dosage Frequency on Patient Compliance , 1997, Diabetes Care.

[35]  S. Satya‐Murti Evidence-based Medicine: How to Practice and Teach EBM , 1997 .

[36]  R. Davis,et al.  Prone sleep position and the sudden infant death syndrome in King County, Washington: a case-control study. , 1996, The Journal of pediatrics.

[37]  R. J. Hayes,et al.  Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. , 1995, JAMA.

[38]  D G Altman,et al.  The scandal of poor medical research , 1994, BMJ.

[39]  T. Dwyer,et al.  Factors potentiating the risk of sudden infant death syndrome associated with the prone position. , 1993, The New England journal of medicine.

[40]  A. Detsky,et al.  Evidence-based medicine. A new approach to teaching the practice of medicine. , 1992, JAMA.

[41]  A. Zuckerman,et al.  Hepatitis B surface antigen polypeptide micelles from antigen expressed in Saccharomyces cerevisiae. , 1986, Journal of virological methods.

[42]  J. Aronson,et al.  Oxford Textbook of Clinical Pharmacology and Drug Therapy , 1985 .

[43]  T. Eisenstein,et al.  Hepatitis B: The Virus, the Disease, and the Vaccine , 1984 .

[44]  M. Hilleman,et al.  Human hepatitis B vaccine from recombinant yeast , 1984, Nature.

[45]  D. S. Dane,et al.  Virus-like particles in serum of patients with Australia-antigen-associated hepatitis. , 1970, Lancet.

[46]  K. Popper,et al.  Conjectures and refutations;: The growth of scientific knowledge , 1972 .

[47]  R. Asher Apriority: thoughts on treatment. , 1961, Lancet.

[48]  B. Spock Baby and Child Care , 1959 .

[49]  J. I The Design of Experiments , 1936, Nature.

[50]  T. Fahey Transient Goiter Enlargement after Administration of 0.3 mg of Recombinant Human Thyrotropin in Patients with Benign Nontoxic Nodular Goiter: A Randomized, Double-Blind, Crossover Trial , 2007 .

[51]  J. Aronson,et al.  Paradoxical reactions: Under-recognized adverse effects of drugs? , 2006 .

[52]  B. Marshall Helicobacter Connections , 2006, ChemMedChem.

[53]  Duff R. Waring Paradoxical Drug Response and the Placebo Effect: A Discussion of Grunbaum's Definitional Scheme , 2003, Theoretical Medicine and Bioethics.

[54]  Gordon H. Guyatt,et al.  Users' Guides to the Medical Literature: A Manual for Evidence-Based Clinical Practice; Users' Guides to the Medical Literature: Essentials of Evidence-Based Clinical Practice , 2003, BMJ : British Medical Journal.

[55]  B. Schmidt,et al.  Do we measure the right end points? A systematic review of primary outcomes in recent neonatal randomized clinical trials. , 2001 .

[56]  J. Cramer Enhancing Patient Compliance in the Elderly , 1998, Drugs & aging.

[57]  W. Rogers,et al.  Preliminary report: effect of encainide and flecainide on mortality in a randomized trial of arrhythmia suppression after myocardial infarction. , 1989, The New England journal of medicine.