Influences on the Quality of Published Drug Studies

To practice evidence-based medicine, physicians need data on the clinical effectiveness, toxicity, convenience, and cost of new drugs compared with available alternatives. We give examples of published drug studies that are defective, sometimes because pharmaceutical industry funding has affected their content and quality. We make recommendations on how to avoid these defects.

[1]  D G Altman,et al.  Assessing the quality of randomization from reports of controlled trials published in obstetrics and gynecology journals. , 1994, JAMA.

[2]  W. Browner,et al.  The case against childhood cholesterol screening. , 1990, JAMA.

[3]  Frans Van de Werf,et al.  An international randomized trial comparing four thrombolytic strategies for acute myocardial infarction. , 1993, The New England journal of medicine.

[4]  M. Weintraub,et al.  Consequences of the 1989 New York State triplicate benzodiazepine prescription regulations. , 1991, JAMA.

[5]  M. Gardner,et al.  More informative abstracts revisited. , 1990, The Cleft palate-craniofacial journal : official publication of the American Cleft Palate-Craniofacial Association.

[6]  R M Arnold,et al.  Absolutely relative: how research results are summarized can affect treatment decisions. , 1992, The American journal of medicine.

[7]  D. Sackett,et al.  Thrombolytic Agents: The Science of the Art of Choosing the Better Treatment , 1994, Annals of Internal Medicine.

[8]  J. Avorn,et al.  Evaluating drugs after their approval for clinical use. , 1993, The New England journal of medicine.

[9]  A. Detsky,et al.  Evidence-based medicine. A new approach to teaching the practice of medicine. , 1992, JAMA.

[10]  P. Langenberg,et al.  How much 'better' is good enough? The magnitude of treatment effect in clinical trials. , 1992, American journal of diseases of children.

[11]  R. Davidson.  Source of funding and outcome of clinical trials , 1986, Journal of general internal medicine.

[12]  D G Altman,et al.  Statistics in medical journals. , 1982, Statistics in medicine.

[13]  C D Naylor,et al.  Measured Enthusiasm: Does the Method of Reporting Trial Results Alter Perceptions of Therapeutic Effectiveness? , 1992, Annals of Internal Medicine.

[14]  T C Chalmers,et al.  A method for assessing the quality of a randomized control trial. , 1981, Controlled clinical trials.

[15]  GMC finds GPs guilty of fraud , 1994, BMJ.

[16]  M J Gardner,et al.  An exploratory study of statistical assessment of papers published in the British Medical Journal. , 1990, JAMA.

[17]  G. Bond.  Ethical issues relating to the conduct and interpretation of epidemiologic research in private industry. , 1991, Journal of clinical epidemiology.

[18]  P. Rochon,et al.  A study of manufacturer-supported trials of nonsteroidal anti-inflammatory drugs in the treatment of arthritis. , 1994, Archives of internal medicine.

[19]  S Lock,et al.  Fraud and Misconduct in Medical Research , 1996, The Medico-legal journal.

[20]  P. Easterbrook,et al.  Publication bias in clinical research , 1991, The Lancet.

[21]  D. Rennie,et al.  Authorship! Authorship! Guests, ghosts, grafters, and the two-sided coin. , 1994, JAMA.

[22]  J. Huttunen,et al.  Helsinki Heart Study: primary-prevention trial with gemfibrozil in middle-aged men with dyslipidemia. Safety of treatment, changes in risk factors, and incidence of coronary heart disease. , 1987, The New England journal of medicine.

[23]  Users' Guides to the Medical Literature (Editorials) , 1993 .

[24]  D. Rennie,et al.  Publication bias. The triumph of hope over experience. , 1992 .

[25]  R A Deyo,et al.  The importance of placebo effects in pain treatment and research. , 1994, JAMA.

[26]  B Kinosian,et al.  Avoiding bias in the conduct and reporting of cost-effectiveness research sponsored by pharmaceutical companies. , 1991, The New England journal of medicine.

[27]  J. Tinker.  Voices from the past--from ice crystals to fruit flies in the quest for a molecular mechanism of anesthetic action. , 1993, Anesthesia and analgesia.

[28]  M D Rawlins,et al.  Review of company postmarketing surveillance studies. , 1992, BMJ.

[29]  M. Urowitz,et al.  Comparison of azathioprine, methotrexate, and the combination of both in the treatment of rheumatoid arthritis. A controlled clinical trial. , 1992, Arthritis and rheumatism.

[30]  C. Mulrow.  The medical review article: state of the science. , 1987, Annals of internal medicine.

[31]  A. Relman.  Tacrine as a Treatment for Alzheimer's Dementia , 1991 .

[32]  More on sulfinpyrazone after myocardial infarction. , 1982, The New England journal of medicine.

[33]  H. Janowitz,et al.  The "natural history" of ulcerative colitis: an analysis of the placebo response. , 1989, Journal of clinical gastroenterology.

[34]  J. S. Bower,et al.  Hemodynamic and gas exchange effects of intravenous diltiazem in patients with pulmonary hypertension. , 1982, The American journal of cardiology.

[35]  G. Pledger,et al.  The FDA's critique of the anturane reinfarction trial. , 1980, The New England journal of medicine.

[36]  Let us focus your worries! Health care policy: a clinical approach. , 1994, JAMA.

[37]  J J Anderson,et al.  Secular changes in published clinical trials of second-line agents in rheumatoid arthritis. , 1991, Arthritis and rheumatism.

[38]  E. Hemminki.  Quality of Clinical Trials — A Concern of Three Decades , 1982, Methods of Information in Medicine.

[39]  D. Rennie,et al.  Throw it away, Sam: the controlled circulation journals. , 1990, AJR. American journal of roentgenology.

[40]  J. Rask-Madsen,et al.  WITHHOLDING UNFAVOURABLE RESULTS IN DRUG COMPANY SPONSORED CLINICAL TRIALS , 1987, The Lancet.

[41]  G. Assmann,et al.  3. Genetic (primary) forms of hypertriglceridemia , 1991 .

[42]  R. P. Schwarz.  Maintaining integrity and credibility in industry-sponsored clinical research. , 1991, Controlled clinical trials.

[43]  L. Criswell,et al.  No firm basis to advocate auranofin in the treatment of juvenile rheumatoid arthritis. , 1991, Arthritis and rheumatism.

[44]  M. Polis.  Design of a randomized controlled trial of foscarnet in patients with cytomegalovirus retinitis associated with acquired immunodeficiency syndrome. , 1992, The American journal of medicine.

[45]  G. Klerman,et al.  The effects of antihypertensive therapy on the quality of life. , 1986, The New England journal of medicine.

[46]  D. Moher,et al.  Statistical power, sample size, and their reporting in randomized controlled trials. , 1994, JAMA.

[47]  N. Vogelzang,et al.  A successful system of scientific data audits for clinical trials. A report from the Cancer and Leukemia Group B. , 1993, JAMA.

[48]  A. Tversky,et al.  The framing of decisions and the psychology of choice. , 1981, Science.

[49]  P. Gøtzsche.  Methodology and overt and hidden bias in reports of 196 double-blind trials of nonsteroidal antiinflammatory drugs in rheumatoid arthritis. , 1989, Controlled clinical trials.

[50]  David Griffith,et al.  Health research for development , 1991, The Lancet.

[51]  W. Rogers,et al.  Preliminary report: effect of encainide and flecainide on mortality in a randomized trial of arrhythmia suppression after myocardial infarction. , 1989, The New England journal of medicine.

[52]  M. Gottlieb,et al.  Response to treatment with the leukocyte-derived immunomodulator IMREG-1 in immunocompromised patients with AIDS-related complex. A multicenter, double-blind, placebo-controlled trial. , 1991, Annals of internal medicine.

[53]  E. Giannini,et al.  Auranofin in the treatment of juvenile rheumatoid arthritis. , 1990, The Journal of pediatrics.

[54]  R. Califf,et al.  Holding GUSTO Up to the Light , 1994, Annals of Internal Medicine.

[55]  Kay Dickersin,et al.  Keeping posted Why register clinical trials?-Revisited , 1992 .

[56]  A. Kling,et al.  Oral tetrahydroaminoacridine in long-term treatment of senile dementia, Alzheimer type. , 1986, The New England journal of medicine.

[57]  P. Ridker,et al.  Large-Scale Trials of Thrombolytic Therapy for Acute Myocardial Infarction: GISSI-2, ISIS-3, and GUSTO-1 , 1993, Annals of Internal Medicine.

[58]  E. Wyllie,et al.  Increased seizure frequency with generic primidone. , 1987, JAMA.

[59]  G. Guyatt.  Academic medicine and the pharmaceutical industry: a cautionary tale. , 1994, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[60]  G. Lundberg.  Statement by the International Committee of Medical Journal Editors on Duplicate or Redundant Publication , 1993 .

[61]  D. Rennie,et al.  The publication of sponsored symposiums in medical journals. , 1992, The New England journal of medicine.

[62]  E. Hemminki.  Study of information submitted by drug companies to licensing authorities. , 1980, British medical journal.

[63]  I Chalmers,et al.  Underreporting research is scientific misconduct. , 1990, JAMA.

[64]  P. Meier.  Anturane reinfarction trial. , 1981, New England Journal of Medicine.

[65]  G. Guyatt,et al.  Validation of an index of the quality of review articles. , 1991, Journal of clinical epidemiology.

[66]  R. Haynes.  Clinical review articles. , 1992, BMJ.

[67]  Y. Iesaka,et al.  Usefulness of early versus late programmed ventricular stimulation in acute myocardial infarction. , 1991, The American journal of cardiology.

[68]  K J Rothman,et al.  Conflict of interest. The new McCarthyism in science. , 1993, JAMA.

[69]  W. Hardy.  Foscarnet treatment of acyclovir-resistant herpes simplex virus infection in patients with acquired immunodeficiency syndrome: preliminary results of a controlled, randomized, regimen-comparative trial. , 1992, The American journal of medicine.

[70]  P. Dieppe,et al.  Is research into the treatment of osteoarthritis with non-steroidal anti-inflammatory drugs misdirected? , 1993, The Lancet.

[71]  F. Mosteller,et al.  How study design affects outcomes in comparisons of therapy. I: Medical. , 1989, Statistics in medicine.

[72]  Dwight Kaufman.  Cancer therapy and the randomized clinical trial good medicine? , 1993, CA: a cancer journal for clinicians.

[73]  D. Rennie.  Breast cancer: how to mishandle misconduct. , 1994, JAMA.

[74]  C. Fisch,et al.  Electrocardiographic Findings in Sertraline Depression Trials , 1992 .

[75]  T C Chalmers,et al.  Getting to grips with Archie Cochrane's agenda. , 1992, BMJ.

[76]  R. Simes.  Publication bias: the case for an international registry of clinical trials. , 1986, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[77]  P. Lurie,et al.  Regulation of benzodiazepine prescription. , 1992, JAMA.

[78]  G H Guyatt,et al.  Agreement among reviewers of review articles. , 1991, Journal of clinical epidemiology.

[79]  M. Blaufox,et al.  Effect of antihypertensives on sexual function and quality of life: the TAIM Study. , 1991, Annals of internal medicine.

[80]  A. Liberati.  Publication bias and the editorial process. , 1992, JAMA.

[81]  D. Sackett,et al.  Controversy in counting and attributing events in clinical trials. , 1979, The New England journal of medicine.

[82]  R. Temple,et al.  Government Viewpoint of Clinical Trials , 1982 .

[83]  D. Rennie.  Editors and auditors. , 1989, JAMA.

[84]  T. Chalmers,et al.  Minimizing the three stages of publication bias. , 1990, JAMA.

[85]  G. Guyatt,et al.  Users' guides to the medical literature. , 1993, JAMA.

[86]  D. Rennie.  Accountability, audit, and reverence for the publication process. , 1993, JAMA.

[87]  B. Demichelis,et al.  Completeness of reporting trial results: effect on physicians' willingness to prescribe , 1994, The Lancet.

[88]  J H Ellenberg,et al.  Analysis of clinical trials by treatment actually received: is it really an option? , 1991, Statistics in medicine.

[89]  P. Ridker,et al.  A Response to Holding GUSTO Up to the Light , 1994, Annals of Internal Medicine.

[90]  C Norman,et al.  Stanford inquiry casts doubt on 11 papers. , 1988, Science.

[91]  K. Dickersin,et al.  Factors influencing publication of research results. Follow-up of applications submitted to two institutional review boards. , 1992, JAMA.

[92]  M. Cho,et al.  The Quality of Drug Studies Published in Symposium Proceedings , 1996, Annals of Internal Medicine.

[93]  Clinical-trial registration: a call for its implementation in Canada. , 1993, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[94]  K. Dickersin,et al.  Regulatory process effects clinical trial registration in Spain. , 1992, Controlled clinical trials.

[95]  D. Rennie,et al.  The Second International Congress on Peer Review in Biomedical Publication. , 1994, Journal of the American Medical Association (JAMA).

[96]  INFORMATION FOR DRUG TRIAL PARTICIPANTS , 1987, The Lancet.

[97]  M. Cho,et al.  Instruments for assessing the quality of drug studies published in the medical literature. , 1994, JAMA.

[98]  N. Winer,et al.  Effects of pindolol and methyldopa on blood pressure and plasma norepinephrine. , 1982, American heart journal.

[99]  P. Rochon,et al.  Evaluating the quality of articles published in journal supplements compared with the quality of those published in the parent journal. , 1994, JAMA.

[100]  S. Glantz,et al.  Tobacco industry response to a risk assessment of environmental tobacco smoke , 1993 .

[101]  K J Rothman,et al.  The continuing unethical use of placebo controls. , 1994, The New England journal of medicine.

[102]  Drummond Rennie,et al.  Editorial Peer Review in Biomedical Publication: The First International Congress , 1990 .

[103]  C. Borland,et al.  NO and CO transfer. , 1990, The European respiratory journal.

[104]  N. Bellamy,et al.  Comparison of amitriptyline, cyclobenzaprine, and placebo in the treatment of fibromyalgia. A randomized, double-blind clinical trial. , 1994, Arthritis and rheumatism.

[105]  Gordon H. Guyatt,et al.  Users' guides to the medical literature. II. How to use an article about therapy or prevention. A. Are the results of the study valid? Evidence-Based Medicine Working Group. , 1993, JAMA.

[106]  G H Guyatt,et al.  USERS' GUIDES TO THE MEDICAL LITERATURE. II: HOW TO USE AN ARTICLE ABOUT THERAPY OR PREVENTION A. ARE THE RESULTS OF THE STUDY VALID ? , 1993 .