Electronic Trial Banks: A Complementary Method for Reporting Randomized Trials

Background. Randomized clinical trial (RCT) results are often difficult to find, interpret, or apply to clinical care. The authors propose that RCTs be reported into electronic knowledge bases—trial banks—in addition to being reported in text. What information should these trial-bank reports contain? Methods. Using the competency decomposition method, the authors specified the ideal trial-bank contents as the information necessary and sufficient for completing the task of systematic reviewing. Results. They decomposed the systematic reviewing task into four top-level tasks and 62 subtasks. 162 types of trial information were necessary and sufficient for completing these subtasks. These items relate to a trial's design, execution, administration, and results. Conclusion. Trial-bank publishing of these 162 items would capture into computer-understandable form all the trial information needed for critically appraising and synthesizing trial results. Decision-support systems that access shared, up-to-date trial banks could help clinicians manage, synthesize, and apply RCT evidence more effectively. Key words: electronic publishing; knowledge bases; clinical trials; meta-analysis. (Med Decis Making 2000;20:440-450)

[1]  S. Glantz Biostatistics: how to detect, correct and prevent errors in the medical literature. , 1980, Circulation.

[2]  T C Chalmers,et al.  A method for assessing the quality of a randomized control trial. , 1981, Controlled clinical trials.

[3]  E Andrew,et al.  Method for Assessment of the Reporting Standard of Clinical Trials with Roentgen Contrast Media , 1984, Acta radiologica: diagnosis.

[4]  C. Meinert,et al.  Content of reports on clinical trials: a critical review. , 1984, Controlled clinical trials.

[5]  M. Evans,et al.  A score system for evaluating random control clinical trials of prophylaxis of abdominal surgical wound infection , 1985, The British journal of surgery.

[6]  R. Simes Publication bias: the case for an international registry of clinical trials. , 1986, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[7]  S. Pocock,et al.  Statistical problems in the reporting of clinical trials. A survey of three medical journals. , 1987, The New England journal of medicine.

[8]  J C Bailar,et al.  Guidelines for statistical reporting in articles for medical journals. Amplifications and explanations. , 1988, Annals of internal medicine.

[9]  J. Tyson,et al.  Aid to the evaluation of therapeutic studies. , 1989, Pediatrics.

[10]  Submission of data to GenBank. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[11]  F. Mosteller,et al.  How study design affects outcomes in comparisons of therapy. I: Medical. , 1989, Statistics in medicine.

[12]  E. Huth,et al.  The underused medical literature. , 1989, Annals of internal medicine.

[13]  I. Chalmers,et al.  A cohort study of summary reports of controlled trials. , 1990, JAMA.

[14]  K. Dickersin The existence of publication bias and risk factors for its occurrence. , 1990, JAMA.

[15]  R B Haynes,et al.  Loose connections between peer-reviewed clinical journals and clinical practice. , 1990, Annals of internal medicine.

[16]  J. Kleijnen,et al.  Acupuncture and chronic pain: a criteria-based meta-analysis. , 1990, Journal of clinical epidemiology.

[17]  T. Imperiale,et al.  Do corticosteroids reduce mortality from alcoholic hepatitis? A meta-analysis of the randomized trials. , 1990, Annals of internal medicine.

[18]  J. Kleijnen,et al.  Clinical trials of homoeopathy. , 1991, BMJ.

[19]  C Burks,et al.  Electronic data publishing and GenBank. , 1991, Science.

[20]  S A Brown,et al.  Measurement of Quality of Primary Studies for Meta‐Analysis , 1991, Nursing research.

[21]  L M Bouter,et al.  Spinal manipulation and mobilisation for back and neck pain: a blinded review. , 1991, BMJ.

[22]  S M Nazarian,et al.  Warfarin in the prevention of stroke associated with nonrheumatic atrial fibrillation. Veterans Affairs Stroke Prevention in Nonrheumatic Atrial Fibrillation Investigators. , 1992, The New England journal of medicine.

[23]  C D Naylor,et al.  Incorporating variations in the quality of individual randomized trials into meta-analysis. , 1992, Journal of clinical epidemiology.

[24]  Kay Dickersin,et al.  Keeping posted Why register clinical trials?-Revisited , 1992 .

[25]  P. Easterbrook Directory of registries of clinical trials. , 1992, Statistics in medicine.

[26]  G H Guyatt,et al.  Respiratory muscle training in chronic airflow limitation: a meta-analysis. , 1992, The American review of respiratory disease.

[27]  Patrick Onghena,et al.  Antidepressant-induced analgesia in chronic non-malignant pain: a meta-analysis of 39 placebo-controlled studies , 1992, Pain.

[28]  S. M. Gore,et al.  The Lancet's statistical review process: areas for improvement by authors , 1992, The Lancet.

[29]  J. Vandenbroucke,et al.  Low-molecular-weight heparin versus standard heparin in general and orthopaedic surgery: a meta-analysis , 1992, The Lancet.

[30]  K. Dickersin,et al.  Why register clinical trials?--Revisited. , 1992, Controlled clinical trials.

[31]  Todd R. Johnson,et al.  Generic tasks and task structures: history, critique and new directions , 1993 .

[32]  M. Parmar,et al.  Meta-analysis of the literature or of individual patient data: is there a difference? , 1993, The Lancet.

[33]  J. Lau,et al.  Meta-analytic stimulus for changes in clinical trials , 1993, Statistical methods in medical research.

[34]  Clinical-trial registration: a call for its implementation in Canada. , 1993, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[35]  D. H. Williams,et al.  Reporting of assignment methods in clinical trials. , 1994, Controlled clinical trials.

[36]  S. Goodman,et al.  Manuscript Quality before and after Peer Review and Editing at Annals of Internal Medicine , 1994, Annals of Internal Medicine.

[37]  A. Haines,et al.  Implementing findings of research , 1994, BMJ.

[38]  L. Stewart,et al.  Systematic Reviews: Obtaining data from randomised controlled trials: how much do we need for reliable and informative meta-analyses? , 1994 .

[39]  K. Dickersin,et al.  Systematic Reviews: Identifying relevant studies for systematic reviews , 1994 .

[40]  K. Dickersin,et al.  Full publication of results initially presented in abstracts. A meta-analysis. , 1994 .

[41]  R. Brian Haynes,et al.  Research Paper: Performances of 27 MEDLINE systems tested by searches with clinical questions , 1994, J. Am. Medical Informatics Assoc..

[42]  G H Guyatt,et al.  Users' guides to the medical literature. VI. How to use an overview. Evidence-Based Medicine Working Group. , 1994, JAMA.

[43]  J. Buring,et al.  The benefits of aspirin in acute myocardial infarction. Still a well-kept secret in the United States. , 1994, Archives of internal medicine.

[44]  M. Cho,et al.  Instruments for assessing the quality of drug studies published in the medical literature. , 1994, JAMA.

[45]  D G Altman,et al.  Assessing the quality of randomization from reports of controlled trials published in obstetrics and gynecology journals. , 1994, JAMA.

[46]  L F Burmeister,et al.  A comparison of meta-analytic results using literature vs individual patient data. Paternal cell immunization for recurrent miscarriage. , 1995, JAMA.

[47]  C Safran,et al.  Guidelines for management of HIV infection with computer-based patient's record , 1995, The Lancet.

[48]  W. Spitzer,et al.  Scientific monograph of the Quebec Task Force on Whiplash-Associated Disorders: redefining "whiplash" and its management. , 1995, Spine.

[49]  Les M Irwig,et al.  An evidence based approach to individualising treatment , 1995, BMJ.

[50]  D. Cook,et al.  Methodologic guidelines for systematic reviews of randomized control trials in health care from the Potsdam Consultation on Meta-Analysis. , 1995, Journal of clinical epidemiology.

[51]  Hubbard Sm,et al.  NCI's cancer information systems--bringing medical knowledge to clinicians. , 1995 .

[52]  D. Rennie,et al.  The Cochrane Collaboration. Preparing, maintaining, and disseminating systematic reviews of the effects of health care. , 1995, JAMA.

[53]  Applying the findings of clinical trials to individual patients. , 1995, ACP journal club.

[54]  M. Clarke,et al.  Identifying relevant studies for systematic reviews , 1995, BMJ.

[55]  P C Deedwania,et al.  Amiodarone in patients with congestive heart failure and asymptomatic ventricular arrhythmia. Survival Trial of Antiarrhythmic Therapy in Congestive Heart Failure. , 1995, The New England journal of medicine.

[56]  R E LaPorte,et al.  The death of biomedical journals , 1995, BMJ.

[57]  D. Brand,et al.  Cardiologists' practices compared with practice guidelines: use of beta-blockade after acute myocardial infarction. , 1995, Journal of the American College of Cardiology.

[58]  A R Jadad,et al.  Assessing the quality of randomized controlled trials: an annotated bibliography of scales and checklists. , 1995, Controlled clinical trials.

[59]  D. Warner,et al.  Statistical power, sample size, and their reporting in randomized controlled trials , 1995 .

[60]  G. Taubes Electronic Preprints Point the Way to ‘Author Empowerment’ , 1996, Science.

[61]  T Delamothe,et al.  Whose data are they anyway? , 1996, BMJ.

[62]  I. Olkin,et al.  Improving the quality of reporting of randomized controlled trials. The CONSORT statement. , 1996, JAMA.

[63]  J. Cimino Review Paper: Coding Systems in Health Care , 1995, Methods of Information in Medicine.

[64]  D K Owens,et al.  Presentation and explanation of medical decision models using the World Wide Web. , 1996, Proceedings : a conference of the American Medical Informatics Association. AMIA Fall Symposium.

[65]  The message, the medium, and The Lancet , 1996, The Lancet.

[66]  D. Cook,et al.  Systematic Reviews: Synthesis of Best Evidence for Clinical Decisions , 1997, Annals of Internal Medicine.

[67]  W. Aronow,et al.  Underutilization of Beta‐Blockers in Older Patients With Prior Myocardial Infarction or Coronary Artery Disease in an Academic, Hospital‐Based Geriatrics Practice , 1997, Journal of the American Geriatrics Society.

[68]  Whose data are they anyway? Food industry could be misusing data. , 1997, BMJ.

[69]  L Sweeney,et al.  Weaving Technology and Policy Together to Maintain Confidentiality , 1997, Journal of Law, Medicine & Ethics.

[70]  K A McKibbon,et al.  Locating and Appraising Systematic Reviews , 1997, Annals of Internal Medicine.

[71]  J. Wennberg,et al.  A JAMA theme issue on quality of care. A new proposal and a call to action. , 1997, JAMA.

[72]  R. Soetikno,et al.  Quality-of-life research on the Internet: feasibility and potential biases in patients with ulcerative colitis. , 1997, Journal of the American Medical Informatics Association : JAMIA.

[73]  W. Hammond,et al.  Computerized decision support based on a clinical practice guideline improves compliance with care standards. , 1997, The American journal of medicine.

[74]  I Chalmers,et al.  Discussion sections in reports of controlled trials published in general medical journals: islands in search of continents? , 1998, JAMA.

[75]  D Moher,et al.  CONSORT: an evolving tool to help improve the quality of reports of randomized controlled trials. Consolidated Standards of Reporting Trials. , 1998, JAMA.

[76]  W Gardner,et al.  Database Protection and Access to Information , 1998, Science.

[77]  C. Meinert Beyond CONSORT: need for improved reporting standards for clinical trials. Consolidated Standards of Reporting Trials. , 1998, JAMA.

[78]  Thomas J. Walker,et al.  Free Internet Access to Traditional Journals , 1998 .

[79]  J. Ioannidis Effect of the statistical significance of results on the time to completion and publication of randomized efficacy trials. , 1998, JAMA.

[80]  Gwendolyn Halford,et al.  CSIS Website: Center for Strategic and International Studies , 2000 .

[81]  Ellen Fineout-Overholt,et al.  Users' Guides to the Medical Literature , 2002 .