2 – Assessing Available Information

Access to information is no longer a limiting factor in scientific progress. All the data generated in a study should be made available for scrutiny. Internet technology has made space limitations imposed by print journals obsolete. Data sets that are prohibitively large to be included in print form, such as those arising from DNA microarray studies, are being made available via Internet web sites. Similarly, comprehensive data sets should be made available for all studies, including clinical trials. All raw data and calculations should be made available, including those for individual experiments that “failed to work” for whatever reason. The practice of reporting data only from the subset of experiments that yielded data consistent with the hypothesis should be abandoned. The results of all studies, even ones in which the null hypothesis was supported (negative studies), should be reported. Such negative results, assuming the study was conducted and interpreted correctly, provide valid and potentially important information. This should be a requirement for all studies conducted with public funds, even incorrectly conducted studies. This information would be useful in making funding decisions. Regardless of how scientific information is communicated, its critical evaluation always will remain central to the scientific enterprise. This skill must be learned and practiced by its participants.

[1]  Gordon H. Guyatt,et al.  How to Use an Article About Therapy or Prevention , 1995 .

[2]  J. Ioannidis,et al.  Quantitative Synthesis in Systematic Reviews , 1997, Annals of Internal Medicine.

[3]  R. Wears,et al.  Positive-outcome bias and other limitations in the outcome of research abstracts submitted to a scientific meeting. , 1998, JAMA.

[4]  J. Vandenbroucke,et al.  175th anniversary lecture. Medical journals and the shaping of medical knowledge. , 1998, The Lancet.

[5]  J A Kelly,et al.  Scientific meeting abstracts: significance, access, and trends. , 1998, Bulletin of the Medical Library Association.

[6]  Garfield Eugene,et al.  SCI journal citation reports : a bibliometric analysis of science journals in the ISI data base. 1981 annual , 1982 .

[7]  David Haber,et al.  Guide to clinical preventive services: a challenge to physician resourcefulness , 1993 .

[8]  K A McKibbon,et al.  Locating and Appraising Systematic Reviews , 1997, Annals of Internal Medicine.

[9]  M. Evans,et al.  Trials on trial. A review of trials of antibiotic prophylaxis. , 1984, Archives of surgery.

[10]  G H Guyatt,et al.  USERS' GUIDES TO THE MEDICAL LITERATURE. II: HOW TO USE AN ARTICLE ABOUT THERAPY OR PREVENTION A. ARE THE RESULTS OF THE STUDY VALID ? , 1993 .

[11]  Gordon Tullock,et al.  Trials On Trial , 1980 .

[12]  K. Dickersin,et al.  Full publication of results initially presented in abstracts. A meta-analysis. , 1994 .

[13]  Gordon H. Guyatt,et al.  Users' Guides to the Medical Literature: VIII. How to Use Clinical Practice Guidelines A. Are the Recommendations Valid? , 1995 .

[14]  C. Junker Adherence to published standards of reporting: a comparison of placebo-controlled trials published in English or German. , 1998, JAMA.

[15]  D. Sackett Bias in analytic research. , 1979, Journal of chronic diseases.

[16]  P. Seglen,et al.  Citations and journal impact factors: questionable indicators of research quality , 1997, Allergy.