Ten rules for reading clinical research reports.

This was not a scientific assessment of the scientific quality of the papers published by The American Journal of Surgery. It was an informal audit of the adequacy of the data analysis in the clinical research reports appearing in the 1987-1988 issues. As one who has devoted more than three decades to helping a great variety of people make sense of scientific data, I found the overall quality of data analysis in these papers to be above average for the medical literature; and yet, I found many instances of errors so serious as to render invalid the conclusions of the authors. My 10 proposed rules for reading clinical research reports constitute only an interim solution to a very worrisome problem. The real solution must come from the producers of and the gatekeepers for the medical literature.

[1]  W. Hong,et al.  Polyamine metabolism in carcinoma of the oral cavity compared with adjacent and normal oral mucosa. , 1987, American journal of surgery.

[2]  J C Bailar,et al.  Guidelines for statistical reporting in articles for medical journals. Amplifications and explanations. , 1988, Annals of internal medicine.

[3]  T. J. Sheehan,et al.  The medical literature. Let the reader beware. , 1980, Archives of internal medicine.

[4]  A. W. Kemp,et al.  Medical Uses of Statistics. , 1994 .

[5]  T. J. Breen,et al.  Biostatistical Analysis (2nd ed.). , 1986 .

[6]  J C Bailar,et al.  Science, statistics, and deception. , 1986, Annals of internal medicine.

[7]  S M Gore,et al.  Misuse of statistical methods: critical assessment of articles in BMJ from January to March 1976. , 1977, British medical journal.

[8]  Joel Kupfersmid,et al.  Improving what is published: A model in search of an editor. , 1988 .

[9]  G. Murray,et al.  The task of a statistical referee , 1988, The British journal of surgery.

[10]  T. Kuhn,et al.  The Structure of Scientific Revolutions , 1963 .

[11]  S. Schor,et al.  Statistical evaluation of medical journal manuscripts. , 1966, JAMA.

[12]  F M Eckel,et al.  Statistical and research quality of the medical and pharmacy literature. , 1985, American journal of hospital pharmacy.

[13]  Frederick Mosteller,et al.  Reporting on methods in clinical trials. , 1982, The New England journal of medicine.

[14]  C. Arnau,et al.  Antibiotic prophylaxis with cefotaxime in gastroduodenal and biliary surgery. , 1989, American journal of surgery.

[15]  T C Chalmers,et al.  The importance of beta, the type II error and sample size in the design and interpretation of the randomized control trial. Survey of 71 "negative" trials. , 1978, The New England journal of medicine.

[16]  S. Pocock,et al.  Statistical problems in the reporting of clinical trials. A survey of three medical journals. , 1987, The New England journal of medicine.

[17]  S Schor Statistical proof in inconclusive 'negative' trials. , 1981, Archives of internal medicine.

[18]  J. Reed,et al.  Statistical proof in inconclusive 'negative' trials. , 1981, Archives of internal medicine.

[19]  M D Grossman,et al.  Effect of delayed operation for bleeding esophageal varices on Child's class and indices of liver function. , 1988, American journal of surgery.

[20]  David S. Salsburg,et al.  The Religion of Statistics as Practiced in Medical Journals , 1985 .