The misuse and abuse of statistics in biomedical research

Statistics are the primary tools for assessing relationships and evaluating study questions. Unfortunately, these tools are often misused, either inadvertently because of ignorance or lack of planning, or conspicuously to achieve a specified result. Data abuses include the incorrect application of statistical tests, lack of transparency and disclosure about decisions that are made, incomplete or incorrect multivariate model building, or exclusion of outliers. Individually, each of these actions may completely invalidate a study, and often studies are victim to more than one offense. Increasingly there are tools and guidance for researchers to look to, including the development of an analysis plan and a series of study specific checklists, in order to prevent or mitigate these offenses.

[1]  W. Sauerbrei,et al.  STRengthening Analytical Thinking for Observational Studies: the STRATOS initiative , 2014, Statistics in medicine.

[2]  D. Rennie,et al.  Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative , 2003, Annals of Internal Medicine.

[3]  Douglas G. Altman,et al.  Statistics and ethics in medical research , 1981 .

[4]  D. Fanelli.  How Many Scientists Fabricate and Falsify Research? A Systematic Review and Meta-Analysis of Survey Data , 2009, PloS one.

[5]  S. Schor,et al.  Statistical evaluation of medical journal manuscripts. , 1966, JAMA.

[6]  D. Moher,et al.  The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials , 2001, The Lancet.

[7]  张静,et al.  Banana Ovate family protein MaOFP1 and MADS-box protein MuMADS1 antagonistically regulated banana fruit ripening , 2015 .

[8]  Xianggui Qu,et al.  Multivariate Data Analysis , 2007, Technometrics.

[9]  I. Hertz-Picciotto,et al.  Methods of covariate selection: directed acyclic graphs and the change-in-estimate procedure. , 2009, American journal of epidemiology.

[10]  J Jamart,et al.  Statistical tests in medical research. , 1992, Acta oncologica.

[11]  Johannes Lenhard,et al.  Models and Statistical Inference: The Controversy between Fisher and Neyman–Pearson , 2006, The British Journal for the Philosophy of Science.

[12]  J. Holden,et al.  Hawthorne effects and research into professional practice. , 2001, Journal of evaluation in clinical practice.

[13]  B. H. Layne,et al.  Low power, type II errors, and other statistical problems in recent cardiovascular research. , 1997, The American journal of physiology.

[14]  R F Meenan,et al.  Misuse of statistical methods in Arthritis and Rheumatism. 1982 versus 1967-68. , 1984, Arthritis and rheumatism.

[15]  S. Pocock,et al.  The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. , 2007, Preventive medicine.

[16]  Ryan E Wiegand,et al.  Performance of using multiple stepwise algorithms for variable selection , 2010, Statistics in medicine.

[17]  AD Gore,et al.  Application of biostatistics in research by teaching faculty and final-year postgraduate students in colleges of modern medicine: A cross-sectional study , 2012, International journal of applied & basic medical research.

[18]  Abdelmonem A. Afifi,et al.  Comparison of Stopping Rules in Forward , 2016 .

[19]  D G Altman,et al.  Statistics and ethics in medical research. Misuse of statistics is unethical. , 1980, British medical journal.

[20]  James O. Berger,et al.  The interplay of Bayesian and frequentist analysis , 2004 .

[21]  Neil Malhotra,et al.  Publication bias in the social sciences: Unlocking the file drawer , 2014, Science.

[22]  Matthew S. Thiese,et al.  Special issue: Responsible writing in science , 2014 .

[23]  B. Efron.  Bayesians, Frequentists, and Scientists , 2005 .

[24]  David Moher,et al.  The STARD Statement for Reporting Studies of Diagnostic Accuracy: Explanation and Elaboration , 2003, Annals of Internal Medicine [serial online].

[25]  Abraham Wald,et al.  Estimation of a Parameter When the Number of Unknown Parameters Increases Indefinitely with the Number of Observations , 1948 .

[26]  Berna Yazici,et al.  MISUSAGE OF STATISTICS IN MEDICAL RESEARCH , 2007 .

[27]  Douglas G Altman,et al.  The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: guidelines for reporting observational studies. , 2014, International journal of surgery.

[28]  H. Keselman,et al.  Backward, forward and stepwise automated subset selection algorithms: Frequency of obtaining authentic and noise variables , 1992 .

[29]  S J White,et al.  Statistical Errors in Papers in the British Journal of Psychiatry , 1979, British Journal of Psychiatry.

[30]  A R Feinstein,et al.  XXV. A survey of the statistical procedures in general medical journals , 1974, Clinical pharmacology and therapeutics.

[31]  Gerald E Welch,et al.  Statistics usage in the American Journal of Obstetrics and Gynecology: has anything changed? , 2002, American journal of obstetrics and gynecology.

[32]  J. Ioannidis,et al.  Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias , 2008, PloS one.

[33]  Suk Jin Hong,et al.  Assessment of errors and misused statistics in dental research. , 2011, International dental journal.

[34]  A. H. Leyland,et al.  What do doctors know of statistics? , 1991, The Lancet.

[35]  S M Gore,et al.  Misuse of statistical methods: critical assessment of articles in BMJ from January to March 1976. , 1977, British medical journal.

[36]  D. Moher,et al.  The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. , 2001, Journal of the American Podiatric Medical Association.

[37]  D G Altman,et al.  Misleading statistics: errors in textbooks, software and manuals. , 1988, International journal of epidemiology.

[38]  R. Fisher,et al.  STATISTICAL METHODS AND SCIENTIFIC INDUCTION , 1955 .

[39]  A. Madansky.  Identification of Outliers , 1988 .

[40]  Karl P. Pfeiffer,et al.  Statistical errors in medical research--a review of common pitfalls. , 2007, Swiss medical weekly.

[41]  S. Glantz.  Biostatistics: how to detect, correct and prevent errors in the medical literature. , 1980, Circulation.

[42]  David T. Felson Md Fellow in Rheumatology.  Misuse of statistical methods in arthritis and rheumatism , 2005 .

[43]  Douglas G Altman,et al.  Basic statistical reporting for articles published in biomedical journals: the "Statistical Analyses and Methods in the Published Literature" or the SAMPL Guidelines. , 2015, International journal of nursing studies.

[44]  Ian Shrier,et al.  Reducing bias through directed acyclic graphs , 2008 .

[45]  A. Afifi,et al.  Comparison of Stopping Rules in Forward “Stepwise” Regression , 1977 .

[46]  T. Perneger.  What's wrong with Bonferroni adjustments , 1998, BMJ.

[47]  P. Royston,et al.  Selection of important variables and determination of functional form for continuous predictors in multivariable model building , 2007, Statistics in medicine.