Many perspectives on Deborah Mayo's "Statistical Inference as Severe Testing: How to Get Beyond the Statistics Wars"

The new book by philosopher Deborah Mayo is relevant to data science for topical reasons, as she takes various controversial positions regarding hypothesis testing and statistical practice, and also as an entry point to thinking about the philosophy of statistics. The present article is a slightly expanded version of a series of informal reviews and comments on Mayo's book. We hope this discussion will introduce people to Mayo's ideas along with other perspectives on the topics she addresses.

[1]  The effect of preliminary normality goodness of fit tests on subsequent inference. , 1978 .

[2]  A. Spanos.  Recurring controversies about P values and confidence intervals revisited. , 2014, Ecology.

[3]  R. Harris,et al.  Rigor Mortis: How Sloppy Science Creates Worthless Cures, Crushes Hope, and Wastes Billions , 2017 .

[4]  D. Donoho.  One-sided inference about functionals of a density , 1988 .

[5]  J. Woodward,et al.  Saving the phenomena , 1988 .

[6]  A. Gelman,et al.  Beyond subjective and objective in statistics , 2015, 1508.05453.

[7]  Joseph Hilbe,et al.  Data Analysis Using Regression and Multilevel/Hierarchical Models , 2009 .

[8]  Brian D. Haig,et al.  The Philosophy of Quantitative Methods , 2018 .

[9]  Hasok Chang.  Is water H[2]O? : evidence, realism and pluralism , 2012 .

[10]  E. Wagenmakers.  A practical solution to the pervasive problems ofp values , 2007, Psychonomic bulletin & review.

[11]  James V. Zidek,et al.  Multi-Bayesian Statistical Decision Theory , 1981 .

[12]  Heike Freud,et al.  Error And The Growth Of Experimental Knowledge , 2016 .

[13]  Kevin T. Kelly,et al.  Why Probability Does Not Capture the Logic of Scientific Justification , 2004 .

[14]  B. Haig.  Tests of Statistical Significance Made Sound , 2017, Educational and psychological measurement.

[15]  G. Cumming,et al.  The New Statistics , 2014, Psychological science.

[16]  B. Ripley,et al.  Robust Statistics , 2018, Encyclopedia of Mathematical Geosciences.

[17]  Celia M. Lombardi,et al.  Final Collapse of the Neyman-Pearson Decision Theoretic Framework and Rise of the neoFisherian , 2009 .

[18]  G. Imbens,et al.  Why Ask Why? Forward Causal Inference and Reverse Causal Questions , 2013 .

[19]  Christian Hennig,et al.  Mathematical Models and Reality: A Constructivist Perspective , 2010 .

[20]  Ron S. Kenett,et al.  Generalizing Research Findings for Enhanced Reproducibility: A Translational Medicine Case Study , 2017 .

[21]  Jeffrey N. Rouder,et al.  Robust misinterpretation of confidence intervals , 2013, Psychonomic bulletin & review.

[22]  G. Cumming.  Understanding the New Statistics: Effect Sizes, Confidence Intervals, and Meta-Analysis , 2011 .

[23]  Siddharth Kalla.  of Error (Statistics) , 2010 .

[24]  Z. Dienes.  Bayesian Versus Orthodox Statistics: Which Side Are You On? , 2011, Perspectives on psychological science : a journal of the Association for Psychological Science.

[25]  Deborah G. Mayo,et al.  Statistical Inference as Severe Testing , 2018 .

[26]  Galit Shmueli,et al.  Information Quality: The Potential of Data and Analytics to Generate Knowledge , 2016 .

[27]  H. Kyburg.  The Scope of Bayesian Reasoning , 1992, PSA: Proceedings of the Biennial Meeting of the Philosophy of Science Association.

[28]  Cosma Rohilla Shalizi,et al.  Philosophy and the practice of Bayesian statistics. , 2010, The British journal of mathematical and statistical psychology.

[29]  C. Hennig.  Falsification of Propensity Models by Statistical Tests and the Goodness-of-Fit Paradox , 2007 .

[30]  How to practise Bayesian statistics outside the Bayesian church: what philosophy for Bayesian statistical modelling? , 2013, The British journal of mathematical and statistical psychology.

[31]  George E. P. Box,et al.  Sampling and Bayes' inference in scientific modelling and robustness , 1980 .

[32]  The Seven Deadly Sins of Psychology , 2019 .

[33]  Jan de Leeuw,et al.  MODELS OF DATA , 2000 .

[34]  B. Haig.  Investigating the Psychological World: Scientific Method in the Behavioral Sciences , 2014 .