Frequentist and Bayesian approaches to data analysis: Evaluation and estimation

Statistical thinking is essential to understanding the nature of scientific results as a consumer. Statistical thinking also facilitates thinking like a scientist. Instead of emphasizing a “correct” procedure for data analysis and its outcome, statistical thinking focuses on the process of data analysis. This article reviews frequentist and Bayesian approaches such that teachers can promote less well-known statistical perspectives to encourage statistical thinking. Within the frequentist and Bayesian approaches, we highlight important distinctions between statistical evaluation versus estimation using an example on the facial feedback hypothesis. We first introduce some elementary statistical concepts, which are then illustrated with simulated data. Finally, we demonstrate how these approaches are applied to empirical data obtained from a Registered Replication Report. Data and R code for the example are provided as supplementary teaching material. We conclude with a discussion of key learning outcomes centred on promoting statistical thinking.

[1]  Jeffrey N. Rouder,et al.  Teaching Bayes’ Theorem: Strength of Evidence as Predictive Accuracy , 2018, The American Statistician.

[2]  F. Strack,et al.  Inhibiting and facilitating conditions of the human smile: a nonobtrusive test of the facial feedback hypothesis. , 1988, Journal of personality and social psychology.

[3]  Richard D. Morey,et al.  Baysefactor: Computation of Bayes Factors for Common Designs , 2018 .

[4]  Rolf A. Zwaan,et al.  Registered Replication Report , 2016, Perspectives on psychological science : a journal of the Association for Psychological Science.

[5]  M. Jeon,et al.  Decision Qualities of Bayes Factor and p Value-Based Hypothesis Testing , 2017, Psychological methods.

[6]  Gerd Gigerenzer,et al.  Statistical Rituals: The Replication Delusion and How We Got There , 2018, Advances in Methods and Practices in Psychological Science.

[7]  A. Marsh,et al.  A multi-semester classroom demonstration yields evidence in support of the facial feedback effect. , 2019, Emotion.

[8]  John W. Tukey,et al.  Analyzing data: Sanctification or detective work? , 1969 .

[9]  G. Gigerenzer Mindless statistics , 2004 .

[10]  E. S. Pearson,et al.  ON THE USE AND INTERPRETATION OF CERTAIN TEST CRITERIA FOR PURPOSES OF STATISTICAL INFERENCE PART I , 1928 .

[11]  C. Wild,et al.  Statistical Thinking in Empirical Enquiry , 1999 .

[12]  Helen M. Doerr,et al.  A modeling perspective on student's mathematical reasoning about data , 2003 .

[13]  C. Robert,et al.  Understanding Computational Bayesian Statistics , 2009 .

[14]  J. Rodgers The epistemology of mathematical and statistical modeling: a quiet methodological revolution. , 2010, The American psychologist.

[15]  Donald A. Berry Teaching Elementary Bayesian Statistics with Real Applications in Science , 1997 .

[16]  E. Wagenmakers,et al.  Harold Jeffreys’s default Bayes factor hypothesis tests: Explanation, extension, and application in psychology , 2016 .

[17]  G. Cumming,et al.  The New Statistics , 2014, Psychological science.

[18]  Torrin M. Liddell,et al.  Bayesian data analysis for newcomers , 2018, Psychonomic bulletin & review.

[19]  E. Lehmann The Fisher, Neyman-Pearson Theories of Testing Hypotheses: One Theory or Two? , 1993 .

[20]  R. Abelson Statistics As Principled Argument , 1995 .

[21]  Jolynn Pek,et al.  Reporting Effect Sizes in Original Psychological Research: A Discussion and Tutorial , 2017, Psychological methods.

[22]  M. Kendall Statistical Methods for Research Workers , 1937, Nature.