Play It Again: Teaching Statistics With Monte Carlo Simulation

ABSTRACT Monte Carlo simulations (MCSs) provide important information about statistical phenomena that would be impossible to assess otherwise. This article introduces MCS methods and their applications to research and statistical pedagogy using a novel software package for the R Project for Statistical Computing constructed to lessen the often steep learning curve when organizing simulation code. A primary goal of this article is to demonstrate how well-suited MCS designs are to classroom demonstrations, and how they provide a hands-on method for students to become acquainted with complex statistical concepts. In this article, essential programming aspects for writing MCS code in R are overviewed, multiple applied examples with relevant code are provided, and the benefits of using a generate–analyze–summarize coding structure over the typical “for-loop” strategy are discussed.

[1]  Tim Everton.  Probabilistic Simulation In The Classroom , 1984 .

[2]  Moritz Heene,et al.  Sensitivity of SEM Fit Indexes With Respect to Violations of Uncorrelated Errors , 2012 .

[3]  Reidar Hagtvedt,et al.  Teaching Confidence Intervals Using Simulation , 2008 .

[4]  Nicholas K Tulach,et al.  Do lower income areas have more pedestrian casualties? , 2013, Accident; analysis and prevention.

[5]  Brian C. Castrucci,et al.  Teen Pregnancy in Texas: 2005 to 2015 , 2008, Maternal and Child Health Journal.

[6]  Robert McDougall,et al.  Teachers and Textbooks: On Statistical Definitions in Senior Secondary Mathematics , 2015 .

[7]  Alyssa Counsell,et al.  It Might Not Make a Big DIF , 2016, Educational and psychological measurement.

[8]  Sanford Weisberg,et al.  An R Companion to Applied Regression , 2010 .

[9]  Yang Liu,et al.  Profile-likelihood Confidence Intervals in Item Response Theory Models , 2017, Multivariate behavioral research.

[10]  Joan Garfield,et al.  How students learn statistics , 1995 .

[11]  Sheldon M. Ross.  Chapter 12 – Markov Chain Monte Carlo Methods , 2013 .

[12]  Calin Vamos,et al.  Monte Carlo Experiments , 2012 .

[13]  Terri Gullickson.  The Psychology Research Handbook: A Guide for Graduate Students and Research Assistants. , 1997 .

[14]  Paul Teetor,et al.  R Cookbook , 2011 .

[15]  Paul J. Campbell,et al.  Teaching Statistics: A Bag of Tricks , 2005 .

[16]  Gordon P. Brooks,et al.  Using Monte Carlo Software to Teach Abstract Statistical Concepts: A Case Study , 2005 .

[17]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[18]  Anna Reid,et al.  Students' Conceptions of Statistics: A Phenomenographic Study , 2002 .

[19]  Jj Allaire,et al.  Web Application Framework for R , 2016 .

[20]  Andrew P. Robinson,et al.  Introduction to Scientific Programming and Simulation Using R , 2014 .

[21]  Philip H. Ramsey,et al.  Power and Type I errors for pairwise comparisons of means in the unequal variances case. , 2009, The British journal of mathematical and statistical psychology.

[22]  R. Philip Chalmers,et al.  Extended Mixed-Effects Item Response Models With the MH-RM Algorithm , 2015 .

[23]  Daniel A. Sass,et al.  Evaluating Model Fit With Ordered Categorical Data Within a Measurement Invariance Framework: A Comparison of Estimators , 2014 .

[24]  John D. McKenzie,et al.  Creating Realistic Data Sets with Specified Properties via Simulation , 2009 .

[25]  Felix D. Schönbrodt,et al.  At what sample size do correlations stabilize , 2013 .

[26]  Maximum-Likelihood Estimation of Noncompensatory IRT Models With the MH-RM Algorithm , 2014 .

[27]  David M. Lane.  Simulations of the Sampling Distribution of the Mean Do Not Necessarily Mislead and Can Facilitate Learning , 2015 .

[28]  J. Wiley,et al.  Advanced R , 2016, Apress.

[29]  Kenneth A. Bollen,et al.  Monte Carlo Experiments: Design and Implementation , 2001 .

[30]  Jamie D. Mills,et al.  Using Computer Simulation Methods to Teach Statistics: A Review of the Literature , 2002 .

[31]  Hadley Wickham,et al.  ggplot2 - Elegant Graphics for Data Analysis (2nd Edition) , 2017 .

[32]  Dani Ben-Zvi,et al.  How Students Learn Statistics Revisited: A Current Review of Research on Teaching and Learning Statistics , 2007 .

[33]  Jacob Cohen,et al.  THINGS I HAVE LEARNED (SO FAR) , 1990 .

[34]  Norman Matloff,et al.  The Art of R Programming: A Tour of Statistical Software Design , 2011 .

[35]  Alan T. Arnholt.  Simulating Sampling Distributions , 1999 .

[36]  W. John Braun,et al.  R Tricks for Kids. , 2014 .

[37]  Surajit Ray,et al.  BIC and Alternative Bayesian Information Criteria in the Selection of Structural Equation Models , 2014, Structural equation modeling : a multidisciplinary journal.

[38]  Maurice J. Burke,et al.  On Simulation and the Teaching of Statistics , 2000 .

[39]  D. Betsy McCoach,et al.  The Performance of RMSEA in Models With Small Degrees of Freedom , 2015 .

[40]  Michael Wood,et al.  The Role of Simulation Approaches in Statistics , 2005 .

[41]  David P. MacKinnon,et al.  Monte Carlo Confidence Intervals for Complex Functions of Indirect Effects , 2016 .

[42]  Welch Bl.  THE GENERALIZATION OF ‘STUDENT'S’ PROBLEM WHEN SEVERAL DIFFERENT POPULATION VARLANCES ARE INVOLVED , 1947 .

[43]  Roser Bono,et al.  The effect of skewness and kurtosis on the robustness of linear mixed models , 2013, Behavior research methods.

[44]  Reidar Hagtvedt,et al.  Pedagogical Simulation of Sampling Distributions and the Central Limit Theorem , 2007 .