BootES: An R package for bootstrap confidence intervals on effect sizes

Bootstrap Effect Sizes (bootES; Gerlanc & Kirby, 2012) is a free, open-source software package for R (R Development Core Team, 2012), which is a language and environment for statistical computing. BootES computes both unstandardized and standardized effect sizes (such as Cohen’s d, Hedges’s g, and Pearson’s r) and makes easily available for the first time the computation of their bootstrap confidence intervals (CIs). In this article, we illustrate how to use bootES to find effect sizes for contrasts in between-subjects, within-subjects, and mixed factorial designs and to find bootstrap CIs for correlations and differences between correlations. An appendix gives a brief introduction to R that will allow readers to use bootES without having prior knowledge of R.

[1]  L. Harlow,et al.  What if there were no significance tests , 1997 .

[2]  Stanley Wasserman,et al.  New developments in statistics for psychology and the social sciences , 1988 .

[3]  M. L. Smith,et al.  Meta-analysis of psychotherapy outcome studies. , 1977, The American psychologist.

[4]  B. Thompson.  What Future Quantitative Social Science Research Could Look Like: Confidence Intervals for Effect Sizes , 2002 .

[5]  Ken Kelley,et al.  Methods for the Behavioral, Educational, and Social Sciences: An R package , 2007, Behavior research methods.

[6]  R. J. Boik.  Contrasts and Effect Sizes in Behavioral Research: A Correlational Approach , 2001 .

[7]  Debashis Kushary,et al.  Bootstrap Methods and Their Application , 2000, Technometrics.

[8]  Rex B. Kline,et al.  Beyond Significance Testing: Reforming Data Analysis Methods in Behavioral Research , 2004 .

[9]  L. Hedges.  Distribution Theory for Glass's Estimator of Effect size and Related Estimators , 1981 .

[10]  Ryan Womack,et al.  Introduction to R , 2010, IASSIST.

[11]  G. Cumming,et al.  Confidence intervals : better answers to better questions. , 2009 .

[12]  James Algina,et al.  Confidence Interval Coverage for Cohen's Effect Size Statistic , 2006 .

[13]  Kate E Decleene,et al.  Publication Manual of the American Psychological Association , 2011 .

[14]  Gene V. Glass,et al.  Choice of the Metric for Effect Size in Meta-analysis , 1980 .

[15]  David C. Howell,et al.  Nonorthogonal Analysis of Variance: Putting the Question before the Answer , 1982 .

[16]  Ken Kelley,et al.  Confidence Intervals for Standardized Effect Sizes: Theory, Application, and Implementation , 2007 .

[17]  Michael R. Smith,et al.  Evaluation of Several Nonparametric Bootstrap Methods to Estimate Confidence Intervals for Software Metrics , 2003, IEEE Trans. Software Eng..

[18]  Leland Wilkinson,et al.  Statistical Methods in Psychology Journals Guidelines and Explanations , 2005 .

[19]  G. Cumming,et al.  A Primer on the Understanding, Use, and Calculation of Confidence Intervals that are Based on Central and Noncentral Distributions , 2001 .

[20]  P. Hall.  On the Number of Bootstrap Simulations Required to Construct a Confidence Interval , 1986 .

[21]  G. Cumming,et al.  Reform of statistical inference in psychology: The case ofMemory & Cognition , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[22]  Ken Kelley,et al.  The Effects of Nonnormal Distributions on Confidence Intervals Around the Standardized Mean Difference: Bootstrap and Parametric Confidence Intervals , 2005 .

[23]  B. Efron.  Better Bootstrap Confidence Intervals , 1987 .

[24]  David Hinkley,et al.  Bootstrap Methods: Another Look at the Jackknife , 2008 .

[25]  Ying Cui,et al.  Bootstrap confidence intervals for the mean correlation corrected for Case IV range restriction: a more adequate procedure for meta-analysis. , 2013, The Journal of applied psychology.

[26]  P. Killeen,et al.  An Alternative to Null-Hypothesis Significance Tests , 2005, Psychological science.

[27]  H. Keselman,et al.  Modern robust data analysis methods: measures of central tendency. , 2003, Psychological methods.

[28]  D. Rubin,et al.  Contrasts and Correlations in Effect-Size Estimation , 2000, Psychological science.

[29]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[30]  James H. Steiger,et al.  R2: A computer program for interval estimation, power Calculations, sample size estimation, and hypothesis testing in multiple regression , 1992 .

[31]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[32]  J Carpenter,et al.  Bootstrap confidence intervals: when, which, what? A practical guide for medical statisticians. , 2000, Statistics in medicine.

[33]  Xiao-Hua Zhou,et al.  Statistical Methods for Meta‐Analysis , 2008 .

[34]  R. A. Bailey.  Designing Experiments and Analyzing Data: a Model Comparison Perspective, 2nd edn , 2005 .

[35]  G. Glass.  Primary, Secondary, and Meta-Analysis of Research1 , 1976 .

[36]  B. Efron,et al.  Bootstrap confidence intervals , 1996 .

[37]  Angelo J. Canty.  Resampling Methods in R : The boot Package , 2022 .

[38]  Karl Pearson,et al.  Mathematical contributions to the theory of evolution, On the law of ancestral heredity , 1898, Proceedings of the Royal Society of London.

[39]  John M. Ferron,et al.  Interval Estimates of Multivariate Effect Sizes , 2007 .

[40]  Miguel A. Padilla,et al.  Correlation Attenuation Due to Measurement Error , 2012 .

[41]  Ralph L. Rosnow,et al.  Essentials of Behavioral Research: Methods and Data Analysis , 1984 .

[42]  J. H. Steiger,et al.  Beyond the F test: Effect size confidence intervals and tests of close fit in the analysis of variance and contrast analysis. , 2004, Psychological methods.

[43]  Scott E. Maxwell,et al.  Designing Experiments and Analyzing Data: A Model Comparison Perspective , 1990 .

[44]  James Algina,et al.  An alternative to Cohen's standardized mean difference effect size: a robust parameter and confidence interval in the two independent groups case. , 2005, Psychological methods.

[45]  R. Rosenthal.  Meta-analytic procedures for social research , 1984 .

[46]  K. Pearson.  Mathematical Contributions to the Theory of Evolution. III. Regression, Heredity, and Panmixia , 1896 .