Confidence intervals for two sample means: Calculation, interpretation, and a few simple rules

Valued by statisticians, enforced by editors, and confused by many authors, standard errors (SEs) and confidence intervals (CIs) remain a controversial issue in the psychological literature. This is especially true for the proper use of CIs for within-subjects designs, even though several recent publications elaborated on possible solutions for this case. The present paper presents a short and straightforward introduction to the basic principles of CI construction, in an attempt to encourage students and researchers in cognitive psychology to use CIs in their reports and presentations. Focusing on a simple but prevalent case of statistical inference, the comparison of two sample means, we describe possible CIs for between- and within-subjects designs. In addition, we give hands-on examples of how to compute these CIs and discuss their relation to classical t-tests.

[1]  Jerzy Jarmasz,et al.  Revisiting confidence intervals for repeated measures designs , 2010, Psychonomic bulletin & review.

[2]  Roger Bakeman,et al.  Picturing repeated measures: Comments on Loftus, Morrison, and others , 1996 .

[3]  Albert Erlebacher,et al.  Design and analysis of experiments contrasting the within- and between-subjects manipulation of the independent variable. , 1977 .

[4]  B. Leupen,et al.  Design and analysis , 1997 .

[5]  William K. Estes,et al.  On the communication of information by displays of standard errors and confidence intervals , 1997 .

[6]  Thom Baguley,et al.  Calculating and graphing within-subject confidence intervals for ANOVA , 2012, Behavior research methods.

[7]  A. Riopelle,et al.  On confidence intervals for within-subjects designs. , 2005, Psychological methods.

[8]  Geoffrey R. Loftus,et al.  Standard errors and confidence intervals in within-subjects designs: Generalizing Loftus and Masson (1994) and avoiding the biases of alternative accounts , 2012, Psychonomic Bulletin & Review.

[9]  Elizabeth Wilkinson,et al.  The Task Force on Statistical Inference , 1999 .

[10]  G. Cumming,et al.  Researchers misunderstand confidence intervals and standard error bars. , 2005, Psychological methods.

[11]  D. C. Howell.  Statistical Methods for Psychology , 1987 .

[12]  J. G. Hollands,et al.  Confidence intervals in repeated-measures designs: The number of observations principle. , 2009, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[13]  Kate E Decleene,et al.  Publication Manual of the American Psychological Association , 2011 .

[14]  Denis Cousineau,et al.  Confidence intervals in within-subject designs: A simpler solution to Loftus and Masson's method , 2005 .

[15]  M. Masson.  Using confidence intervals for graphically based data interpretation. , 2003, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[16]  Leland Wilkinson,et al.  Statistical Methods in Psychology Journals Guidelines and Explanations , 2005 .

[17]  G. Cumming,et al.  Inference by eye: confidence intervals and how to read pictures of data. , 2005, The American psychologist.

[18]  W. Tryon.  Evaluating statistical difference, equivalence, and indeterminacy using inferential confidence intervals: an integrated alternative method of conducting null hypothesis statistical tests. , 2001, Psychological methods.

[19]  G. Keren,et al.  Between- or Within-Subjects Design: A Methodological Dilemma , 1993 .

[20]  J. P. Morgan,et al.  Design and Analysis: A Researcher's Handbook , 2005, Technometrics.

[21]  M. Masson,et al.  Using confidence intervals in within-subject designs , 1994, Psychonomic bulletin & review.