论文信息 - Replication and Researchers' Understanding of Confidence Intervals and Standard Error Bars.

Replication and Researchers' Understanding of Confidence Intervals and Standard Error Bars.

Confidence intervals (CIs) and standard error bars give information about replication, but do researchers have an accurate appreciation of that information? Authors of journal articles in psychology, behavioral neuroscience, and medicine were invited by email to visit a Web site and indicate on a figure where they judged replication means would plausibly fall. Responses from 263 researchers suggest that many leading researchers in the 3 disciplines underestimate the extent to which future replications will vary. A 95% CI will on average capture 83.4% of future replication means. A majority of respondents, however, held the confidence-level misconception that a 95% CI will on average capture 95% of replication means. Better understanding of CIs is needed if they are to be successfully used more widely in psychology.

G. Cumming | F. Fidler | Jennifer Williams

[1] A. Tversky,et al. BELIEF IN THE LAW OF SMALL NUMBERS , 1971, Pediatrics.

[2] M. Oakes. Statistical Inference: A Commentary for the Social and Behavioural Sciences , 1986 .

[3] F. Schmidt. Statistical Significance Testing and Cumulative Knowledge in Psychology: Implications for Training of Researchers , 1996 .

[4] L. Harlow,et al. What if there were no significance tests , 1997 .

[5] William K. Estes,et al. On the communication of information by displays of standard errors and confidence intervals , 1997 .

[6] Leland Wilkinson,et al. Statistical Methods in Psychology Journals Guidelines and Explanations , 2005 .

[7] R. Nickerson,et al. Null hypothesis significance testing: a review of an old and continuing controversy. , 2000, Psychological methods.

[8] G. Cumming,et al. A Primer on the Understanding, Use, and Calculation of Confidence Intervals that are Based on Central and Noncentral Distributions , 2001 .

[9] G. Cumming,et al. Past and Future American Psychological Association Guidelines for Statistical Practice , 2002 .

[10] G. Cumming,et al. Researchers misunderstand confidence intervals and standard error bars. , 2005, Psychological methods.