Psychology Will Be a Much Better Science When We Change the Way We Analyze Data

Jn 1964, 1 entered the field of psychology because 1 believed that within it dwelt some o f the most fund a m e nta l a nd ch a lJe n g ing proble ms of the exta nt sciences. Who could not be intrigu ed, for example, by the rela tion between consciou sness and be ha vior, o r the rules guiding interactions in social situations, o r the processes tha t underlie d evelopme nt from infancy to ma turity? Tod ay, in 1996, my fascination with these proble ms is undiminis hed . But I have deve loped a certain an gst ove r the interve ning 30-something years-a constant, nagging feeling that our fie ld spe nds a lo t of time spinning its wheels without really ma king much progress. This problem s hows up in obvious waysfor insta nce, in the regulari ty with which findings seem no t to replicate. 1t also s hows up in subtler ways-for instance, one d oes not o ften hea r psychologists saying, " Well, this proble m is solved now; let's move on to the next one" (as, e.g., Johannes Kepler must have said m ore tha n three centuries

[1]  F. Schmidt Statistical Significance Testing and Cumulative Knowledge in Psychology: Implications for Training of Researchers , 1996 .

[2]  John T. E. Richardson Measures of effect size , 1996 .

[3]  A. Greenwald,et al.  Effect sizes and p values: what should be reported and what should be replicated? , 1996, Psychophysiology.

[4]  Robert Rosenthal,et al.  WRITING META-ANALYTIC REVIEWS , 1995 .

[5]  Geoffrey R. Loftus,et al.  Data analysis as insight: Reply to Morrison and Weaver , 1995 .

[6]  R. Abelson Statistics As Principled Argument , 1995 .

[7]  R. Frick Accepting the null hypothesis , 1995, Memory & cognition.

[8]  W. Sommer,et al.  Metamemory, distinctiveness, and event-related potentials in recognition memory for faces , 1995, Memory & cognition.

[9]  M. Masson,et al.  Using confidence intervals in within-subject designs , 1994, Psychonomic bulletin & review.

[10]  Jacob Cohen The earth is round (p < .05) , 1994 .

[11]  Michael D. Maltz Deviating from the Mean: The Declining Significance of Significance , 1994 .

[12]  R. P. Carver The Case Against Statistical Significance Testing, Revisited , 1993 .

[13]  R. Serlin Confidence Intervals and the Scientific Method: A Case for Holm on the Range. , 1993 .

[14]  Geoffrey R. Loftus,et al.  A picture is worth a thousandp values: On the irrelevance of hypothesis testing in the microcomputer age , 1993 .

[15]  Robert L. Winkler,et al.  Bayesian statistics: An overview. , 1993 .

[16]  Howard Wainer,et al.  A Handbook for Data Analysis in the Behavioral Sciences: Statistical Issues , 1993 .

[17]  P. Diehr,et al.  Testing the null hypothesis in small area analysis. , 1992, Health Services Research.

[18]  John E. Hunter,et al.  Methods of Meta-Analysis: Correcting Error and Bias in Research Findings , 1991 .

[19]  Geoffrey R. Loftus,et al.  On the Tyranny of Hypothesis Testing in the Social Sciences , 1991 .

[20]  Horizontality of water level: a neo-Piagetian developmental review. , 1991, Advances in child development and behavior.

[21]  Jacob Cohen,et al.  THINGS I HAVE LEARNED (SO FAR) , 1990 .

[22]  D. Bamber,et al.  Learning-forgetting independence, unidimensional memory models, and feature models: comment on Bogartz (1990). , 1990, Journal of experimental psychology. Learning, memory, and cognition.

[23]  P. Meehl Why Summaries of Research on Psychological Theories are Often Uninterpretable , 1990 .

[24]  R. Rosenthal,et al.  Statistical Procedures and the Justification of Knowledge in Psychological Science , 1989 .

[25]  John Beatty,et al.  The Empire of Chance: How Probability Changed Science and Everyday Life , 1989 .

[26]  S. Kalichman Individual differences in water-level task performance: A component-skills analysis , 1988 .

[27]  James O. Berger,et al.  Statistical Analysis and the Illusion of Objectivity , 1988 .

[28]  M. Gardner,et al.  USING CONFIDENCE INTERVALS , 1987, The Lancet.

[29]  M. Oakes Statistical Inference: A Commentary for the Social and Behavioural Sciences , 1986 .

[30]  Geoffrey R. Loftus,et al.  Consistency and Confoundings: Reply to Slamecka , 1985 .

[31]  Geoffrey R. Loftus,et al.  Evaluating forgetting curves. , 1985 .

[32]  R. Rosenthal,et al.  Contrast Analysis: Focused Comparisons in the Analysis of Variance , 1985 .

[33]  Brian McElree,et al.  Normal forgetting of verbal lists as a function of their degree of learning. , 1983 .

[34]  Thomas J. Rothenberg,et al.  On Energy Policy Models , 1983 .

[35]  R. P. Carver The Case Against Statistical Significance Testing , 1978 .

[36]  P. Meehl Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. , 1978 .

[37]  A. Greenwald Consequences of Prejudice Against the Null Hypothesis , 1975 .

[38]  W. Hays Statistics for the social sciences , 1973 .

[39]  D. Lykken Statistical significance in psychological research. , 1968, Psychological bulletin.

[40]  P. Meehl Theory-Testing in Psychology and Physics: A Methodological Paradox , 1967, Philosophy of Science.

[41]  D. Bakan,et al.  The test of significance in psychological research. , 1966, Psychological bulletin.

[42]  Robert Rosenthal,et al.  The Interpretation of Levels of Significance by Psychological Researchers , 1963 .

[43]  D. A. Grant,et al.  Testing the null hypothesis and the strategy and tactics of investigating theoretical models. , 1962, Psychological review.

[44]  Jum C. Nunnally,et al.  The Place of Statistics in Psychology , 1960 .

[45]  W. W. Rozeboom The fallacy of the null-hypothesis significance test. , 1960, Psychological bulletin.

[46]  L. V. Jones Statistical theory and research design. , 1955, Annual review of psychology.

[47]  R Fisher,et al.  Design of Experiments , 1936 .