Critical Thinking in Psychology: Critical Thinking in Quasi-Experimentation

All experiments are about discovering the effects of causes. In this sense, humans always have been experimenters, from early man seeing whether striking a stone against another stone would start a fire, to the modern cook trying out new ingredients in a recipe to see how it changes the taste. All experiments have in common the deliberate manipulation of an assumed cause (striking a stone, adding a new ingredient), followed by observation of the effects that follow (fire, taste). This common thread holds for all modern scientific experiments, including the randomized experiments discussed in the previous chapter, and the quasi-experiments described in the present chapter. This chapter focuses on critical thinking about causation in quasi-experiments. The reason for this focus on causation is not that other kinds of critical thinking are unimportant in quasi-experiments. To the contrary, every bit of critical thinking that was described in the previous chapter for randomized experiments also has to be done in quasi-experiments, such as choosing good independent and dependent variables, identifying useful populations of participants and settings to study, ensuring that the assumptions of statistical tests are met, and thinking about ways in which the results might generalize. However, the quasi-experimenter also has one more task to do – the critical thinking that takes the place of random assignment. All tasks in life are easier when you have the proper tools. This chapter describes some of the basic tools we use for the task of critical thinking about causation in quasi-experiments.

[1]  J. Folkman,et al.  Fighting cancer by attacking its blood supply. , 1996, Scientific American.

[2]  W. Trochim,et al.  Advances in Quasi-Experimental Design and Analysis , 1986 .

[3]  W. Shadish,et al.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2001 .

[4]  J. Magidson Toward a Causal Model Approach for Adjusting for Preexisting Differences in the Nonequivalent Control Group Situation , 1977 .

[5]  D. Faust The limits of scientific reasoning , 1984 .

[6]  M. Kendall,et al.  The Logic of Scientific Discovery. , 1959 .

[7]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[8]  E. C. Poulton,et al.  Influential companions: Effects of one strategy on another in the within-subjects designs of cognitive psychology. , 1982 .

[9]  P. Rowe What is all the hullabaloo about endostatin? , 1999, The Lancet.

[10]  P. Holland Statistics and Causal Inference , 1985 .

[11]  D. Rubin Estimating causal effects of treatments in randomized and nonrandomized studies. , 1974 .

[12]  D. Campbell Factors relevant to the validity of experiments in social settings. , 1957, Psychological bulletin.

[13]  D. Campbell,et al.  EXPERIMENTAL AND QUASI-EXPERIMENT Al DESIGNS FOR RESEARCH , 2012 .

[14]  J. Mackie,et al.  The cement of the universe : a study of causation , 1977 .

[15]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[16]  D. Sackett Bias in analytic research. , 1979, Journal of chronic diseases.