Journal of Economic Behavior & Organization

In this article we explore the issues that surround within-subject and between-subject designs. We describe experiments in economics and in psychology that make comparisons using either of these designs (or both) that sometimes yield the same results and sometimes do not. The overall goal is to establish a framework for understanding which critical questions need to be asked about such experimental studies, what authors of such studies can do to ameliorate fears of confoundedness, and which scenarios are particularly susceptible to divergent results from the two approaches. Overall, we find that both designs have their merits, and the choice of designs should be carefully considered in the context of the question being studied and in terms of the practical implementation of the research study.

[1]  J. Andreoni Warm-Glow versus Cold-Prickle: The Effects of Positive and Negative Framing on Cooperation in Experiments , 1995 .

[2]  Baruch Fischhoff,et al.  Scope (in)sensitivity in elicited valuations , 1998 .

[3]  Nicholas E. Flores,et al.  Contingent Valuation: Controversies and Evidence , 2000 .

[4]  E. C. Poulton Range effects are characteristic of a person serving in a within-subjects experimental design: A reply to Rothstein. , 1974 .

[5]  P. Schoemaker,et al.  Prospect theory's reflection hypothesis: A critical examination , 1980 .

[6]  E. Poulton Unwanted range effects from using within-subject experimental designs. , 1973 .

[7]  Craig R. Fox,et al.  Ambiguity Aversion and Comparative Ignorance , 1995 .

[8]  E. Fehr,et al.  Cooperation and Punishment in Public Goods Experiments , 1999, SSRN Electronic Journal.

[9]  Grice Gr Dependence of empirical laws upon the source of experimental variation. , 1966 .

[10]  M. A. Milburn,et al.  Sources of bias in the prediction of future events , 1978 .

[11]  Ayelet Gneezy,et al.  The Framing of Financial Windfalls and Implications for Public Policy , 2007 .

[12]  David S. Brookshire,et al.  The valuation of aesthetic preferences , 1976 .

[13]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[14]  Ilana Ritov,et al.  Determinants of stated willingness to pay for public goods: A study in the headline method , 1994, Journal of risk and uncertainty.

[15]  R. Mark Isaac,et al.  Communication and Free-Riding Behavior: The Voluntary Contribution Mechanism , 1988 .

[16]  C. Engel Journal of Economic Behavior & Organization , 2015 .

[17]  Kevin J. Boyle,et al.  Measuring Natural Resource Damages with Contingent Valuation: Tests of Validity and Reliability , 1993 .

[18]  R. Rosenthal,et al.  Experimenter effects in behavioral research , 1968 .

[19]  Christopher K. Hsee,et al.  Will Products Look More Attractive When Presented Separately or Together? , 1998 .

[20]  R. Mark Isaac,et al.  Group Size Effects in Public Goods Provision: The Voluntary Contributions Mechanism , 1988 .

[21]  Uri Gneezy,et al.  Deception: The Role of Consequences , 2005 .

[22]  A. Greenwald Within-subjects designs: To use or not to use? , 1976 .

[23]  E L Brown,et al.  Memory for faces: testing method, encoding strategy, and confidence. , 1981, The American journal of psychology.

[24]  David V. Budescu,et al.  Reflection of transitive and intransitive preferences: A test of prospect theory , 1987 .

[25]  J. Titchener Experimenter Effects in Behavioral Research. , 1967 .

[26]  Larry Samuelson,et al.  Building rational cooperation , 2006, J. Econ. Theory.

[27]  G R Grice,et al.  Dependence of empirical laws upon the source of experimental variation. , 1966, Psychological bulletin.

[28]  Christopher K. Hsee,et al.  The Evaluability Hypothesis: An Explanation for Preference Reversals between Joint and Separate Evaluations of Alternatives , 1996 .

[29]  Daniel Kahneman,et al.  Valuing public goods: The purchase of moral satisfaction , 1992 .

[30]  Christopher K. Hsee,et al.  Distinction Bias: Misprediction and Mischoice Due to Joint Evaluation , 2004, Journal of personality and social psychology.

[31]  V. L. Smith,et al.  Eyewitness accuracy and confidence: within- versus between-subjects correlations. , 1989, The Journal of applied psychology.

[32]  A. Tversky,et al.  Rational choice and the framing of decisions , 1990 .

[33]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .