The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework

We review 74 experiments with no, low, or high performance-based financial incentives. The modal result has no effect on mean performance (though variance is usually reduced by higher payment). Higher incentive does improve performance often, typically judgment tasks that are responsive to better effort. Incentives also reduce “presentation” effects (e.g., generosity and risk-seeking). Incentive effects are comparable to effects of other variables, particularly “cognitive capital” and task “production” demands, and interact with those variables, so a narrow-minded focus on incentives alone is misguided. We also note that no replicated study has made rationality violations disappear purely by raising incentives.

[1]  R. Yerkes,et al.  The relation of strength of stimulus to rapidity of habit‐formation , 1908 .

[2]  William G. Cochran,et al.  Experimental Designs, 2nd Edition , 1950 .

[3]  W. Edwards,et al.  Probability-preferences in gambling. , 1953, The American journal of psychology.

[4]  H P BAHRICK,et al.  Incidental learning under two incentive conditions. , 1954, Journal of experimental psychology.

[5]  J. W. Atkinson Motives In Fantasy, Action, And Society , 1958 .

[6]  S. Siegel,et al.  Bargaining And Group Decision Making , 1960 .

[7]  Albert Bonelli,et al.  Bargaining and Group Decision Making, Experiments in Bilateral Monopoly , 1960 .

[8]  L. B. Miller,et al.  Monetary reward and motivation in discrimination learning. , 1961, Journal of experimental psychology.

[9]  S. Siegel,et al.  Bargaining and Group Decision Making: Experiments in Bilateral Monopoly , 1961 .

[10]  W. Edwards,et al.  Probability learning in 1000 trials. , 1961, Journal of experimental psychology.

[11]  Vernon L. Smith Papers in Experimental Economics: An Experimental Study of Competitive Market Behavior , 1962 .

[12]  V. Smith An Experimental Study of Competitive Market Behavior , 1962, Journal of Political Economy.

[13]  S. Glucksberg,et al.  The influence of strength of drive on functional fixedness and perceptual recognition. , 1962, Journal of experimental psychology.

[14]  Vernon L. Smith,et al.  Experimental Auction Markets and the Walrasian Hypothesis , 1965, Journal of Political Economy.

[15]  W. Edwards,et al.  Conservatism in a simple probability inference task. , 1966, Journal of experimental psychology.

[16]  Sidney Siegel,et al.  Choice, strategy, and utility , 1967 .

[17]  W. S. Peavler,et al.  Effects of verbalization and incentive on the pupil response to mental activity. , 1968, Canadian journal of psychology.

[18]  W. S. Peavler,et al.  Incentive effects and pupillary changes in association learning. , 1969, Journal of experimental psychology.

[19]  N. Castellan Effect of change of payoff in probability learning. , 1969 .

[20]  P. Slovic Differential effects of real versus hypothetical payoffs on choices among gambles. , 1969 .

[21]  R. Nisbett,et al.  Undermining children's intrinsic interest with extrinsic reward: A test of the "overjustification" hypothesis. , 1973 .

[22]  Paul Slovic,et al.  Dimensional Commensurability and Cue Utilization in Comparative Judgment. , 1974 .

[23]  F. Craik,et al.  Depth of processing and the retention of words , 1975 .

[24]  V. Smith Experimental Economics : Induced Value Theory , 2007 .

[25]  Charles R. Plott,et al.  Committee Decisions under Majority Rule: An Experimental Study , 1978, American Political Science Review.

[26]  V. Smith,et al.  Research in Experimental Economics , 1979 .

[27]  C. Plott,et al.  Economic Theory of Choice and the Preference Reversal Phenomenon , 1979 .

[28]  Kenneth O. McGraw,et al.  Evidence of a detrimental effect of extrinsic incentives on breaking a mental set. , 1979 .

[29]  K. MacCrimmon,et al.  Utility Theory: Axioms Versus ‘Paradoxes’ , 1979 .

[30]  D. M. Grether,et al.  Bayes Rule as a Descriptive Model: The Representativeness Heuristic , 1980 .

[31]  H. P. Binswanger Attitudes toward risk: Experimental measurement in rural india , 1980 .

[32]  P. Schoemaker,et al.  Prospect theory's reflection hypothesis: A critical examination , 1980 .

[33]  B. Fischhoff,et al.  Journal of Experimental Psychology: Human Learning and Memory , 1980 .

[34]  D. M. Grether,et al.  Financial Incentive Effects and Individual Decision-making , 1981 .

[35]  Barry Schwartz,et al.  Reinforcement-Induced Behavioral Stereotypy: How Not To Teach People To Discover Rules , 1982 .

[36]  John D. Hey,et al.  Search for rules for search , 1982 .

[37]  Friedrich Schneider,et al.  Economic Theory of Choice and the Preference Reversal Phenomenon: A Reexamination , 1982 .

[38]  W. Güth,et al.  An experimental analysis of ultimatum bargaining , 1982 .

[39]  An Examination Of The Conservative Information-Processing Bias In An Accounting Framework , 1982 .

[40]  T. Salthouse,et al.  Division of attention: Age differences on a visually presented memory task , 1984, Memory & cognition.

[41]  R. Baumeister Choking under pressure: self-consciousness and paradoxical effects of incentives on skillful performance. , 1984, Journal of personality and social psychology.

[42]  Keith J Holyoak,et al.  Pragmatic reasoning schemas , 1985, Cognitive Psychology.

[43]  J. A. Sniezek The role of variable labels in cue probability learning tasks , 1986 .

[44]  H. Arkes,et al.  Factors influencing the use of a decision rule in a probabilistic task , 1986 .

[45]  Colin Camerer Do Biases in Probability Judgment Matter in Markets? Experimental Evidence , 1987 .

[46]  Andrew Schotter,et al.  Tournaments and Piece Rates: An Experimental Study , 1987, Journal of Political Economy.

[47]  Lars-Göran Nilsson Motivated memory: Dissociation between performance data and subjective reports , 1987 .

[48]  Amnon Rapoport,et al.  Experimental Tests of the Separation Theorem and the Capital Asset Pricing Model , 1988 .

[49]  V. Smith,et al.  Bubbles, Crashes, and Endogenous Expectations in Experimental Spot Asset Markets , 1988 .

[50]  Hugo Sonnenschein,et al.  A Further Test of Noncooperative Bargaining Theory: Comment , 1988 .

[51]  D. Nebeker,et al.  The Influence of Monetary Incentives on Goal Choice, Goal Commitment, and Task Performance , 1988 .

[52]  Colin Camerer,et al.  EXPERIMENTAL TESTS OF A SEQUENTIAL EQUILIBRIUM REPUTATION MODEL , 1988 .

[53]  Philip M. Podsakoff,et al.  The effects of "intrinsic" and "extrinsic" reinforcement contingencies on task behavior. , 1988 .

[54]  William F. Wright,et al.  Effects of extrinsic incentives on the quality of frequency assessments , 1988 .

[55]  Amnon Rapoport,et al.  Experimental tests of the mean-variance model for portfolio selection , 1988 .

[56]  L. Cosmides The logic of social exchange: Has natural selection shaped how humans reason? Studies with the Wason selection task , 1989, Cognition.

[57]  R. Dawes,et al.  Heuristics and Biases: Clinical versus Actuarial Judgment , 2002 .

[58]  William F. Wright,et al.  Effects of situation familiarity and financial incentives on use of the anchoring and adjustment heuristic for probability assessment , 1989 .

[59]  Colin Camerer An experimental test of several generalized utility theories , 1989 .

[60]  John Conlisk,et al.  Three Variants on the Allais Example , 1989 .

[61]  J. Heywood,et al.  Tournaments, Piece Rates, and the Shape of the Payoff Function , 1989, Journal of Political Economy.

[62]  Friedel Bolle,et al.  High reward experiments without high expenditure for the experimenter , 1990 .

[63]  Alvin E. Roth,et al.  Two-Sided Matching: A Study in Game-Theoretic Modeling and Analysis , 1990 .

[64]  John H. Kagel,et al.  Testing between alternative models of choice under uncertainty: Some initial results , 1990 .

[65]  Robert H. Ashton,et al.  Pressure And Performance In Accounting Decision Settings - Paradoxical Effects Of Incentives, Feedback, And Justification , 1990 .

[66]  Peter C. Ordeshook,et al.  A Decade of Experimental Research on Spatial Models of Elections and Committees , 1990 .

[67]  Paul J. H. Schoemaker,et al.  Are Risk-Attitudes Related Across Domains and Response Modes? , 1990 .

[68]  R. Hogarth,et al.  Venture Theory: A Model of Decision Weights , 1990 .

[69]  J. Huyck,et al.  Tacit Coordination Games, Strategic Uncertainty, and Coordination Failure , 1990 .

[70]  K. A. Ericsson,et al.  Toward a general theory of expertise : prospects and limits , 1991 .

[71]  S. Zamir,et al.  Bargaining and Market Behavior in Jerusalem, Ljubljana, Pittsburgh, and Tokyo: An Experimental Study , 1991 .

[72]  V. Smith,et al.  Papers in Experimental Economics: Experimental Economics: Behavioral Lessons for Microeconomic Theory and Policy , 1991 .

[73]  Colin Camerer,et al.  The process-performance paradox in expert judgment - How can experts know so much and predict so badly? , 1991 .

[74]  Karim Jamal,et al.  Money vs gaming: Effects of salient monetary payments in double oral auctions , 1991 .

[75]  I. Kirsch,et al.  Cognitive mediators of pain perception and tolerance. , 1991, Journal of personality and social psychology.

[76]  R. Hogarth,et al.  Learning from feedback: exactingness and incentives. , 1991, Journal of experimental psychology. Learning, memory, and cognition.

[77]  Graham Loomes,et al.  Non-transitive Preferences over Gains and Losses , 1992 .

[78]  Steven J. Kachelmeier,et al.  Examining Risk Preferences under High Monetary Incentives: Experimental Evidence from the People's Republic of China , 1992 .

[79]  Robert Libby,et al.  Incentives, Effort, And The Cognitive-Processes Involved In Accounting-Related Judgments , 1992 .

[80]  R. McKelvey,et al.  An experimental study of the centipede game , 1992 .

[81]  Martin Sefton,et al.  Incentives in simple bargaining games , 1992 .

[82]  A. Tversky,et al.  Advances in prospect theory: Cumulative representation of uncertainty , 1992 .

[83]  David M. Grether,et al.  Testing Bayes Rule and the Representativeness Heuristic: Some Experimental Evidence , 1992 .

[84]  Gary McClelland,et al.  Hypothetical and Real Consequences in Experimental Auctions for Insurance against Low Probability Risks , 1992 .

[85]  J. Quiggin Testing between alternative models of choice under uncertainty—Comment , 1993 .

[86]  Ken Binmore,et al.  Frontiers of game theory , 1993 .

[87]  A. Reber Implicit learning and tacit knowledge , 1993 .

[88]  Rami Zwick,et al.  Comparing the calibration and coherence of numerical and verbal probability judgments , 1993 .

[89]  N. Wilcox Lottery choice: incentives, complexity and decision time , 1993 .

[90]  Vernon L. Smith,et al.  REWARDS, EXPERIENCE AND DECISION COSTS IN FIRST PRICE AUCTIONS , 1993 .

[91]  Colin Camerer,et al.  Cognition and framing in sequential bargaining for gains and losses , 1993 .

[92]  Lola L. Lopes Psychology and Economics: Perspectives on Risk, Cooperation, and the Marketplace , 1994 .

[93]  J. Horowitz,et al.  Fairness in Simple Bargaining Experiments , 1994 .

[94]  Glenn W. Harrison,et al.  Expected utility theory and the experiments , 1994 .

[95]  Peter Bohm,et al.  Time Preference and Preference Reversal among Experienced Subjects: The Effects of Real Payments , 1994 .

[96]  Glenn W. Harrison,et al.  Expected Utility Theory and the Experimentalists , 1994 .

[97]  David W Harless,et al.  The predictive utility of generalized expected utility theories , 1994 .

[98]  Colin F. Camerer,et al.  Rules for Experimenting in Psychology and Economics, and Why They Differ , 1995 .

[99]  J. Keith Murnighan,et al.  An experimental investigation of ultimatum games: information, fairness, expectations, and lowest acceptable offers , 1995 .

[100]  R. G. Cummings,et al.  Homegrown Values and Hypothetical Surveys: Is the Dichotomous Choice Approach Incentive-Compatible? , 1995 .

[101]  Kevin McCabe,et al.  On expectations and the monetary stakes in ultimatum games , 1996 .

[102]  Werner G. Müller,et al.  Optimal Design of an Experiment in Economics , 1996 .

[103]  Thomas R. Palfrey,et al.  Economical experiments: Bayesian efficient experimental design , 1996 .

[104]  R. Eisenberger,et al.  Detrimental effects of reward. Reality or myth? , 1996, The American psychologist.

[105]  David M. Grether,et al.  The preference reversal phenomenon: Response mode, markets and incentives , 1996 .

[106]  Susan Elizabeth Gunter Ponce de Leon , 1996 .

[107]  James Andreoni,et al.  Giving according to GARP: an experimental study of rationality and altruism , 1997 .

[108]  G. Loomes,et al.  The Impact of Incentives Upon Risky Choice Experiments , 1997 .

[109]  Colin Camerer Prospect Theory In The Wild: Evidence From The Field , 1998 .

[110]  J. Shaw,et al.  Are financial incentives related to performance? A meta-analytic review of empirical research. , 1998 .

[111]  Gary McClelland,et al.  Payoff Dominance vs. Cognitive Transparency in Decision Making , 1998 .

[112]  I. Erev,et al.  The psychological and economical perspectives on human decisions in social and interactive contexts , 1998 .

[113]  Robin P. Cubitt,et al.  On the Validity of the Random Lottery Incentive System , 1998 .

[114]  Alvin E. Roth,et al.  Learning in High Stakes Ultimatum Games: An Experiment in the Slovak Republic , 1998 .

[115]  Daniel Friedman,et al.  Monty Hall's Three Doors: Construction and Deconstruction of a Choice Anomaly , 1998 .

[116]  Per-Olov Johansson,et al.  An experimental comparison of dichotomous choice contingent valuation questions and real purchase decisions , 1998 .

[117]  J. Kagel,et al.  The Winner's Curse and Public Information in Common Value Auctions: Comment , 1999 .

[118]  Antonio Merlo,et al.  A Surprise-Quiz View of Learning in Economic Experiments , 1999 .

[119]  Canice Prendergast The Provision of Incentives in Firms , 1999 .

[120]  I. Erev,et al.  Games and Human Behavior , 1999 .

[121]  R. Selten,et al.  Money Does Not Induce Risk Neutral Behavior, but Binary Lotteries Do even Worse , 1999 .

[122]  V. Smith,et al.  Social Distance and Other-Regarding Behavior in Dictator Games: Reply , 1999 .

[123]  A. Tversky,et al.  Choices, Values, and Frames , 2000 .

[124]  V. Smith,et al.  On expectations and the monetary stakes in ultimatum games , 1996 .

[125]  Martin Weber,et al.  The impact of endowment framing on market prices -- an experimental analysis , 2000 .

[126]  Bradley J. Ruffle,et al.  The Deadweight Loss of Christmas: Comment , 2000 .

[127]  V. Smith,et al.  Social distance and other-regarding behavior in dictator games , 2000 .

[128]  R. Hertwig,et al.  Experimental practices in economics: A methodological challenge for psychologists? , 2001, Behavioral and Brain Sciences.