The effect of foregone payoffs on underweighting small probability events

Foregone payoffs add information about the outcomes for alternatives that are not chosen. The present paper examines the effect of foregone payoffs on underweighting rare but possible events in repeated choice tasks. Previous studies have not demonstrated any long-lasting effects of foregone payoffs (following repeated presentation of a task) when foregone payoffs do not add much information. The present paper highlights the conditions and the contributing factors for the occurrence of such long-lasting effects. An experimental study compares the effect of foregone payoffs under different degrees of rarity of the negative payoff. It is demonstrated that foregone payoffs increase the selection from risky alternatives with extremely rare and highly negative outcomes, and that this effect does not diminish with repeated presentation of the task. These findings can be summarized using a surprisingly simple reinforcement-learning model. The findings are discussed in the context of the potential long-term effect of social learning. Copyright © 2006 John Wiley & Sons, Ltd.

[1]  R. Duncan Luce,et al.  Individual Choice Behavior , 1959 .

[2]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[3]  W. K. Estes,et al.  Some Functions of Memory in Probability Learning and Choice Behavior1 , 1976 .

[4]  W. Estes.  The cognitive side of probability learning. , 1976 .

[5]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[6]  Ronald A. Kleinknecht,et al.  The origins and remission of fear in a group of tarantula enthusiasts , 1982 .

[7]  B. Galef,et al.  Social influences on the identification of toxic foods by Norway rats , 1987 .

[8]  G. Bower,et al.  From conditioning to category learning: an adaptive network model. , 1988 .

[9]  S. Yoerg.  Social feeding reverses learned flavor aversions in spotted hyenas (Crocuta crocuta). , 1991, Journal of comparative psychology.

[10]  F. Provenza,et al.  Socially induced diet preference ameliorates conditioned food aversion in lambs , 1991 .

[11]  Richard P. Larrick,et al.  Protecting the self from the negative consequences of risky decisions. , 1992, Journal of personality and social psychology.

[12]  Jerome R. Busemeyer,et al.  An adaptive approach to human decision making: Learning theory, decision theory, and human performance. , 1992 .

[13]  A. Damasio,et al.  Insensitivity to future consequences following damage to human prefrontal cortex , 1994, Cognition.

[14]  Bereby-Meyer,et al.  On Learning To Become a Successful Loser: A Comparison of Alternative Abstractions of Learning Processes in the Loss Domain. , 1998, Journal of mathematical psychology.

[15]  A. Rapoport,et al.  Coordination, “Magic,” and Reinforcement Learning in a Market Entry Game , 1998 .

[16]  Colin Camerer,et al.  Experience‐weighted Attraction Learning in Normal Form Games , 1999 .

[17]  Randall W Engle,et al.  Working memory, short-term memory, and general fluid intelligence: a latent-variable approach. , 1999, Journal of experimental psychology. General.

[18]  R. Sarin,et al.  Payoff Assessments without Probabilities: A Simple Dynamic Model of Choice , 1999 .

[19]  M. Zeelenberg.  Anticipated regret, expected feedback and behavioral decision-making , 1999 .

[20]  Mairwen K. Jones,et al.  Danger expectancies, self-efficacy and insight in spider phobia. , 2000, Behaviour research and therapy.

[21]  P. Todd,et al.  Explaining social learning of food preferences without aversions: an evolutionary simulation model of Norway rats , 2001, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[22]  Ilan Fischer,et al.  The same but different: an empirical investigation of the reducibility principle , 2001 .

[23]  E Yechiam,et al.  On the potential value and limitations of emphasis change and other exploration-enhancing training methods. , 2001, Journal of experimental psychology. Applied.

[24]  J. Busemeyer,et al.  A contribution of cognitive decision models to clinical assessment: decomposing performance on the Bechara gambling task. , 2002, Psychological assessment.

[25]  P. Finn,et al.  Motivation, working memory, and decision making: a cognitive-motivational theory of personality vulnerability to alcoholism. , 2002, Behavioral and cognitive neuroscience reviews.

[26]  Food choice in rats (Rattus norvegicus): the effect of exposure to a poisoned conspecific , 2002 .

[27]  Brit Grosskopf.  Reinforcement and Directional Learning in the Ultimatum Game with Responder Competition , 2003 .

[28]  I. Erev,et al.  Small feedback‐based decisions and their limited correspondence to description‐based decisions , 2003 .

[29]  Brit Grosskopf,et al.  What makes cheap talk effective? Experimental evidence , 2004 .

[30]  E. Weber,et al.  Predicting Risk-Sensitivity in Humans and Lower Animals: Risk as Variance or Coefficient of Variation , 2004, Psychological review.

[31]  R. Hertwig,et al.  Decisions from Experience and the Effect of Rare Events in Risky Choice , 2004, Psychological science.

[32]  Marcel Zeelenberg,et al.  Consequences of regret aversion in real life : The case of the Dutch postcode lottery , 2004 .

[33]  I. Erev,et al.  On adaptation, maximization, and reinforcement learning among cognitive strategies. , 2005, Psychological review.

[34]  Eldad Yechiam,et al.  Comparison of basic assumptions embedded in learning models for experience-based decision making , 2005, Psychonomic bulletin & review.

[35]  E. Yechiam,et al.  The Role of Personal Experience in Contributing to Different Patterns of Response to Rare Terrorist Attacks , 2005 .

[36]  Jerome R. Busemeyer,et al.  Using Cognitive Models to Map Relations Between Neuropsychological Disorders and Human Decision-Making Deficits , 2005, Psychological science.

[37]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[38]  Jerome R. Busemeyer,et al.  Individual differences in the response to forgone payoffs: an examination of high functioning drug abusers , 2005 .