Information Search in Decisions From Experience

Do different patterns of sampling influence the decisions people make, even when the information the decisions are based on is equivalent? Do more and less switching between options correlate with different kinds of decision policies? In past research, the correspondence between search and decision patterns has been difficult to ascertain because the information obtained has often been confounded with its consequences in an exploration-exploitation trade-off. We used a sampling task in which information is explored prior to being exploited. We found that search patterns did reveal decision policies. Individuals who transitioned more frequently between options were more likely to choose options that win most of the time in round-wise comparisons and were more likely to underweight rare, risky events. Less switching between options was associated with choosing options that win in the long run on the basis of summary comparisons—decisions consistent with expected-value maximization and linear weighting of outcomes.

[1]  D. Bernoulli Exposition of a New Theory on the Measurement of Risk , 1954 .

[2]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[3]  Thomas Caraco,et al.  ON FORAGING TIME ALLOCATION IN A STOCHASTIC ENVIRONMENT , 1980 .

[4]  D. Stephens The logic of risk-sensitive foraging preferences , 1981, Animal Behaviour.

[5]  A. Damasio,et al.  Insensitivity to future consequences following damage to human prefrontal cortex , 1994, Cognition.

[6]  Alasdair I. Houston,et al.  Models of Adaptive Behaviour: An Approach Based on State , 1999 .

[7]  J. Connor Kepler's Witch: An Astronomer's Discovery of Cosmic Order Amid Religious War, Political Intrigue, and the Heresy Trial of His Mother , 2004 .

[8]  R. Hertwig,et al.  Decisions from Experience and the Effect of Rare Events in Risky Choice , 2004, Psychological science.

[9]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 2005, IEEE Transactions on Neural Networks.

[10]  Craig R. Fox,et al.  “Decisions from experience” = sampling error + prospect theory: Reconsidering Hertwig, Barron, Weber & Erev (2004) , 2006, Judgment and Decision Making.

[11]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[12]  Timothy J. Pleskac,et al.  The Description-Experience Gap in Risky Choice: The Role of Sample Size and Experienced Probabilities , 2008 .

[13]  B. Newell,et al.  Biased samples not mode of presentation: Re-examining the apparent underweighting of rare events in experience-based choice , 2008 .

[14]  N. Chater,et al.  Are Probabilities Overweighted or Underweighted When Rare Outcomes Are Experienced (Rarely)? , 2009, Psychological science.

[15]  R. Hertwig,et al.  The description–experience gap in risky choice , 2009, Trends in Cognitive Sciences.

[16]  Timothy J. Pleskac,et al.  Decisions from experience: Why small samples? , 2010, Cognition.