Two distinct exploratory behaviors in decisions from experience: comment on Gonzalez and Dutt (2011).

Gonzalez and Dutt (2011) recently reported that trends during sampling, prior to a consequential risky decision, reveal a gradual movement from exploration to exploitation. That is, even when search imposes no immediate costs, people adopt the same pattern manifest in costly search: early exploration followed by later exploitation. From this isomorphism in costless and costly search, the authors concluded that the same cognitive mechanisms underlay the control of sampling in 2 experimental paradigms employed to investigate decisions from experience: the sampling paradigm implementing costless search and the repeated-choice paradigm implementing costly search. We show that this is a misinterpretation of the human data resulting from drawing inferences about cognitive processes from data aggregated across individuals. Because of an inverse relationship between sample size and the propensity to explore, aggregating across individuals produces a pattern where exploration is gradually replaced by exploitation. On an individual level, however, there is no general reduction in exploration in the sampling paradigm. We list ensuing problems for the instance-based learning model Gonzalez and Dutt presented to explain the similarities between sampling and repeated decisions from experience.

[1]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[2]  C. Lebiere,et al.  The Newell Test for a theory of cognition , 2003, Behavioral and Brain Sciences.

[3]  R. Hertwig,et al.  Decisions from Experience and the Effect of Rare Events in Risky Choice , 2004, Psychological science.

[4]  Jerome R. Busemeyer,et al.  Using Cognitive Models to Map Relations Between Neuropsychological Disorders and Human Decision-Making Deficits , 2005, Psychological science.

[5]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[6]  C. Lebiere,et al.  Instance-Based Cognitive Models of Decision-Making , 2005 .

[7]  W. Estes,et al.  Risks of drawing inferences about cognitive processes from model fits to individual versus average performance , 2005, Psychonomic bulletin & review.

[8]  Timothy J. Pleskac,et al.  The Description-Experience Gap in Risky Choice: The Role of Sample Size and Experienced Probabilities , 2008 .

[9]  N. Chater,et al.  Are Probabilities Overweighted or Underweighted When Rare Outcomes Are Experienced (Rarely)? , 2009, Psychological science.

[10]  R. Hertwig,et al.  The description–experience gap in risky choice , 2009, Trends in Cognitive Sciences.

[11]  Timothy J. Pleskac,et al.  Decisions from experience: Why small samples? , 2010, Cognition.

[12]  Thomas T. Hills,et al.  Information Search in Decisions From Experience , 2010, Psychological science.

[13]  Alvin E. Roth,et al.  A choice prediction competition: Choices from experience and from description , 2010 .

[14]  Varun Dutt,et al.  Instance-based learning: integrating sampling and repeated decisions from experience. , 2011, Psychological review.

[15]  Alice F. Healy,et al.  A cognitive modeling account of simultaneous learning and fatigue effects , 2011, Cognitive Systems Research.