Regulatory fit and systematic exploration in a dynamic decision-making environment.

This work explores the influence of motivation on choice behavior in a dynamic decision-making environment, where the payoffs from each choice depend on one's recent choice history. Previous research reveals that participants in a regulatory fit exhibit increased levels of exploratory choice and flexible use of multiple strategies over the course of an experiment. The present study placed promotion and prevention-focused participants in a dynamic environment for which optimal performance is facilitated by systematic exploration of the decision space. These participants either gained or lost points with each choice. Our experiment revealed that participants in a regulatory fit were more likely to engage in systematic exploration of the task environment than were participants in a regulatory mismatch and performed more optimally as a result. Implications for contemporary models of human reinforcement learning are discussed.

[1]  S. Mednick,et al.  Remote Associates Test, College, Adult, Form 1 and Examiner's Manual, Remote Associates Test, College and Adult Forms 1 and 2. , 1967 .

[2]  P. Dayan,et al.  Exploration bonuses and dual control , 1996 .

[3]  E. Higgins,et al.  Beyond pleasure and pain. , 1997, The American psychologist.

[4]  Andrew G. Barto,et al.  Reinforcement learning , 1998 .

[5]  E. Higgins,et al.  Performance incentives and means: how regulatory focus influences goal attainment. , 1998, Journal of personality and social psychology.

[6]  C. Carver,et al.  On the Self-Regulation of Behavior , 1998 .

[7]  E. Higgins.  Making a good decision: value from fit. , 2000, The American psychologist.

[8]  P. Montague,et al.  Neural Economics and the Biological Substrates of Valuation , 2002, Neuron.

[9]  I. Erev,et al.  On adaptation, maximization, and reinforcement learning among cognitive strategies. , 2005, Psychological review.

[10]  P. R. Alper.  Performance incentives. , 2005, Health affairs.

[11]  P. Glimcher,et al.  JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR 2005, 84, 555–579 NUMBER 3(NOVEMBER) DYNAMIC RESPONSE-BY-RESPONSE MODELS OF MATCHING BEHAVIOR IN RHESUS MONKEYS , 2022 .

[12]  P. Dayan,et al.  Cortical substrates for exploratory decisions in humans , 2006, Nature.

[13]  Wayne D. Gray,et al.  The soft constraints hypothesis: a rational analysis approach to resource allocation for interactive behavior. , 2006, Psychological review.

[14]  Grant C. Baldwin,et al.  A test of the regulatory fit hypothesis in perceptual classification learning , 2006, Memory & cognition.

[15]  J. Rieskamp,et al.  SSL: a theory of how people learn to select strategies. , 2006, Journal of experimental psychology. General.

[16]  Samuel M. McClure,et al.  Short-term memory traces for action bias in human reinforcement learning , 2007, Brain Research.

[17]  Darrell A. Worthy,et al.  Using Regulatory Focus to Explore Implicit and Explicit Processing in Concept Learning , 2007 .

[18]  Arthur B Markman,et al.  Regulatory fit effects in a choice task , 2007, Psychonomic bulletin & review.

[19]  M. Botvinick,et al.  Hierarchically organized behavior and its neural foundations: A reinforcement learning perspective , 2009, Cognition.

[20]  Bradley C. Love,et al.  Short-term gains, long-term pains: How cues about state aid learning in dynamic environments , 2009, Cognition.

[21]  R. Rosenfeld.  Nature , 2009, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[22]  Richard S. Sutton,et al.  Reinforcement Learning , 1992, Handbook of Machine Learning.