Toward a common theory for learning from reward, affect, and motivation: the SIMON framework

While the effects of reward, affect, and motivation on learning have each developed into their own fields of research, they largely have been investigated in isolation. As all three of these constructs are highly related, and use similar experimental procedures, an important advance in research would be to consider the interplay between these constructs. Here we first define each of the three constructs, and then discuss how they may influence each other within a common framework. Finally, we delineate several sources of evidence supporting the framework. By considering the constructs of reward, affect, and motivation within a single framework, we can develop a better understanding of the processes involved in learning and how they interplay, and work toward a comprehensive theory that encompasses reward, affect, and motivation.

[1]  P. Lang International affective picture system (IAPS) : affective ratings of pictures and instruction manual , 2005 .

[2]  J. Dreher,et al.  Processing of primary and secondary rewards: A quantitative meta-analysis and review of human functional neuroimaging studies , 2013, Neuroscience & Biobehavioral Reviews.

[3]  J. Panksepp Affective Consciousness and the Instinctual Motor System: The Neural Sources of Sadness and Joy , 2000 .

[4]  J. Gläscher,et al.  Dissociable Systems for Gain- and Loss-Related Value Predictions and Errors of Prediction in the Human Brain , 2006, The Journal of Neuroscience.

[5]  P. Cisek Making decisions through a distributed consensus , 2012, Current Opinion in Neurobiology.

[6]  Peter J. Lang,et al.  Origins of Orienting and Defensive Responses: An Evolutionary Perspective , 2013 .

[7]  W. Stroebe,et al.  Fear signals inhibit impulsive behavior toward rewarding food objects , 2011, Appetite.

[8]  P. Kleinginna,et al.  A categorized list of motivation definitions, with a suggestion for a consensual definition , 1981 .

[9]  Andrew G. Barto,et al.  Reinforcement learning , 1998 .

[10]  L. Specchio,et al.  Pathological gambling plus hypersexuality in restless legs syndrome: a new case , 2011, Neurological Sciences.

[11]  J. Russell,et al.  A 12-Point Circumplex Structure of Core Affect. , 2011, Emotion.

[12]  H O Fekjaer,et al.  [Pathological gambling]. , 2001, Tidsskrift for den Norske laegeforening : tidsskrift for praktisk medicin, ny raekke.

[13]  J. Adelman,et al.  Automatic vigilance for negative words in lexical decision and naming: comment on Larsen, Mercer, and Balota (2006). , 2008, Emotion.

[14]  E. Rolls Précis of The brain and emotion. , 2000, The Behavioral and brain sciences.

[15]  B. Balleine,et al.  Goal-directed instrumental action: contingency and incentive learning and their cortical substrates , 1998, Neuropharmacology.

[16]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[17]  Robert E. Valett,et al.  What is the role , 1964 .

[18]  Brian Knutson,et al.  Valence and salience contribute to nucleus accumbens activation , 2008, NeuroImage.

[19]  M. Landy,et al.  Decision making, movement planning and statistical decision theory , 2008, Trends in Cognitive Sciences.

[20]  Matthew C Farrelly,et al.  Promotion of smoking cessation with emotional and/or graphic antismoking advertising. , 2012, American journal of preventive medicine.

[21]  A. Rangel,et al.  Dissociating valuation and saliency signals during decision-making. , 2011, Cerebral cortex.

[22]  P. Young The role of affective processes in learning and motivation. , 1959, Psychological review.

[23]  C. Carver Approach, Avoidance, and the Self-Regulation of Affect and Action , 2006 .

[24]  P. Kleinginna,et al.  A categorized list of emotion definitions, with suggestions for a consensual definition , 1981 .

[25]  C. Izard The Many Meanings/Aspects of Emotion: Definitions, Functions, Activation, and Regulation , 2010 .

[26]  Marcia L. Spetch,et al.  Is the enhancement of memory due to reward driven by value or salience? , 2012, Acta psychologica.

[27]  I. Ritov,et al.  Decision Affect Theory: Emotional Reactions to the Outcomes of Risky Options , 1997 .

[28]  M. Bradley,et al.  Affective Normsfor English Words (ANEW): Stimuli, instruction manual and affective ratings (Tech Report C-1) , 1999 .

[29]  J. Kalaska,et al.  Neural mechanisms for interacting with a world full of action choices. , 2010, Annual review of neuroscience.

[30]  David E. Bell,et al.  Regret in Decision Making under Uncertainty , 1982, Oper. Res..

[31]  P. Lang Emotion and Motivation: Toward Consensus Definitions and a Common Research Purpose , 2010 .

[32]  R. I. Brown,et al.  Arousal and sensation-seeking components in the general explanation of gambling and gambling addictions. , 1986, The International journal of the addictions.

[33]  Zoubin Ghahramani,et al.  Perspectives and problems in motor learning , 2001, Trends in Cognitive Sciences.

[34]  B. Everitt,et al.  Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex , 2002, Neuroscience & Biobehavioral Reviews.

[35]  Josiah R. Boivin,et al.  A Causal Link Between Prediction Errors, Dopamine Neurons and Learning , 2013, Nature Neuroscience.

[36]  Y. Geda,et al.  Pathological gambling caused by drugs used to treat Parkinson disease. , 2005, Archives of neurology.

[37]  Nicolas W. Schuck,et al.  Reduced Striatal Responses to Reward Prediction Errors in Older Compared with Younger Adults , 2013, The Journal of Neuroscience.

[38]  Andrew Prestwich,et al.  Using aversive images to enhance healthy food choices and implicit attitudes: An experimental test of evaluative conditioning. , 2011, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[39]  G. Glover,et al.  Contributions of amygdala and striatal activity in emotion regulation , 2005, Biological Psychiatry.

[40]  Tom F. Price,et al.  Does Negative Affect Always Narrow and Positive Affect Always Broaden the Mind? Considering the Influence of Motivational Intensity on Cognitive Scope , 2013 .

[41]  N. White Reward or reinforcement: What's the difference? , 1989, Neuroscience & Biobehavioral Reviews.

[42]  David E. Bell,et al.  Disappointment in Decision Making Under Uncertainty , 1985, Oper. Res..

[43]  Steven Jay Lynn,et al.  The role of cognition in classical and operant conditioning. , 2004, Journal of clinical psychology.

[44]  J. Russell,et al.  The neurophysiological bases of emotion: An fMRI study of the affective circumplex using emotion‐denoting words , 2009, Human brain mapping.

[45]  Simon Hong,et al.  New Insights on the Subcortical Representation of Reward This Review Comes from a Themed Issue on Cognitive Neuroscience Edited Lateral Habenula Serotonin Neurons , 2022 .

[46]  M. Bradley,et al.  Emotion, Motivation, and Anxiety: Brain Mechanisms and Psychophysiology the Motivational Organization of Emotion Patterns of Human Emotion Emotion and Perception the Psychophysiology of Picture Processing Neural Imaging: Motivation in the Visual Cortex Motivational Circuits in the Brain , 2022 .

[47]  M. Bradley,et al.  The pupil as a measure of emotional arousal and autonomic activation. , 2008, Psychophysiology.

[48]  A. Elliot,et al.  Approach and Avoidance Motivation , 2001 .

[49]  U. Bingel,et al.  Event-Related Nociceptive Arousal Enhances Memory Consolidation for Neutral Scenes , 2012, The Journal of Neuroscience.

[50]  G. Pagnoni,et al.  Human Striatal Responses to Monetary Reward Depend On Saliency , 2004, Neuron.

[51]  Mara Mather,et al.  The emotional harbinger effect: poor context memory for cues that previously predicted something arousing. , 2008, Emotion.

[52]  S. Corkin,et al.  Two routes to emotional memory: distinct neural processes for valence and arousal. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[53]  R. Byrne Mental models and counterfactual thoughts about what might have been , 2002, Trends in Cognitive Sciences.

[54]  J. Russell A circumplex model of affect. , 1980 .

[55]  H. Damasio,et al.  The Iowa Gambling Task and the somatic marker hypothesis: some questions and answers , 2005, Trends in Cognitive Sciences.

[56]  三嶋 博之 The theory of affordances , 2008 .

[57]  Marcia L. Spetch,et al.  Extreme outcomes sway risky decisions from experience , 2014 .

[58]  H. Hekmat,et al.  Behavior modification through covert semantic desensitization. , 1971, Journal of consulting and clinical psychology.

[59]  R. D. Kirkden,et al.  Using preference, motivation and aversion tests to ask scientific questions about animals’ feelings , 2006 .

[60]  Hilla Peretz,et al.  Ju n 20 03 Schrödinger ’ s Cat : The rules of engagement , 2003 .

[61]  Karen Collins,et al.  Losses disguised as wins in modern multi-line video slot machines. , 2010, Addiction.

[62]  M. Bradley,et al.  Emotion and the motivational brain , 2010, Biological Psychology.

[63]  Amy Beth Warriner,et al.  Norms of valence, arousal, and dominance for 13,915 English lemmas , 2013, Behavior Research Methods.

[64]  K. Berridge Motivation concepts in behavioral neuroscience , 2004, Physiology & Behavior.

[65]  S. Kapur,et al.  Separate brain regions code for salience vs. valence during reward prediction in humans , 2007, Human brain mapping.

[66]  K. Berridge,et al.  What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? , 1998, Brain Research Reviews.