Reward Expectancy-Related Prefrontal Neuronal Activities: Are They Neural Substrates of “Affective” Working Memory?

Primate prefrontal delay neurons are involved in retaining task-relevant cognitive information in working memory (WM). Recent studies have also revealed primate prefrontal delay neurons that are related to reward/omission-of-reward expectancy. Such reward-related delay activities might constitute "affective WM" (Davidson, 2002). "Affective" and "cognitive" WM are both concerned with representing not what is currently being presented, but rather what was presented previously or might be presented in the future. However, according to the original and widely accepted definition, WM is the "temporary storage and manipulation of information for complex cognitive tasks". Reward/omission-of-reward expectancy-related neuronal activity is neither prerequisite nor essential for accurate task performance; thus, such activity is not considered to comprise the neural substrates of WM. Also, "affective WM" might not be an appropriate usage of the term "WM". We propose that WM- and reward/omission-of-reward expectancy-related neuronal activity are concerned with representing which response should be performed in order to attain a goal (reward) and the goal of the response, respectively. We further suggest that the prefrontal cortex (PFC) plays a crucial role in the integration of cognitive (for example, WM-related) and motivational (for example, reward expectancy-related) operations for goal-directed behaviour. The PFC could then send this integrated information to other brain areas to control the behaviour.

[1]  B. Milner,et al.  Deficits on subject-ordered tasks after frontal- and temporal-lobe lesions in man , 1982, Neuropsychologia.

[2]  P. Goldman-Rakic,et al.  Dissociation of object and spatial processing domains in primate prefrontal cortex. , 1993, Science.

[3]  K. Hikosaka,et al.  Delay activity of orbital and lateral prefrontal neurons of the monkey varying with different rewards. , 2000, Cerebral cortex.

[4]  M. Roesch,et al.  Impact of expected reward on neuronal activity in prefrontal cortex, frontal and supplementary eye fields and premotor cortex. , 2003, Journal of neurophysiology.

[5]  Richard Passingham,et al.  Delayed matching after selective prefrontal lesions in monkeys (Macaca mulatta) , 1975, Brain Research.

[6]  H. E. Rosvold,et al.  Analysis of the delayed-alternation deficit produced by dorsolateral prefrontal lesions in the rhesus monkey. , 1971, Journal of comparative and physiological psychology.

[7]  J. O'Doherty,et al.  Neural Responses during Anticipation of a Primary Taste Reward , 2002, Neuron.

[8]  Javier Quintana,et al.  Prefrontal representation of stimulus attributes during delay tasks. I. Unit activity in cross-temporal integration of sensory and sensory-motor information , 1988, Brain Research.

[9]  W. Newsome,et al.  Matching Behavior and the Representation of Value in the Parietal Cortex , 2004, Science.

[10]  H. Barbas,et al.  Architecture and cortical connections of the prefrontal cortex in the rhesus monkey. , 1992, Advances in neurology.

[11]  M. Shadlen,et al.  Effect of Expected Reward Magnitude on the Response of Neurons in the Dorsolateral Prefrontal Cortex of the Macaque , 1999, Neuron.

[12]  W. Schultz,et al.  Relative reward preference in primate orbitofrontal cortex , 1999, Nature.

[13]  H. Niki,et al.  Encoding of behavioral significance of visual stimuli by primate prefrontal neurons: relation to relevant task conditions , 2004, Experimental Brain Research.

[14]  A. Walker,et al.  A cytoarchitectural study of the prefrontal area of the macaque monkey , 1940 .

[15]  Gregor Thut,et al.  Activation of the human brain by monetary reward , 1997, Neuroreport.

[16]  E. Miller,et al.  Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task , 2003, The European journal of neuroscience.

[17]  Wolfram Schultz,et al.  Behavioral reactions reflecting differential reward expectations in monkeys , 2001, Experimental Brain Research.

[18]  P. Goldman-Rakic,et al.  Areal segregation of face-processing neurons in prefrontal cortex. , 1997, Science.

[19]  R. Davidson,et al.  The functional neuroanatomy of emotion and affective style , 1999, Trends in Cognitive Sciences.

[20]  C. Gross,et al.  Evidence for dissociation of impairment on auditory discrimination and delayed response following lateral frontal lesions in monkeys. , 1962, Experimental neurology.

[21]  M. A. Trapold,et al.  Are expectancies based upon different positive reinforcing events discriminably different , 1970 .

[22]  H. Niki,et al.  Prefrontal cortical unit activity and delayed alternation performance in monkeys. , 1971, Journal of neurophysiology.

[23]  R. Davidson.  Anxiety and affective style: role of prefrontal cortex and amygdala , 2002, Biological Psychiatry.

[24]  M. Petrides,et al.  Specialized systems for the processing of mnemonic information within the primate frontal cortex. , 1996, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[25]  P. Goldman-Rakic,et al.  Delay-related activity of prefrontal neurons in rhesus monkeys performing delayed response , 1982, Brain Research.

[26]  P. Goldman-Rakic,et al.  Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. , 1989, Journal of neurophysiology.

[27]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[28]  H. Damasio,et al.  Dissociation Of Working Memory from Decision Making within the Human Prefrontal Cortex , 1998, The Journal of Neuroscience.

[29]  K. Pribram,et al.  Further analysis of the temporal lobe syndrome utilizing frontotemporal ablations , 1953, The Journal of comparative neurology.

[30]  C. Jacobsen.  FUNCTIONS OF FRONTAL ASSOCIATION AREA IN PRIMATES , 1935 .

[31]  W. Schultz,et al.  Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex. , 2000, Journal of neurophysiology.

[32]  M. Petrides,et al.  Functional organization of spatial and nonspatial working memory processing within the human lateral frontal cortex. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[33]  P. Goldman-Rakic.  The prefrontal landscape: implications of functional architecture for understanding human mentation and the central executive. , 1996, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[34]  H. Niki.  Differential activity of prefrontal units during right and left delayed response trials. , 1974, Brain research.

[35]  S C Rao,et al.  Integration of what and where in the primate prefrontal cortex. , 1997, Science.

[36]  K. Hikosaka,et al.  Coding and Monitoring of Motivational Context in the Primate Prefrontal Cortex , 2002, The Journal of Neuroscience.

[37]  M MISHKIN,et al.  Effects of small frontal lesions on delayed alternation in monkeys. , 1957, Journal of neurophysiology.

[38]  M. D’Esposito,et al.  Functional MRI studies of spatial and nonspatial working memory. , 1998, Brain research. Cognitive brain research.

[39]  Masataka Watanabe,et al.  Long‐ and short‐range reward expectancy in the primate orbitofrontal cortex , 2004, The European journal of neuroscience.

[40]  J. Fuster.  Unit activity in prefrontal cortex during delayed-response performance: neuronal correlates of transient memory. , 1973, Journal of neurophysiology.

[41]  O. Hikosaka,et al.  Expectation of reward modulates cognitive signals in the basal ganglia , 1998, Nature Neuroscience.

[42]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[43]  M. Raichle,et al.  Integration of emotion and cognition in the lateral prefrontal cortex , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[44]  J B Poline,et al.  The neural system that bridges reward and cognition in humans: An fMRI study , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[45]  O. Hikosaka,et al.  Influence of reward expectation on visuospatial processing in macaque lateral prefrontal cortex. , 2002, Journal of neurophysiology.

[46]  J. Tanji,et al.  Integration of temporal order and object information in the monkey lateral prefrontal cortex. , 2004, Journal of neurophysiology.

[47]  Functional significance of delay-period activity of primate prefrontal neurons in relation to spatial working memory and reward/omission-of-reward expectancy , 2005, Experimental Brain Research.

[48]  Masataka Watanabe.  Reward expectancy in primate prefrental neurons , 1996, Nature.

[49]  P S Goldman-Rakic,et al.  The “Psychic” Neuron of the Cerebral Cortex , 1999, Annals of the New York Academy of Sciences.

[50]  K. C. Anderson,et al.  Single neurons in prefrontal cortex encode abstract rules , 2001, Nature.

[51]  E. Miller,et al.  Task-specific neural activity in the primate prefrontal cortex. , 2000, Journal of neurophysiology.

[52]  S. Wise,et al.  Rule-dependent neuronal activity in the prefrontal cortex , 1999, Experimental Brain Research.