The influence of recent decisions on future goal selection

Recent decisions about actions and goals can have effects on future choices. Several studies have shown an effect of the previous trial history on neural activity in a subsequent trial. Often, but not always, these effects originate from task requirements that make it necessary to maintain access to previous trial information to make future decisions. Maintaining the information about recent decisions and their outcomes can play an important role in both adapting to new contingencies and learning. Previous goal decisions must be distinguished from goals that are currently being planned to avoid perseveration or more general errors. Output monitoring is probably based on this separation of accomplished past goals from pending future goals that are being pursued. Behaviourally, it has been shown that the history context can influence the location, error rate and latency of successive responses. We will review the neurophysiological studies in the literature, including data from our laboratory, which support a role for the frontal lobe in tracking previous goal selections and outputs when new goals need to be accomplished.

[1]  S. Tsujimoto,et al.  Neuronal representation of response-outcome in the primate prefrontal cortex. , 2004, Cerebral cortex.

[2]  Leanne Boucher,et al.  Influence of history on saccade countermanding performance in humans and macaque monkeys , 2007, Vision Research.

[3]  M. Molinari,et al.  Cerebellar Damage Impairs Executive Control and Monitoring of Movement Generation , 2014, PloS one.

[4]  Andrew R. Mitz,et al.  Prefrontal Cortex Activity Related to Abstract Response Strategies , 2005, Neuron.

[5]  J. Schall,et al.  Neural Control of Voluntary Movement Initiation , 1996, Science.

[6]  Richard J Krauzlis,et al.  Cancelling of pursuit and saccadic eye movements in humans and monkeys. , 2003, Journal of neurophysiology.

[7]  Gustavo Deco,et al.  Neural Variability in Premotor Cortex Is Modulated by Trial History and Predicts Behavioral Performance , 2013, Neuron.

[8]  Emiliano Brunamonti,et al.  Reaching in Depth: Hand Position Dominates over Binocular Eye Position in the Rostral Superior Parietal Lobule , 2009, The Journal of Neuroscience.

[9]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 2005, IEEE Transactions on Neural Networks.

[10]  J. Schall,et al.  Current advances and pressing problems in studies of stopping , 2012, Current Opinion in Neurobiology.

[11]  Aldo Genovesio,et al.  Representation of Future and Previous Spatial Goals by Separate Neural Populations in Prefrontal Cortex , 2006, The Journal of Neuroscience.

[12]  Michael W. Cole,et al.  Canceling planned action: an FMRI study of countermanding saccades. , 2004, Cerebral cortex.

[13]  E. Miller,et al.  Neural Activity in the Primate Prefrontal Cortex during Associative Learning , 1998, Neuron.

[14]  E. Miller,et al.  Goal-direction and top-down control , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[15]  Ian Greenhouse,et al.  Stopping a response has global or nonglobal effects on the motor system depending on preparation. , 2012, Journal of neurophysiology.

[16]  Brita Elvevåg,et al.  Habitual prospective memory in schizophrenia , 2003 .

[17]  C. Padoa-Schioppa,et al.  Neurons in the orbitofrontal cortex encode economic value , 2006, Nature.

[18]  Aldo Genovesio,et al.  Feature- and Order-Based Timing Representations in the Frontal Cortex , 2009, Neuron.

[19]  S. Wise,et al.  Neuronal activity related to elapsed time in prefrontal cortex. , 2006, Journal of neurophysiology.

[20]  Leanne Boucher,et al.  Neural Basis of Adaptive Response Time Adjustment during Saccade Countermanding , 2011, The Journal of Neuroscience.

[21]  A. Pouget,et al.  Variance as a Signature of Neural Computations during Decision Making , 2011, Neuron.

[22]  S. Ferraina,et al.  Neural correlates of cognitive control of reaching movements in the dorsal premotor cortex of rhesus monkeys. , 2011, Journal of neurophysiology.

[23]  Jun Tanji,et al.  Distinct Information Representation and Processing for Goal-Directed Behavior in the Dorsolateral and Ventrolateral Prefrontal Cortex and the Dorsal Premotor Cortex , 2012, The Journal of Neuroscience.

[24]  D P Munoz,et al.  Neuronal Correlates for Preparatory Set Associated with Pro-Saccades and Anti-Saccades in the Primate Frontal Eye Field , 2000, The Journal of Neuroscience.

[25]  Alan C. Evans,et al.  Evidence for a two-stage model of spatial working memory processing within the lateral frontal cortex: a positron emission tomography study. , 1996, Cerebral cortex.

[26]  Dara S. Manoach,et al.  Antisaccades and task-switching: interactions in controlled processing , 2002, Experimental Brain Research.

[27]  J. Tanji,et al.  Categorization of behavioural sequences in the prefrontal cortex , 2007, Nature.

[28]  Robert Leech,et al.  Salience network integrity predicts default mode network function after traumatic brain injury , 2012, Proceedings of the National Academy of Sciences.

[29]  Aldo Genovesio,et al.  Encoding Goals but Not Abstract Magnitude in the Primate Prefrontal Cortex , 2012, Neuron.

[30]  W. Newsome,et al.  Matching Behavior and the Representation of Value in the Parietal Cortex , 2004, Science.

[31]  E. Hoshi.  Cortico-basal ganglia networks subserving goal-directed behavior mediated by conditional visuo-goal association , 2013, Front. Neural Circuits.

[32]  P. Goldman-Rakic,et al.  Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. , 1989, Journal of neurophysiology.

[33]  G. Logan,et al.  Response inhibition in the stop-signal paradigm , 2008, Trends in Cognitive Sciences.

[34]  Jun Tanji,et al.  Involvement of the Globus Pallidus in Behavioral Goal Determination and Action Specification , 2013, The Journal of Neuroscience.

[35]  S. Wise,et al.  Autonomous Encoding of Irrelevant Goals and Outcomes by Prefrontal Cortex Neurons , 2014, The Journal of Neuroscience.

[36]  C. Constantinidis,et al.  Persistent discharges in the prefrontal cortex of monkeys naive to working memory tasks. , 2007, Cerebral cortex.

[37]  Andreas Nieder,et al.  Semantic Associations between Signs and Numerical Categories in the Prefrontal Cortex , 2007, PLoS biology.

[38]  Jason L Hicks,et al.  Investigating the output monitoring component of event-based prospective memory performance , 2002, Memory & cognition.

[39]  P. Goldman-Rakic,et al.  Common cortical and subcortical targets of the dorsolateral prefrontal and posterior parietal cortices in the rhesus monkey: evidence for a distributed neural network subserving spatially guided behavior , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[40]  Philippe Boulinguez,et al.  Proactive inhibitory control of movement assessed by event-related fMRI , 2008, NeuroImage.

[41]  Martina Rieger,et al.  Inhibitory after‐effects in the stop signal paradigm , 1999 .

[42]  Etienne Koechlin,et al.  An evolutionary computational theory of prefrontal executive function in decision-making , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[43]  Daeyeol Lee,et al.  Beyond working memory: the role of persistent activity in decision making , 2010, Trends in Cognitive Sciences.

[44]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[45]  Matti S Hämäläinen,et al.  Saccadic preparation in the frontal eye field is modulated by distinct trial history effects as revealed by magnetoencephalography. , 2011, Cerebral cortex.

[46]  Darryl W. Schneider,et al.  Automatic and Controlled Response Inhibition: Associative Learning in the Go/no-go and Stop-signal Paradigms the Go/no-go Paradigm and the Stop-signal Paradigm , 2022 .

[47]  S. Wise,et al.  Comparison of Strategy Signals in the Dorsolateral and Orbital Prefrontal Cortex , 2011, The Journal of Neuroscience.

[48]  Aldo Genovesio,et al.  Transient neuronal correlations underlying goal selection and maintenance in prefrontal cortex. , 2008, Cerebral cortex.

[49]  V. Stuphorn,et al.  Supplementary Motor Area Exerts Proactive and Reactive Control of Arm Movements , 2010, The Journal of Neuroscience.

[50]  P. Goldman-Rakic,et al.  Dissociation of object and spatial processing domains in primate prefrontal cortex. , 1993, Science.

[51]  D. P. Hanes,et al.  Controlled Movement Processing: Superior Colliculus Activity Associated with Countermanded Saccades , 2003, The Journal of Neuroscience.

[52]  Leanne Boucher,et al.  Nonindependent and nonstationary response times in stopping and stepping saccade tasks , 2010, Attention, perception & psychophysics.

[53]  R Caminiti,et al.  Early coding of visuomanual coordination during reaching in parietal area PEc. , 2001, Journal of neurophysiology.

[54]  D. Barraclough,et al.  Prefrontal cortex and decision making in a mixed-strategy game , 2004, Nature Neuroscience.

[55]  Andrew R. Mitz,et al.  MatOFF: A tool for analyzing behaviorally complex neurophysiological experiments , 2007, Journal of Neuroscience Methods.

[56]  Aldo Genovesio,et al.  Prefrontal–parietal function: from foraging to foresight , 2014, Trends in Cognitive Sciences.

[57]  R. Passingham,et al.  The Neurobiology of the Prefrontal Cortex: Anatomy, Evolution, and the Origin of Insight , 2012 .

[58]  Jillian H. Fecteau,et al.  Exploring the consequences of the previous trial , 2003, Nature Reviews Neuroscience.

[59]  S. Wise,et al.  Encoding problem‐solving strategies in prefrontal cortex: activity during strategic errors , 2008, The European journal of neuroscience.

[60]  S. Wise,et al.  Learning-dependent neuronal activity in the premotor cortex: activity during the acquisition of conditional motor associations , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[61]  Earl K Miller,et al.  The representation of multiple objects in prefrontal neuronal delay activity. , 2007, Cerebral cortex.

[62]  E. Miller,et al.  Prospective Coding for Objects in Primate Prefrontal Cortex , 1999, The Journal of Neuroscience.

[63]  Aldo Genovesio,et al.  Prefrontal Cortex Activity during the Discrimination of Relative Distance , 2011, The Journal of Neuroscience.

[64]  Daeyeol Lee,et al.  Cortical Signals for Rewarded Actions and Strategic Exploration , 2013, Neuron.

[65]  R. Logie,et al.  Prospective and retrospective memory in normal aging and dementia: An experimental study , 2002, Memory & cognition.

[66]  M. Goodale,et al.  Two visual systems re-viewed , 2008, Neuropsychologia.

[67]  M. Petrides.  Lateral prefrontal cortex: architectonic and functional organization , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[68]  S. Wise,et al.  Neuronal Activity during a Cued Strategy Task: Comparison of Dorsolateral, Orbital, and Polar Prefrontal Cortex , 2012, The Journal of Neuroscience.

[69]  G. Logan.  On the ability to inhibit thought and action , 1984 .

[70]  Aldo Genovesio,et al.  Integration of retinal disparity and fixation-distance related signals toward an egocentric coding of distance in the posterior parietal cortex of primates. , 2004, Journal of neurophysiology.

[71]  R. Wurtz,et al.  Signal transformations from cerebral cortex to superior colliculus for the generation of saccades , 2001, Vision Research.

[72]  Mark A. McDaniel,et al.  Prospective memory and aging: forgetting intentions over short delays. , 2000 .

[73]  Frederick Verbruggen,et al.  Responding with Restraint: What Are the Neurocognitive Mechanisms? , 2010, Journal of Cognitive Neuroscience.

[74]  Aldo Genovesio,et al.  Evaluating self-generated decisions in frontal pole cortex of monkeys , 2009, Nature Neuroscience.

[75]  Emiliano Brunamonti,et al.  Postsaccadic Activities in the Posterior Parietal Cortex of Primates Are Influenced by both Eye Movement Vectors and Eye Position , 2007, The Journal of Neuroscience.

[76]  E. Miller,et al.  Different time courses of learning-related activity in the prefrontal cortex and striatum , 2005, Nature.

[77]  D P Munoz,et al.  Role of Primate Superior Colliculus in Preparation and Execution of Anti-Saccades and Pro-Saccades , 1999, The Journal of Neuroscience.

[78]  E. Miller,et al.  Learning Substrates in the Primate Prefrontal Cortex and Striatum: Sustained Activity Related to Successful Actions , 2009, Neuron.

[79]  V. Stuphorn,et al.  Medial Frontal Cortex Motivates But Does Not Control Movement Initiation in the Countermanding Task , 2010, The Journal of Neuroscience.

[80]  M. Botvinick,et al.  Conflict monitoring and cognitive control. , 2001, Psychological review.

[81]  E. Fox.  Negative priming from ignored distractors in visual selection: A review , 1995, Psychonomic bulletin & review.

[82]  Matthew S. Cain,et al.  Neural Activity Is Modulated by Trial History: A Functional Magnetic Resonance Imaging Study of the Effects of a Previous Antisaccade , 2007, The Journal of Neuroscience.

[83]  J. Tanji,et al.  Representation of immediate and final behavioral goals in the monkey prefrontal cortex during an instructed delay period. , 2005, Cerebral cortex.