Action selection: A race model for selected and non-selected actions distinguishes the contribution of premotor and prefrontal areas

Race models have been used to explain perceptual, motor and oculomotor decisions. Here we developed a race model to explain how human subjects select actions when there are no overt rewards and no external cues to specify which action to make. Critically, we were able to estimate the cumulative activity of neuronal decision-units for selected and non-selected actions. We used functional magnetic resonance imaging (fMRI) to test for regional brain activity that correlated with the predictions of this race model. Activity in the pre-SMA, cingulate motor and premotor areas correlated with prospective selection between responses according to the race model. Activity in the lateral prefrontal cortex did not correlate with the race model, even though this area was active during action selection. This activity related to the degree to which individuals switched between alternative actions. Crucially, a follow-up experiment showed that it was not present on the first trial. Taken together, these results suggest that the lateral prefrontal cortex is not the source for the generation of action. It is more likely that it is involved in switching to alternatives or monitoring previous actions. Thus, our experiment shows the power of the race model in distinguishing the contribution of different areas in the selection of action.

[1]  D. Barraclough,et al.  Learning and decision making in monkeys during a rock-paper-scissors game. , 2005, Brain research. Cognitive brain research.

[2]  P. Goldman-Rakic,et al.  Comparison of human infants and rhesus monkeys on Piaget's AB task: evidence for dependence on dorsolateral prefrontal cortex , 2004, Experimental Brain Research.

[3]  M. Shadlen,et al.  Decision-making with multiple alternatives , 2008, Nature Neuroscience.

[4]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[5]  Robert D. Rogers,et al.  On Measuring the Perceived Onsets of Spontaneous Actions , 2006, The Journal of Neuroscience.

[6]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[7]  C. D. Frith,et al.  The Role of the Dorsolateral Prefrontal Cortex in Random Number Generation: A Study with Positron Emission Tomography , 2000, NeuroImage.

[8]  F. C. Mills,et al.  Statistical Methods , 1973 .

[9]  Katsuyuki Sakai,et al.  Is the Prefrontal Cortex Necessary for Establishing Cognitive Sets? , 2007, The Journal of Neuroscience.

[10]  D. Eckstein,et al.  Rule-Selection and Action-Selection have a Shared Neuroanatomical Basis in the Human Prefrontal and Parietal Cortex , 2008, Cerebral cortex.

[11]  J. Desmond,et al.  Dissociation of Frontal and Cerebellar Activity in a Cognitive Task: Evidence for a Distinction between Selection and Search , 1998, NeuroImage.

[12]  A Baddeley,et al.  Random Generation and the Executive Control of Working Memory , 1998, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[13]  L. Deecke,et al.  The Preparation and Execution of Self-Initiated and Externally-Triggered Movement: A Study of Event-Related fMRI , 2002, NeuroImage.

[14]  Michael N. Shadlen,et al.  Probabilistic reasoning by neurons , 2007, Nature.

[15]  Ewald Moser,et al.  The selection of intended actions and the observation of others' actions: A time-resolved fMRI study , 2006, NeuroImage.

[16]  C. D. Frith,et al.  The Role of the Dorsolateral Prefrontal Cortex: Evidence from the Effects of Contextual Constraint in a Sentence Completion Task , 2002, NeuroImage.

[17]  Scott D. Brown,et al.  Domain General Mechanisms of Perceptual Decision Making in Human Cortex , 2009, The Journal of Neuroscience.

[18]  B A J Reddi,et al.  Accuracy, information, and response time in a saccadic decision task. , 2003, Journal of neurophysiology.

[19]  Jan Derrfuss,et al.  When the Choice Is Ours: Context and Agency Modulate the Neural Bases of Decision-Making , 2008, PloS one.

[20]  H. C Lau,et al.  Willed action and attention to the selection of action , 2004, NeuroImage.

[21]  D. Meyer,et al.  Neuroeconomics: The Consilience of Brain and Decision , 2004 .

[22]  M. Walton,et al.  Interactions between decision making and performance monitoring within prefrontal cortex , 2004, Nature Neuroscience.

[23]  T. Robbins,et al.  Contrasting Cortical and Subcortical Activations Produced by Attentional-Set Shifting and Reversal Learning in Humans , 2000, Journal of Cognitive Neuroscience.

[24]  T. Robbins,et al.  Dissociating executive mechanisms of task control following frontal lobe damage and Parkinson's disease. , 1998, Brain : a journal of neurology.

[25]  Philip L. Smith,et al.  Dual diffusion model for single-cell recording data from the superior colliculus in a brightness-discrimination task. , 2007, Journal of neurophysiology.

[26]  Matthew F. S. Rushworth,et al.  Choosing Where to Attend and the Medial Frontal Cortex: An fMRI Study , 2008, Journal of neurophysiology.

[27]  Timothy D. Hanks,et al.  Probabilistic Population Codes for Bayesian Decision Making , 2008, Neuron.

[28]  B. Libet,et al.  Time of conscious intention to act in relation to onset of cerebral activity (readiness-potential). The unconscious initiation of a freely voluntary act. , 1983, Brain : a journal of neurology.

[29]  Timothy Edward John Behrens,et al.  Effort-Based Cost–Benefit Valuation and the Human Brain , 2009, The Journal of Neuroscience.

[30]  M. Brass,et al.  Unconscious determinants of free decisions in the human brain , 2008, Nature Neuroscience.

[31]  M. Shadlen,et al.  Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task , 2002, The Journal of Neuroscience.

[32]  Holger Wiese,et al.  Prefrontal cortex activity in self-initiated movements is condition-specific, but not movement-related , 2005, NeuroImage.

[33]  M Petrides,et al.  Impairments on nonspatial self-ordered and externally ordered working memory tasks after lesions of the mid-dorsal part of the lateral frontal cortex in the monkey , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[34]  Scott A. McDonald,et al.  LATER predicts saccade latency distributions in reading , 2007, Experimental Brain Research.

[35]  R. Carpenter,et al.  Countermanding saccades in humans , 1999, Vision Research.

[36]  Donald A. Norman,et al.  Attention to Action , 1986 .

[37]  Karl J. Friston,et al.  Willed action and the prefrontal cortex in man: a study with PET , 1991, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[38]  R. Carpenter,et al.  Contrast, Probability, and Saccadic Latency Evidence for Independence of Detection and Decision , 2004, Current Biology.

[39]  M. Hallett,et al.  The timing of the conscious intention to move , 2008, The European journal of neuroscience.

[40]  Karl J. Friston,et al.  The prefrontal cortex shows context-specific changes in effective connectivity to motor or visual cortex during the selection of action or colour. , 2004, Cerebral cortex.

[41]  M. Petrides.  The role of the mid-dorsolateral prefrontal cortex in working memory , 2000, Experimental Brain Research.

[42]  P. Dayan,et al.  Cortical substrates for exploratory decisions in humans , 2006, Nature.

[43]  P. Dayan,et al.  Differential Encoding of Losses and Gains in the Human Striatum , 2007, The Journal of Neuroscience.

[44]  Kip Smith,et al.  The impact of the certainty context on the process of choice , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[45]  D. Norman,et al.  Attention to action: Willed and automatic control , 1980 .

[46]  Karl J. Friston,et al.  Cortical areas and the selection of movement: a study with positron emission tomography , 1991, Experimental Brain Research.

[47]  C. Bruce,et al.  Primate frontal eye fields. I. Single neurons discharging before saccades. , 1985, Journal of neurophysiology.

[48]  Jeffrey N. Rouder,et al.  Modeling Response Times for Two-Choice Decisions , 1998 .

[49]  E. Vaadia,et al.  Midbrain dopamine neurons encode decisions for future action , 2006, Nature Neuroscience.

[50]  Timothy E. J. Behrens,et al.  Frontal Cortex Subregions Play Distinct Roles in Choices between Actions and Stimuli , 2008, The Journal of Neuroscience.

[51]  Peter Dayan,et al.  Temporal difference models describe higher-order learning in humans , 2004, Nature.

[52]  M. Walton,et al.  Calculating the Cost of Acting in Frontal Cortex , 2007, Annals of the New York Academy of Sciences.

[53]  Jonathan D. Cohen,et al.  The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. , 2006, Psychological review.

[54]  Karl J. Friston,et al.  Attention to Action: Specific Modulation of Corticocortical Interactions in Humans , 2001, NeuroImage.

[55]  R. E. Passingham,et al.  Interference with Performance of a Response Selection Task that has no Working Memory Component: An rTMS Comparison of the Dorsolateral Prefrontal and Medial Frontal Cortex , 2001, Journal of Cognitive Neuroscience.