Order-Dependent Modulation of Directional Signals in the Supplementary and Presupplementary Motor Areas

To maximize reward and minimize effort, animals must often execute multiple movements in a timely and orderly manner. Such movement sequences must be usually discovered through experience, and during this process, signals related to the animal's action, its ordinal position in the sequence, and subsequent reward need to be properly integrated. To investigate the role of the primate medial frontal cortex in planning and controlling multiple movements, monkeys were trained to produce a series of hand movements instructed by visual stimuli. We manipulated the number of movements in a sequence across trials, making it possible to dissociate the effects of the ordinal position of a given movement and the number of remaining movements necessary to obtain reward. Neurons in the supplementary and presupplementary motor areas modulated their activity according to the number of remaining movements, more often than in relation to the ordinal position, suggesting that they might encode signals related to the timing of reward or its temporally discounted value. In both cortical areas, signals related to the number of remaining movements and those related to movement direction were often combined multiplicatively, suggesting that the gain of the signals related to movements might be modulated by motivational factors. Finally, compared with the supplementary motor area, neurons in the presupplementary motor area were more likely to increase their activity when the number of remaining movements is large. These results suggest that these two areas might play complementary roles in controlling movement sequences.

[1]  Daeyeol Lee Coherent Oscillations in Neuronal Activity of the Supplementary Motor Area during a Visuomotor Task , 2003, The Journal of Neuroscience.

[2]  M. Walton,et al.  Action sets and decisions in the medial frontal cortex , 2004, Trends in Cognitive Sciences.

[3]  Masataka Watanabe Reward expectancy in primate prefrental neurons , 1996, Nature.

[4]  Wolfram Schultz,et al.  Effects of expectations for different reward magnitudes on neuronal activity in primate striatum. , 2003, Journal of neurophysiology.

[5]  J. Tanji,et al.  Distinctions between dorsal and ventral premotor areas: anatomical connectivity and functional properties , 2007, Current Opinion in Neurobiology.

[6]  M. Shadlen,et al.  Effect of Expected Reward Magnitude on the Response of Neurons in the Dorsolateral Prefrontal Cortex of the Macaque , 1999, Neuron.

[7]  E. Procyk,et al.  Characterization of serial order encoding in the monkey anterior cingulate sulcus , 2001, The European journal of neuroscience.

[8]  P. Glimcher,et al.  Activity in Posterior Parietal Cortex Is Correlated with the Relative Subjective Desirability of Action , 2004, Neuron.

[9]  Daeyeol Lee,et al.  Effects of reward expectancy on sequential eye movements in monkeys , 2006, Neural Networks.

[10]  J. Tanji,et al.  Neuronal activity in the supplementary and presupplementary motor areas for temporal organization of multiple movements. , 2000, Journal of neurophysiology.

[11]  G. Loewenstein,et al.  Time Discounting and Time Preference: A Critical Review , 2002 .

[12]  Daeyeol Lee,et al.  Behavioral Context and Coherent Oscillations in the Supplementary Motor Area , 2022 .

[13]  H Mushiake,et al.  Pallidal neuron activity during sequential arm movements. , 1995, Journal of neurophysiology.

[14]  M. Roesch,et al.  Neuronal Activity Related to Reward Value and Motivation in Primate Frontal Cortex , 2004, Science.

[15]  J. Tanji,et al.  A motor area rostral to the supplementary motor area (presupplementary motor area) in the monkey: neuronal activity during a learned motor task. , 1992, Journal of neurophysiology.

[16]  Kae Nakamura,et al.  Neuronal activity in medial frontal cortex during learning of sequential procedures. , 1998, Journal of neurophysiology.

[17]  B. Richmond,et al.  Neural signals in the monkey ventral striatum related to motivation for juice and cocaine rewards. , 1996, Journal of neurophysiology.

[18]  W. Schultz,et al.  Adaptive Coding of Reward Value by Dopamine Neurons , 2005, Science.

[19]  O. Hikosaka,et al.  Functional properties of monkey caudate neurons. I. Activities related to saccadic eye movements. , 1989, Journal of neurophysiology.

[20]  Michael L. Platt,et al.  Neural correlates of reward and attention in macaque area LIP , 2006, Neuropsychologia.

[21]  G. Rizzolatti,et al.  Patterns of cytochrome oxidase activity in the frontal agranular cortex of the macaque monkey , 1985, Behavioural Brain Research.

[22]  D. Pandya,et al.  Architecture and frontal cortical connections of the premotor cortex (area 6) in the rhesus monkey , 1987, The Journal of comparative neurology.

[23]  R. Andersen,et al.  Multimodal representation of space in the posterior parietal cortex and its use in planning movements. , 1997, Annual review of neuroscience.

[24]  M. Nissen,et al.  Attentional requirements of learning: Evidence from performance measures , 1987, Cognitive Psychology.

[25]  Daeyeol Lee,et al.  Coding and transmission of information by neural ensembles , 2004, Trends in Neurosciences.

[26]  A. Hariri,et al.  Preference for Immediate over Delayed Rewards Is Associated with Magnitude of Ventral Striatal Activity , 2006, The Journal of Neuroscience.

[27]  P. Roland,et al.  Supplementary motor area and other cortical areas in organization of voluntary movements in man. , 1980, Journal of neurophysiology.

[28]  M. Roesch,et al.  Neuronal activity dependent on anticipated and elapsed delay in macaque prefrontal cortex, frontal and supplementary eye fields, and premotor cortex. , 2005, Journal of neurophysiology.

[29]  P. Goldman-Rakic,et al.  Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. , 1989, Journal of neurophysiology.

[30]  C. Padoa-Schioppa,et al.  Neurons in the orbitofrontal cortex encode economic value , 2006, Nature.

[31]  C. T. Perin A quantitative investigation of the delay-of-reinforcement gradient. , 1943 .

[32]  H. Seo,et al.  Dynamic signals related to choices and outcomes in the dorsolateral prefrontal cortex. , 2007, Cerebral cortex.

[33]  Y. Amit,et al.  Encoding of Movement Fragments in the Motor Cortex , 2007, The Journal of Neuroscience.

[34]  R A Andersen,et al.  Supplementary motor area encodes reward expectancy in eye-movement tasks. , 2005, Journal of neurophysiology.

[35]  L. Fogassi,et al.  Eye position effects on visual, memory, and saccade-related activity in areas LIP and 7a of macaque , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[36]  A. R. Lurii︠a︡ Human brain and psychological processes , 1966 .

[37]  S P Wise,et al.  The somatotopic organization of the supplementary motor area: intracortical microstimulation mapping , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[38]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[39]  Carrie J. McAdams,et al.  Effects of Attention on Orientation-Tuning Functions of Single Neurons in Macaque Cortical Area V4 , 1999, The Journal of Neuroscience.

[40]  M. Roesch,et al.  Neuronal activity in primate orbitofrontal cortex reflects the value of time. , 2005, Journal of neurophysiology.

[41]  Stefan Treue,et al.  Feature-based attention influences motion processing gain in macaque visual cortex , 1999, Nature.

[42]  P. Samuelson A Note on Measurement of Utility , 1937 .

[43]  G. Rizzolatti,et al.  Architecture of superior and mesial area 6 and the adjacent cingulate cortex in the macaque monkey , 1991, The Journal of comparative neurology.

[44]  Frances S. Chance,et al.  Gain Modulation from Background Synaptic Input , 2002, Neuron.

[45]  M. Manfredi,et al.  The masseter inhibitory reflex is evoked by innocuous stimuli and mediated by A beta afferent fibres , 2004, Experimental Brain Research.

[46]  W. Newsome,et al.  Matching Behavior and the Representation of Value in the Parietal Cortex , 2004, Science.

[47]  Jorge V. José,et al.  Synchronization as a mechanism for attentional gain modulation , 2004, Neurocomputing.

[48]  O. Hikosaka,et al.  Expectation of reward modulates cognitive signals in the basal ganglia , 1998, Nature Neuroscience.

[49]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[50]  Scott T. Grafton,et al.  Functional Mapping of Sequence Learning in Normal Humans , 1995, Journal of Cognitive Neuroscience.

[51]  Emilio Salinas,et al.  Gain Modulation A Major Computational Principle of the Central Nervous System , 2000, Neuron.

[52]  W. Schultz,et al.  Relative reward preference in primate orbitofrontal cortex , 1999, Nature.

[53]  B. Richmond,et al.  Anterior Cingulate: Single Neuronal Signals Related to Degree of Reward Expectancy , 2002, Science.

[54]  Xiao-Jing Wang,et al.  An Integrated Microcircuit Model of Attentional Processing in the Neocortex , 2007, The Journal of Neuroscience.

[55]  Daeyeol Lee Neural basis of quasi-rational decision making , 2006, Current Opinion in Neurobiology.

[56]  Daeyeol Lee,et al.  Activity in prefrontal cortex during dynamic selection of action sequences , 2006, Nature Neuroscience.

[57]  M. Roesch,et al.  Impact of expected reward on neuronal activity in prefrontal cortex, frontal and supplementary eye fields and premotor cortex. , 2003, Journal of neurophysiology.

[58]  J. Maunsell Neuronal representations of cognitive state: reward or attention? , 2004, Trends in Cognitive Sciences.

[59]  Jun Tanji,et al.  Participation of the primate presupplementary motor area in sequencing multiple saccades. , 2004, Journal of neurophysiology.

[60]  G. E. Alexander,et al.  Movement sequence-related activity reflecting numerical order of components in supplementary and presupplementary motor areas. , 1998, Journal of neurophysiology.

[61]  G. S. Russo,et al.  Neural activity in monkey dorsal and ventral cingulate motor areas: comparison with the supplementary motor area. , 2002, Journal of neurophysiology.

[62]  P. Strick,et al.  Imaging the premotor areas , 2001, Current Opinion in Neurobiology.

[63]  D. Brooks,et al.  Motor sequence learning: a study with positron emission tomography , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[64]  Jun Tanji,et al.  Role for supplementary motor area cells in planning several movements ahead , 1994, Nature.

[65]  Joseph J. Paton,et al.  The primate amygdala represents the positive and negative value of visual stimuli during learning , 2006, Nature.

[66]  J. Tanji,et al.  Contrasting neuronal activity in the supplementary and frontal eye fields during temporal organization of multiple saccades. , 2003, Journal of neurophysiology.

[67]  E. Bézard,et al.  Shaping of Motor Responses by Incentive Values through the Basal Ganglia , 2007, The Journal of Neuroscience.

[68]  J. Joseph,et al.  Activity in the caudate nucleus of monkey during spatial sequencing. , 1995, Journal of neurophysiology.

[69]  E. Procyk,et al.  Reward encoding in the monkey anterior cingulate cortex. , 2006, Cerebral cortex.

[70]  J. Tanji Sequential organization of multiple movements: involvement of cortical motor areas. , 2001, Annual review of neuroscience.

[71]  G. Leichnetz Afferent and efferent connections of the dorsolateral precentral gyrus (area 4, hand/arm region) in the macaque monkey, with comparisons to area 8 , 1986, The Journal of comparative neurology.

[72]  J. Tanji,et al.  Both supplementary and presupplementary motor areas are crucial for the temporal organization of multiple movements. , 1998, Journal of neurophysiology.

[73]  S. Tsujimoto,et al.  Neuronal activity representing temporal prediction of reward in the primate prefrontal cortex. , 2005, Journal of neurophysiology.

[74]  D. Barraclough,et al.  Prefrontal cortex and decision making in a mixed-strategy game , 2004, Nature Neuroscience.

[75]  K. Doya,et al.  Representation of Action-Specific Reward Values in the Striatum , 2005, Science.

[76]  Daeyeol Lee,et al.  Activity in the supplementary motor area related to learning and performance during a sequential visuomotor task. , 2003, Journal of neurophysiology.

[77]  J. Joseph,et al.  Prefrontal cortex and spatial sequencing in macaque monkey , 2004, Experimental Brain Research.

[78]  T. Sejnowski,et al.  Network Oscillations: Emerging Computational Principles , 2006, The Journal of Neuroscience.

[79]  H. Seo,et al.  Temporal Filtering of Reward Signals in the Dorsal Anterior Cingulate Cortex during a Mixed-Strategy Game , 2007, The Journal of Neuroscience.

[80]  K. Doya,et al.  Parallel neural networks for learning sequential procedures , 1999, Trends in Neurosciences.

[81]  O. Hikosaka,et al.  Influence of reward expectation on visuospatial processing in macaque lateral prefrontal cortex. , 2002, Journal of neurophysiology.

[82]  Ronald Christensen,et al.  Log-Linear Models and Logistic Regression , 1997 .

[83]  Saori C. Tanaka,et al.  Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops , 2004, Nature Neuroscience.

[84]  Apostolos P. Georgopoulos,et al.  Neural activity in prefrontal cortex during copying geometrical shapes , 2003, Experimental Brain Research.