Representational precision in visual cortex reveals outcome encoding and reward modulation during action preparation

&NA; According to ideomotor theory, goal‐directed action involves the active perceptual anticipation of actions and their associated effects. We used multivariate analysis of fMRI data to test if preparation of an action promotes precision in the perceptual representation of the action. In addition, we tested how reward magnitude modulates this effect. Finally, we examined how expectation and uncertainty impact neural precision in the motor cortex. In line with our predictions, preparation of a hand or face action increased the precision of neural activation patterns in the extrastriate body area (EBA) and fusiform face area (FFA), respectively. The size of this effect of anticipation predicted individuals' efficiency at performing the prepared action. In addition, increasing reward magnitude increased the precision of perceptual representations in both EBA and FFA although this effect was limited to the group of participants that learned to associate face actions with high reward. Surprisingly, examination of representations in the hand motor cortex and face motor cortex yielded effects in the opposite direction. Our findings demonstrate that the precision of representations in visual and motor areas provides an important neural signature of the sensorimotor representations involved in goal‐directed action. Graphical abstract Figure. No caption available.

[1]  Nancy Kanwisher,et al.  An algorithmic method for functionally defining regions of interest in the ventral visual pathway , 2012, NeuroImage.

[2]  Andrew M. Clark,et al.  Stimulus onset quenches neural variability: a widespread cortical phenomenon , 2010, Nature Neuroscience.

[3]  Clay B Holroyd,et al.  What can topology changes in the oddball N2 reveal about underlying processes? , 2011, Neuroreport.

[4]  Mark W. Woolrich,et al.  Advances in functional and structural MR image analysis and implementation as FSL , 2004, NeuroImage.

[5]  Keiji Tanaka,et al.  Matching Categorical Object Representations in Inferior Temporal Cortex of Man and Monkey , 2008, Neuron.

[6]  A. Meltzoff,et al.  Imitation of Facial and Manual Gestures by Human Neonates , 1977, Science.

[7]  Michael Rudolph,et al.  The high-conductance state of neocortical neurons in vivo , 2003, Nature Reviews Neuroscience.

[8]  John T Serences,et al.  Value-Based Modulations in Human Visual Cortex , 2008, Neuron.

[9]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[10]  E. Deci,et al.  A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. , 1999, Psychological bulletin.

[11]  B. Hommel,et al.  Directive and incentive functions of affective action consequences: an ideomotor approach , 2015, Psychological research.

[12]  Marius V Peelen,et al.  A Causal Role for the Extrastriate Body Area in Detecting People in Real-World Scenes , 2013, The Journal of Neuroscience.

[13]  G. Pfurtscheller,et al.  Event-related synchronization (ERS) in the alpha band--an electrophysiological correlate of cortical idling: a review. , 1996, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[14]  Ivan Toni,et al.  The Extrastriate Body Area Computes Desired Goal States during Action Planning123 , 2016, eNeuro.

[15]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[16]  Ruud Custers,et al.  Adaptive control of human action: the role of outcome representations and reward signals , 2013, Front. Psychol..

[17]  N. Kanwisher,et al.  A Cortical Area Selective for Visual Processing of the Human Body , 2001, Science.

[18]  E. J. Capaldi,et al.  A review of contemporary ideomotor theory. , 2010, Psychological bulletin.

[19]  J. V. van Berkum,et al.  How robust is the language architecture? The case of mood , 2013, Front. Psychol..

[20]  Nicholas I. Fisher,et al.  Statistical Analysis of Spherical Data. , 1987 .

[21]  J. Cohen,et al.  Catecholamine-Mediated Increases in Gain Enhance the Precision of Cortical Representations , 2016, The Journal of Neuroscience.

[22]  W. Fias,et al.  The Internal Anticipation of Sensory Action Effects: When Action Induces FFA and PPA Activity , 2010, Front. Hum. Neurosci..

[23]  Hermann Lotze Medicinische Psychologie, oder, Physiologie der Seele , 2006 .

[24]  A. Meltzoff,et al.  Explaining Facial Imitation: A Theoretical Model. , 1997, Early development & parenting.

[25]  ROY F. ALLISON The Influence of Room Boundaries on Loudspeaker Power Output , 1974 .

[26]  Keith J. Worsley,et al.  Statistical analysis of activation images , 2001 .

[27]  B. Hommel,et al.  Effect anticipation and action control , 2001 .

[28]  Paul Miller,et al.  Power-law neuronal fluctuations in a recurrent network model of parametric working memory. , 2006, Journal of neurophysiology.

[29]  Russell A. Poldrack,et al.  The future of fMRI in cognitive neuroscience , 2012, NeuroImage.

[30]  B. Hommel,et al.  Effect anticipation and action control. , 2001, Journal of experimental psychology. Human perception and performance.

[31]  B. Hommel,et al.  Genetic markers of striatal dopamine predict individual differences in dysfunctional, but not functional impulsivity , 2010, Neuroscience.

[32]  I. Toni,et al.  Compensatory Activity in the Extrastriate Body Area of Parkinson's Disease Patients , 2012, The Journal of Neuroscience.

[33]  C. N. Boehler,et al.  Task-Load-Dependent Activation of Dopaminergic Midbrain Areas in the Absence of Reward , 2011, The Journal of Neuroscience.

[34]  S. Nieuwenhuis,et al.  Perceptual choice boosts network stability: effect of neuromodulation? , 2015, Trends in Cognitive Sciences.

[35]  Rajesh P. N. Rao,et al.  Spectral Changes in Cortical Surface Potentials during Motor Movement , 2007, The Journal of Neuroscience.

[36]  Clemens Brunner,et al.  Mu rhythm (de)synchronization and EEG single-trial classification of different motor imagery tasks , 2006, NeuroImage.

[37]  Bernhard Hommel,et al.  The Functional and Neural Mechanism of Action Preparation: Roles of EBA and FFA in Voluntary Action Control , 2011, Journal of Cognitive Neuroscience.

[38]  Melissa J. Allman,et al.  Learning processes affecting human decision making: An assessment of reinforcer-selective Pavlovian-to-instrumental transfer following reinforcer devaluation. , 2010, Journal of experimental psychology. Animal behavior processes.

[39]  Nancy Kanwisher,et al.  A cortical representation of the local visual environment , 1998, Nature.

[40]  Byron M. Yu,et al.  Neural Variability in Premotor Cortex Provides a Signature of Motor Preparation , 2006, The Journal of Neuroscience.

[41]  Carmen Weiss,et al.  Doing good or bad: How interactions between action and emotion expectations shape the sense of agency , 2015, Social neuroscience.

[42]  B. Hommel,et al.  Contiguity and contingency in action-effect learning , 2004, Psychological research.

[43]  Bernhard Hommel,et al.  The neural substrate of the ideomotor principle: An event-related fMRI analysis , 2008, NeuroImage.

[44]  B. Hommel,et al.  The neural substrate of the ideomotor principle revisited: Evidence for asymmetries in action-effect learning , 2013, Neuroscience.

[45]  Ryan K. Jessup,et al.  Distinguishing informational from value‐related encoding of rewarding and punishing outcomes in the human brain , 2014, The European journal of neuroscience.

[46]  Nikolaus Kriegeskorte,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[47]  B. Hommel,et al.  Working for food you don’t desire. Cues interfere with goal-directed food-seeking , 2014, Appetite.

[48]  Arie W. Kruglanski,et al.  A theory of goal systems. , 2002 .

[49]  F. D. de Lange,et al.  Motor planning is facilitated by adopting an action's goal posture: an fMRI study. , 2012, Cerebral cortex.

[50]  K. R. Ridderinkhof,et al.  The Role of the Striatum in Effort-Based Decision-Making in the Absence of Reward , 2014, The Journal of Neuroscience.

[51]  P. Conrod,et al.  The Substance Use Risk Profile Scale: a scale measuring traits linked to reinforcement-specific substance use profiles. , 2009, Addictive behaviors.

[52]  Jonathan D. Cohen,et al.  Decision making, the P3, and the locus coeruleus-norepinephrine system. , 2005, Psychological bulletin.

[53]  H. Simon,et al.  Motivational and emotional controls of cognition. , 1967, Psychological review.

[54]  Kenji Matsumoto,et al.  Neural basis of the undermining effect of monetary reward on intrinsic motivation , 2010, Proceedings of the National Academy of Sciences.

[55]  Freek E. Hoebeek,et al.  SLC26A11 (KBAT) in Purkinje Cells Is Critical for Inhibitory Transmission and Contributes to Locomotor Coordination , 2016, eNeuro.

[56]  W D Pierce,et al.  Pervasive negative effects of rewards on intrinsic motivation: The myth continues , 2001, The Behavior analyst.

[57]  N. Kanwisher,et al.  Mental Imagery of Faces and Places Activates Corresponding Stimulus-Specific Brain Regions , 2000, Journal of Cognitive Neuroscience.

[58]  David Dignath,et al.  The Quarterly Journal of Experimental Psychology Cue-elicited Food Seeking Is Eliminated with Aversive Outcomes following Outcome Devaluation View Related Articles View Crossmark Data Citing Articles: 1 View Citing Articles , 2022 .

[59]  Daniel C. McNamee,et al.  Category-dependent and category-independent goal-value codes in human ventromedial prefrontal cortex , 2013, Nature Neuroscience.

[60]  B. Hommel,et al.  Dissociable corticostriatal circuits underlie goal‐directed vs. cue‐elicited habitual food seeking after satiation: evidence from a multimodal MRI study , 2017, The European journal of neuroscience.

[61]  Reinout W. Wiers,et al.  Impulsivity, Impulsive and Reflective Processes and the Development of Alcohol Use and Misuse in Adolescents and Young Adults , 2010, Front. Psychology.

[62]  S. Haber,et al.  The Reward Circuit: Linking Primate Anatomy and Human Imaging , 2010, Neuropsychopharmacology.

[63]  J D Cohen,et al.  A network model of catecholamine effects: gain, signal-to-noise ratio, and behavior. , 1990, Science.

[64]  G. Rees,et al.  Neuroimaging: Decoding mental states from brain activity in humans , 2006, Nature Reviews Neuroscience.

[65]  A. Pouget,et al.  Variance as a Signature of Neural Computations during Decision Making , 2011, Neuron.

[66]  J. Mumford,et al.  Greater Neural Pattern Similarity Across Repetitions Is Associated with Better Memory , 2010, Science.

[67]  J. Patton,et al.  Factor structure of the Barratt impulsiveness scale. , 1995, Journal of clinical psychology.

[68]  Jonathan D. Cohen,et al.  Reproducibility Distinguishes Conscious from Nonconscious Neural Representations , 2010, Science.

[69]  C. Heyes Causes and consequences of imitation , 2001, Trends in Cognitive Sciences.

[70]  L. Hogarth,et al.  Parallel goal-directed and habitual control of human drug-seeking: implications for dependence vulnerability. , 2011, Journal of experimental psychology. Animal behavior processes.

[71]  Marcia K. Johnson,et al.  A brief thought can modulate activity in extrastriate visual areas: Top-down effects of refreshing just-seen visual stimuli , 2007, NeuroImage.

[72]  K. Berridge,et al.  Incentive-sensitization and addiction. , 2001, Addiction.

[73]  K. Berridge,et al.  What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? , 1998, Brain Research Reviews.

[74]  J. A. Pruszynski,et al.  Neural correlates , 2023 .

[75]  Stanislas Dehaene,et al.  Cortical activity is more stable when sensory stimuli are consciously perceived , 2015, Proceedings of the National Academy of Sciences.

[76]  Cosimo Urgesi,et al.  Magnetic Stimulation of Extrastriate Body Area Impairs Visual Processing of Nonfacial Body Parts , 2004, Current Biology.

[77]  Jonathan D. Cohen,et al.  Confounds in multivariate pattern analysis: Theory and rule representation case study , 2013, NeuroImage.

[78]  D. Pitcher,et al.  Transcranial Magnetic Stimulation Disrupts the Perception and Embodiment of Facial Expressions , 2008, The Journal of Neuroscience.

[79]  Paul S. Muhle-Karbe,et al.  On the Influence of Reward on Action-Effect Binding , 2012, Front. Psychology.

[80]  C. N. Boehler,et al.  The influence of reward associations on conflict processing in the Stroop task , 2010, Cognition.

[81]  Vivian V. Valentin,et al.  Determining the Neural Substrates of Goal-Directed Learning in the Human Brain , 2007, The Journal of Neuroscience.

[82]  Jonathan D. Cohen,et al.  An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. , 2005, Annual review of neuroscience.

[83]  Planning not to do something: Does intending not to do something activate associated sensory consequences? , 2010, Cognitive, affective & behavioral neuroscience.

[84]  M. Corbetta,et al.  Extrastriate body area in human occipital cortex responds to the performance of motor actions , 2004, Nature Neuroscience.

[85]  Alison J. Wiggett,et al.  Functional MRI analysis of body and body part representations in the extrastriate and fusiform body areas. , 2007, Journal of neurophysiology.

[86]  Michael W. Cole,et al.  Reward Motivation Enhances Task Coding in Frontoparietal Cortex. , 2016, Cerebral cortex.

[87]  P. Muris,et al.  Psychometric Properties of the Dutch BIS/BAS Scales , 2005 .

[88]  P. Cardoso-Leite,et al.  Neuroscience and Biobehavioral Reviews Action effect anticipation: Neurophysiological basis and functional consequences (cid:2) , 2022 .

[89]  G. Aschersleben,et al.  The Theory of Event Coding (TEC): a framework for perception and action planning. , 2001, The Behavioral and brain sciences.

[90]  Laurence Claes,et al.  Psychometric properties of the Dickman Impulsivity Inventory , 2000 .

[91]  Hartwig R. Siebner,et al.  Linking Actions and Their Perceivable Consequences in the Human Brain , 2002, NeuroImage.

[92]  L. Hogarth,et al.  Impaired goal-directed behavioural control in human impulsivity , 2010, Quarterly journal of experimental psychology.

[93]  T. Braver,et al.  Anticipating the consequences of action: an fMRI study of intention-based task preparation. , 2010, Psychophysiology.

[94]  Clay B. Holroyd,et al.  The Impact of Deliberative Strategy Dissociates ERP Components Related to Conflict Processing vs. Reinforcement Learning , 2012, Front. Neurosci..

[95]  S. Kosslyn,et al.  Mental imagery , 2013, Front. Psychol..

[96]  D. Spalding The Principles of Psychology , 1873, Nature.

[97]  Moritz F. Wurm,et al.  Decoding Actions at Different Levels of Abstraction , 2015, The Journal of Neuroscience.

[98]  P. Dechent,et al.  Neural correlates of ideomotor effect anticipations , 2014, Neuroscience.

[99]  L. Chelazzi,et al.  Reward Changes Salience in Human Vision via the Anterior Cingulate , 2010, The Journal of Neuroscience.

[100]  N. Daw,et al.  Multiple Systems for Value Learning , 2014 .

[101]  M. Botvinick,et al.  Motivation and cognitive control: from behavior to neural mechanism. , 2015, Annual review of psychology.

[102]  Benjamin F. Rodriguez,et al.  Psychometric Properties , 2009 .