Human visual and parietal cortex encode visual choices independent of motor plans

Perceptual decision-making entails the transformation of graded sensory signals into categorical judgments. Often, there is a direct mapping between these judgments and specific motor responses. However, when stimulus-response mappings are fixed, neural activity underlying decision-making cannot be separated from neural activity reflecting motor planning. Several human neuroimaging studies have reported changes in brain activity associated with perceptual decisions. Nevertheless, to date it has remained unknown where and how specific choices are encoded in the human brain when motor planning is decoupled from the decision process. We addressed this question by having subjects judge the direction of motion of dynamic random dot patterns at various levels of motion strength while measuring their brain activity with fMRI. We used multivariate decoding analyses to search the whole brain for patterns of brain activity encoding subjects' choices. To decouple the decision process from motor planning, subjects were informed about the required motor response only after stimulus presentation. Patterns of fMRI signals in early visual and inferior parietal cortex predicted subjects' perceptual choices irrespective of motor planning. This was true across several levels of motion strength and even in the absence of any coherent stimulus motion. We also found that the cortical distribution of choice-selective brain signals depended on stimulus strength: While visual cortex carried most choice-selective information for strong motion, information in parietal cortex decreased with increasing motion coherence. These results demonstrate that human visual and inferior parietal cortex carry information about the visual decision in a more abstract format than can be explained by simple motor intentions. Both brain regions may be differentially involved in perceptual decision-making in the face of strong and weak sensory evidence.

[1]  M. D’Esposito,et al.  The functional anatomy of a perceptual decision in the human brain. , 2010, Journal of neurophysiology.

[2]  Timothy J. Pleskac,et al.  Neural correlates of evidence accumulation in a perceptual decision task. , 2011, Journal of neurophysiology.

[3]  M. Corbetta,et al.  Sensory-motor mechanisms in human parietal cortex underlie arbitrary visual decisions , 2008, Nature Neuroscience.

[4]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[5]  A M Dale,et al.  Optimal experimental design for event‐related fMRI , 1999, Human brain mapping.

[6]  D. Bradley,et al.  Structure and function of visual area MT. , 2005, Annual review of neuroscience.

[7]  Leslie G. Ungerleider,et al.  Neuroimaging Studies of Attention: From Modulation of Sensory Processing to Top-Down Control , 2003, The Journal of Neuroscience.

[8]  U. Noppeney,et al.  Perceptual Decisions Formed by Accumulation of Audiovisual Evidence in Prefrontal Cortex , 2010, The Journal of Neuroscience.

[9]  Leslie G. Ungerleider,et al.  The neural systems that mediate human perceptual decision making , 2008, Nature Reviews Neuroscience.

[10]  K D Singh,et al.  Transient and linearly graded deactivation of the human default-mode network by a visual detection task , 2008, NeuroImage.

[11]  J. Gold,et al.  Distinct Representations of a Perceptual Decision and the Associated Oculomotor Plan in the Monkey Lateral Intraparietal Area , 2011, The Journal of Neuroscience.

[12]  Karl J. Friston,et al.  A theory of cortical responses , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[13]  Scott D. Brown,et al.  Domain General Mechanisms of Perceptual Decision Making in Human Cortex , 2009, The Journal of Neuroscience.

[14]  Stephen D. Mayhew,et al.  Article Learning Shapes the Representation of Behavioral Choice in the Human Brain , 2022 .

[15]  K. R. Ridderinkhof,et al.  The Role of the Medial Frontal Cortex in Cognitive Control , 2004, Science.

[16]  A. Noë,et al.  A sensorimotor account of vision and visual consciousness. , 2001, The Behavioral and brain sciences.

[17]  Soyoung Q. Park,et al.  The neural code of reward anticipation in human orbitofrontal cortex , 2010, Proceedings of the National Academy of Sciences.

[18]  M. Shadlen,et al.  Representation of Confidence Associated with a Decision by Neurons in the Parietal Cortex , 2009, Science.

[19]  F. Tong,et al.  Decoding Seen and Attended Motion Directions from Activity in the Human Visual Cortex , 2006, Current Biology.

[20]  Katsuyuki Sakai,et al.  Prefrontal Set Activity Predicts Rule-Specific Neural Processing during Subsequent Cognitive Performance , 2006, The Journal of Neuroscience.

[21]  Adam Kepecs,et al.  Seeing at a glance, smelling in a whiff: rapid forms of perceptual decision making , 2006, Nature Reviews Neuroscience.

[22]  K. H. Britten,et al.  A relationship between behavioral choice and the visual responses of neurons in macaque MT , 1996, Visual Neuroscience.

[23]  J. Gold,et al.  The Influence of Behavioral Context on the Representation of a Perceptual Decision in Developing Oculomotor Commands , 2003, The Journal of Neuroscience.

[24]  G. Boynton,et al.  Feature-Based Attentional Modulations in the Absence of Direct Visual Stimulation , 2007, Neuron.

[25]  M. D’Esposito,et al.  Neural Representations of Relevant and Irrelevant Features in Perceptual Decision Making , 2010, The Journal of Neuroscience.

[26]  K. H. Britten,et al.  A relationship between behavioral choice and the visual responses of neurons in macaque , 2008 .

[27]  R. Romo,et al.  Neuronal correlates of decision-making in secondary somatosensory cortex , 2002, Nature Neuroscience.

[28]  J. Haynes,et al.  Neural Responses to Unattended Products Predict Later Consumer Choices , 2010, The Journal of Neuroscience.

[29]  Éva M. Bankó,et al.  Dissociating the Effect of Noise on Sensory Processing and Overall Decision Difficulty , 2011, The Journal of Neuroscience.

[30]  G. Freyd,et al.  Separate Signals for Target Selection and Movement Specification in the Superior Colliculus , 2022 .

[31]  C. Tallon-Baudry,et al.  How Ongoing Fluctuations in Human Visual Cortex Predict Perceptual Awareness: Baseline Shift versus Decision Bias , 2009, The Journal of Neuroscience.

[32]  J. Duncan,et al.  Adaptive Coding of Task-Relevant Information in Human Frontoparietal Cortex , 2011, The Journal of Neuroscience.

[33]  Elisabeth J. Ploran,et al.  Evidence Accumulation and the Moment of Recognition: Dissociating Perceptual Recognition Processes Using fMRI , 2007, The Journal of Neuroscience.

[34]  P. Sajda,et al.  Temporal characterization of the neural correlates of perceptual decision making in the human brain. , 2006, Cerebral cortex.

[35]  R. Passingham,et al.  Reading Hidden Intentions in the Human Brain , 2007, Current Biology.

[36]  J. Gold,et al.  Representation of a perceptual decision in developing oculomotor commands , 2000, Nature.

[37]  Jonathan D. Cohen,et al.  The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. , 2006, Psychological review.

[38]  Andreas Kleinschmidt,et al.  Ongoing Activity Fluctuations in hMT+ Bias the Perception of Coherent Visual Motion , 2008, The Journal of Neuroscience.

[39]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[40]  J. Hirsch,et al.  A Neural Representation of Categorization Uncertainty in the Human Brain , 2006, Neuron.

[41]  Jonathan D. Cohen,et al.  Conflict monitoring and anterior cingulate cortex: an update , 2004, Trends in Cognitive Sciences.

[42]  M. Shadlen,et al.  Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task , 2002, The Journal of Neuroscience.

[43]  Geoffrey M Boynton,et al.  The Representation of Behavioral Choice for Motion in Human Visual Cortex , 2007, The Journal of Neuroscience.

[44]  E Salinas,et al.  Conversion of Sensory Signals into Motor Commands in Primary Motor Cortex , 1998, The Journal of Neuroscience.

[45]  Karl J. Friston,et al.  A direct quantitative relationship between the functional properties of human and macaque V5 , 2000, Nature Neuroscience.

[46]  B. Cumming,et al.  Decision-related activity in sensory neurons reflects more than a neuron’s causal effect , 2009, Nature.

[47]  C. Price The anatomy of language: contributions from functional neuroimaging , 2000, Journal of anatomy.

[48]  A. Watson,et al.  Quest: A Bayesian adaptive psychometric method , 1983, Perception & psychophysics.

[49]  Andreas K. Engel,et al.  Buildup of Choice-Predictive Activity in Human Motor Cortex during Perceptual Decision Making , 2009, Current Biology.

[50]  David J. Freedman,et al.  A proposed common neural mechanism for categorization and perceptual decisions , 2011, Nature Neuroscience.

[51]  Mark W. Greenlee,et al.  Neural correlates of stimulus-invariant decisions about motion in depth , 2010, NeuroImage.

[52]  M. Shadlen,et al.  Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque , 1999, Nature Neuroscience.

[53]  S. Kastner,et al.  Topographic maps in human frontal and parietal cortex , 2009, Trends in Cognitive Sciences.

[54]  J. Kalaska,et al.  Neural Correlates of Reaching Decisions in Dorsal Premotor Cortex: Specification of Multiple Direction Choices and Final Selection of Action , 2005, Neuron.

[55]  D. Apthorp,et al.  The role of motion streaks in human visual motion perception , 2011 .

[56]  Leslie G. Ungerleider,et al.  A general mechanism for perceptual decision-making in the human brain , 2004, Nature.

[57]  Timothy D. Hanks,et al.  Microstimulation of macaque area LIP affects decision-making in a motion discrimination task , 2006, Nature Neuroscience.

[58]  Rainer Goebel,et al.  Information-based functional brain mapping. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[59]  M. Shadlen,et al.  A role for neural integrators in perceptual decision making. , 2003, Cerebral cortex.

[60]  S. Treue Visual attention: the where, what, how and why of saliency , 2003, Current Opinion in Neurobiology.

[61]  Alan C. Evans,et al.  A new anatomical landmark for reliable identification of human area V5/MT: a quantitative analysis of sulcal patterning. , 2000, Cerebral cortex.

[62]  O. Braddick,et al.  Brain Areas Sensitive to Coherent Visual Motion , 2001, Perception.

[63]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[64]  Leslie G. Ungerleider,et al.  Involvement of human left dorsolateral prefrontal cortex in perceptual decision making is independent of response modality , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[65]  J. Dreher,et al.  Decision Threshold Modulation in the Human Brain , 2010, The Journal of Neuroscience.

[66]  Stefan Bode,et al.  Decoding sequential stages of task preparation in the human brain , 2009, NeuroImage.

[67]  J. Culham,et al.  The role of parietal cortex in visuomotor control: What have we learned from neuroimaging? , 2006, Neuropsychologia.

[68]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[69]  Andreas Kleinschmidt,et al.  Spontaneous local variations in ongoing neural activity bias perceptual decisions , 2008, Proceedings of the National Academy of Sciences.

[70]  R. Romo,et al.  Periodicity and Firing Rate As Candidate Neural Codes for the Frequency of Vibrotactile Stimuli , 2000, The Journal of Neuroscience.

[71]  Hakwan Lau,et al.  Prior Expectation Modulates the Interaction between Sensory and Prefrontal Regions in the Human Brain , 2011, The Journal of Neuroscience.

[72]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[73]  Lotfi B Merabet,et al.  Visual Topography of Human Intraparietal Sulcus , 2007, The Journal of Neuroscience.

[74]  S. Zeki Functional organization of a visual area in the posterior bank of the superior temporal sulcus of the rhesus monkey , 1974, The Journal of physiology.

[75]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[76]  E. Spelke,et al.  Sources of mathematical thinking: behavioral and brain-imaging evidence. , 1999, Science.

[77]  Timothy D. Hanks,et al.  Neurobiology of decision making: An intentional framework , 2008 .

[78]  W. Newsome,et al.  Representation of an abstract perceptual decision in macaque superior colliculus. , 2004, Journal of neurophysiology.

[79]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[80]  John Ashburner,et al.  A fast diffeomorphic image registration algorithm , 2007, NeuroImage.