On the evolution of neural decisions from uncertain visual input to uncertain actions

Behavior can be conceived as the result of a sequence in which the outcomes of perceptual decisions inform decisions on which action to take. However, the relationship between these processes, and spatiotemporal dynamics of the visual-to-motor transformation remains unclear. Here, we combined accumulation-to-threshold models and electro-magnetoencephalography, to trace neural correlates of sensorimotor decisions in space, time and frequency. We challenge the assumption of sequential decisions, with evidence that visuomotor processing unfolds through a continuous flow of information from sensory to motor regions. Action selection is initiated before regional visual decisions are completed. By linking behavior and physiology through theoretical decision models, we identify simultaneous forward and backward flow of information for visuomotor decisions between sensory and motor regions, in beta and gamma ranges. The model of integrated visuomotor decisions provides a powerful approach to investigate behavioral disorders that impair the ability to use sensory inputs to guide appropriate actions.

[1]  Earl K. Miller,et al.  Laminar recordings in frontal cortex suggest distinct layers for maintenance and control of working memory , 2018, Proceedings of the National Academy of Sciences.

[2]  J. Hirsch,et al.  A Neural Representation of Categorization Uncertainty in the Human Brain , 2006, Neuron.

[3]  J Wolfowitz,et al.  Bayes Solutions of Sequential Decision Problems. , 1949, Proceedings of the National Academy of Sciences of the United States of America.

[4]  M. Shadlen,et al.  Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task , 2002, The Journal of Neuroscience.

[5]  R. Ratcliff,et al.  Neural Representation of Task Difficulty and Decision Making during Perceptual Categorization: A Timing Diagram , 2006, The Journal of Neuroscience.

[6]  A. Engel,et al.  Cortical Network Dynamics of Perceptual Decision-Making in the Human Brain , 2011, Frontiers in Human Neuroscience.

[7]  James L. McClelland On the time relations of mental processes: An examination of systems of processes in cascade. , 1979 .

[8]  Hugo Merchant,et al.  Monkeys Share the Human Ability to Internally Maintain a Temporal Rhythm , 2016, Front. Psychol..

[9]  L. Selen,et al.  Deliberation in the Motor System: Reflex Gains Track Evolving Evidence Leading to a Decision , 2012, The Journal of Neuroscience.

[10]  C. Summerfield,et al.  Rhythmic Fluctuations in Evidence Accumulation during Decision Making in the Human Brain , 2012, Neuron.

[11]  Wolfgang Prinz,et al.  The role of the preSMA and the rostral cingulate zone in internally selected actions , 2007, NeuroImage.

[12]  A. Pouget,et al.  The Cost of Accumulating Evidence in Perceptual Decision Making , 2012, The Journal of Neuroscience.

[13]  James B. Rowe,et al.  Action selection: A race model for selected and non-selected actions distinguishes the contribution of premotor and prefrontal areas , 2010, NeuroImage.

[14]  Julio C. Martinez-Trujillo,et al.  Sharp emergence of feature-selective sustained activity along the dorsal visual pathway , 2014, Nature Neuroscience.

[15]  G. Ermentrout,et al.  Gamma rhythms and beta rhythms have different synchronization properties. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[16]  Christian C. Ruff,et al.  Neural Oscillations and Synchronization Differentially Support Evidence Accumulation in Perceptual and Value-Based Decision Making , 2014, Neuron.

[17]  Jonathan W. Pillow,et al.  Dissociated functional significance of decision-related activity in the primate dorsal stream , 2016, Nature.

[18]  Il Memming Park,et al.  Encoding and decoding in parietal cortex during sensorimotor decision-making , 2014, Nature Neuroscience.

[19]  Charles D Holmes,et al.  Dissociation of LFP Power and Tuning in the Frontal Cortex during Memory , 2018, The Journal of Neuroscience.

[20]  Raymond J. Dolan,et al.  The anatomy of choice: active inference and agency , 2013, Front. Hum. Neurosci..

[21]  Andrew Heathcote,et al.  Brain and Behavior in Decision-Making , 2014, PLoS Comput. Biol..

[22]  Trevor W Robbins,et al.  Reorganization of cortical oscillatory dynamics underlying disinhibition in frontotemporal dementia , 2018, Brain : a journal of neurology.

[23]  Scott D. Brown,et al.  The simplest complete model of choice response time: Linear ballistic accumulation , 2008, Cognitive Psychology.

[24]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[25]  Timothy E. J. Behrens,et al.  Review Frontal Cortex and Reward-guided Learning and Decision-making Figure 1. Frontal Brain Regions in the Macaque Involved in Reward-guided Learning and Decision-making Finer Grained Anatomical Divisions with Frontal Cortical Systems for Reward-guided Behavior , 2022 .

[26]  Marios G Philiastides,et al.  Human VMPFC encodes early signatures of confidence in perceptual decisions , 2017, bioRxiv.

[27]  William D. Penny,et al.  The Role of Dopamine in Temporal Uncertainty , 2016, Journal of Cognitive Neuroscience.

[28]  Glyn Humphreys,et al.  Mu rhythm desynchronization reveals motoric influences of hand action on object recognition , 2013, Front. Hum. Neurosci..

[29]  S. Crutch,et al.  Looking but Not Seeing , 2016 .

[30]  William E. Allen,et al.  Global Representations of Goal-Directed Behavior in Distinct Cell Types of Mouse Neocortex , 2017, Neuron.

[31]  A. Schnitzler,et al.  Normal and pathological oscillatory communication in the brain , 2005, Nature Reviews Neuroscience.

[32]  Jay A. Hennig,et al.  Signal Multiplexing and Single-Neuron Computations in Lateral Intraparietal Area During Decision-Making , 2013, The Journal of Neuroscience.

[33]  S. Kelly,et al.  A supramodal accumulation-to-bound signal that determines perceptual decisions in humans , 2012, Nature Neuroscience.

[34]  R. Traub,et al.  On the Mechanism of the γ → β Frequency Shift in Neuronal Oscillations Induced in Rat Hippocampal Slices by Tetanic Stimulation , 1999, The Journal of Neuroscience.

[35]  Mark W. Woolrich,et al.  A symmetric multivariate leakage correction for MEG connectomes , 2015, NeuroImage.

[36]  R. Romo,et al.  Beta oscillations in the monkey sensorimotor network reflect somatosensory decision making , 2011, Proceedings of the National Academy of Sciences.

[37]  The timing diagram , 1974 .

[38]  Michael C. Anderson,et al.  Selection and stopping in voluntary action: A meta-analysis and combined fMRI study , 2014, NeuroImage.

[39]  Roger A. Barker,et al.  Different decision deficits impair response inhibition in progressive supranuclear palsy and Parkinson’s disease , 2015, Brain : a journal of neurology.

[40]  Karl J. Friston,et al.  Bayesian model selection for group studies , 2009, NeuroImage.

[41]  P. Sajda,et al.  EEG-Informed fMRI Reveals Spatiotemporal Characteristics of Perceptual Decision Making , 2007, The Journal of Neuroscience.

[42]  Xiao-Jing Wang,et al.  Probabilistic Decision Making by Slow Reverberation in Cortical Circuits , 2002, Neuron.

[43]  A. Woods,et al.  Context Modulates the Contribution of Time and Space in Causal Inference , 2012, Front. Psychology.

[44]  Hong-Wei Xue,et al.  Arabidopsis PROTEASOME REGULATOR1 is required for auxin-mediated suppression of proteasome activity and regulates auxin signalling , 2016, Nature Communications.

[45]  M. Edwards,et al.  Reduced drift rate: a biomarker of impaired information processing in functional movement disorders. , 2019, Brain : a journal of neurology.

[46]  Karl J. Friston,et al.  Not All Predictions Are Equal: “What” and “When” Predictions Modulate Activity in Auditory Cortex through Different Mechanisms , 2018, The Journal of Neuroscience.

[47]  W. Singer,et al.  Neural Synchrony in Brain Disorders: Relevance for Cognitive Dysfunctions and Pathophysiology , 2006, Neuron.

[48]  Bingni W. Brunton,et al.  A low-frequency oscillatory neural signal in humans encodes a developing decision variable , 2013, NeuroImage.

[49]  Holly Rossiter,et al.  Lamina-specific cortical dynamics in human visual and sensorimotor cortices , 2018, eLife.

[50]  M. Manosevitz High-Speed Scanning in Human Memory , .

[51]  Saskia Haegens,et al.  Beta oscillations reflect supramodal information during perceptual judgment , 2017, Proceedings of the National Academy of Sciences.

[52]  M N Shadlen,et al.  Motion perception: seeing and deciding. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[53]  Karl J. Friston,et al.  Reflections on agranular architecture: predictive coding in the motor cortex , 2013, Trends in Neurosciences.

[54]  David J. Freedman,et al.  An Integrative Framework for Sensory, Motor, and Cognitive Functions of the Posterior Parietal Cortex , 2018, Neuron.

[55]  Mark D. Humphries,et al.  A probabilistic, distributed, recursive mechanism for decision-making in the brain , 2018, PLoS Comput. Biol..

[56]  Timothy D. Hanks,et al.  Bounded Integration in Parietal Cortex Underlies Decisions Even When Viewing Duration Is Dictated by the Environment , 2008, The Journal of Neuroscience.

[57]  R. Ratcliff,et al.  Sequential Sampling Models in Cognitive Neuroscience: Advantages, Applications, and Extensions. , 2016, Annual review of psychology.

[58]  James B. Rowe,et al.  Selection and inhibition mechanisms for human voluntary action decisions , 2012, NeuroImage.

[59]  David J. Freedman,et al.  Where Are Perceptual Decisions Made in the Brain? , 2016, Trends in Neurosciences.

[60]  Karl J. Friston,et al.  MEG and EEG data fusion: Simultaneous localisation of face-evoked responses , 2009, NeuroImage.

[61]  C. Stam,et al.  Direction of information flow in large-scale resting-state networks is frequency-dependent , 2016, Proceedings of the National Academy of Sciences.

[62]  Stewart Shipp,et al.  Neural Elements for Predictive Coding , 2016, Front. Psychol..

[63]  Bijan Pesaran,et al.  Free choice activates a decision circuit between frontal and parietal cortex , 2008, Nature.

[64]  P. Fries Rhythms for Cognition: Communication through Coherence , 2015, Neuron.

[65]  Andreas K. Engel,et al.  Buildup of Choice-Predictive Activity in Human Motor Cortex during Perceptual Decision Making , 2009, Current Biology.

[66]  David J. Freedman,et al.  A proposed common neural mechanism for categorization and perceptual decisions , 2011, Nature Neuroscience.

[67]  Christian Klaes,et al.  Choosing Goals, Not Rules: Deciding among Rule-Based Action Plans , 2011, Neuron.

[68]  R. Desimone,et al.  Laminar differences in gamma and alpha coherence in the ventral stream , 2011, Proceedings of the National Academy of Sciences.

[69]  A. Nobre,et al.  Effects of Decision Variables and Intraparietal Stimulation on Sensorimotor Oscillatory Activity in the Human Brain , 2012, The Journal of Neuroscience.

[70]  M. Whittington,et al.  Gamma and beta frequency oscillations in response to novel auditory stimuli: A comparison of human electroencephalogram (EEG) data with in vitro models. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[71]  M. Siegel,et al.  Motor cortex activity predicts response alternation during sensorimotor decisions , 2016, Nature Communications.

[72]  Saskia Haegens,et al.  Beyond the Status Quo: A Role for Beta Oscillations in Endogenous Content (Re)Activation , 2017, eNeuro.

[73]  J. L. de la Pompa,et al.  A novel source of arterial valve cells linked to bicuspid aortic valve without raphe in mice , 2018, eLife.

[74]  J. Kalaska,et al.  Neural mechanisms for interacting with a world full of action choices. , 2010, Annual review of neuroscience.

[75]  Robert Oostenveld,et al.  Population activity in the human dorsal pathway predicts the accuracy of visual motion detection. , 2007, Journal of neurophysiology.

[76]  Jiaxiang Zhang,et al.  The Effects of Evidence Bounds on Decision-Making: Theoretical and Empirical Developments , 2012, Front. Psychology.

[77]  T. R. Jordan,et al.  Perception and action in 'visual form agnosia'. , 1991, Brain : a journal of neurology.

[78]  Karl J. Friston,et al.  Canonical Microcircuits for Predictive Coding , 2012, Neuron.

[79]  Jonathan D. Cohen,et al.  Anterior Cingulate Conflict Monitoring and Adjustments in Control , 2004, Science.

[80]  Anne K. Churchland,et al.  Perceptual Decision-Making: A Field in the Midst of a Transformation , 2018, Neuron.

[81]  D. Wolpert,et al.  Changing your mind: a computational mechanism of vacillation , 2009, Nature.

[82]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[83]  Karl J. Friston Active inference and agency , 2014, Cognitive neuroscience.

[84]  Karl J. Friston,et al.  Statistical parametric mapping for event-related potentials: I. Generic considerations , 2004, NeuroImage.

[85]  Michael D. Rugg,et al.  Cognitive functions of the posterior parietal cortex , 2013, Front. Integr. Neurosci..

[86]  Miles A. Whittington,et al.  New Roles for the Gamma Rhythm: Population Tuning and Preprocessing for the Beta Rhythm , 2004, Journal of Computational Neuroscience.