Computational and Neural Mechanisms Underlying Decision-Making in Humans

How do we make economic decisions in everyday life? How do we make decisions in the face of uncertainty regarding the statistics of the environment? These are the questions that played a pivotal role in the formation of the field "Decision Neuroscience". In each chapter of this thesis, we investigated the computational and neural mechanisms to tackle these questions using behavioral and neural data acquired through fMRI experiments. In the first chapter, we investigated the computational and neural basis of economic decision-making in a binary choice task between two food items. We analyzed behavioral and neural data in a task where participants conducted a sequence of binary choices under the manipulation of fixation-based attention. We developed and calibrated a computational model based on evidence sampling and accumulation to show that the model not only accurately captured basic properties such as choice and reaction time (RT) but also the effect of attentional manipulation in participants’ behavior. We found that the evidence accumulation process predicted by the model to drive a decision was implemented in the areas of frontoparietal network including dmPFC and IPS. These regions also exhibited increased functional connectivity with the activity in vmPFC during choice period where sampled evidence was represented. Our results suggest the involvement of these areas in value-based binary choice. In the second chapter, we examined the computations involved in the decision making under uncertainty. In particular, we aimed to pin down the computations related to temporal change detection. Temporal change detection is the capacity to detect change in the statistics that govern the timing of occurrence of events. We analyzed behavioral data from a novel task where participants observed a sequence of images presented at irregular timings and tasked to detect a change in the frequency of image presentations. We developed and compared computational models from Bayesian to heuristic models and found that all the models captured quantitative aspects of participants’ behavior equally well despite the difference in their computational complexity. Thus, we could not distinguish computations involved in temporal change detection solely from the behavioral data. In the third chapter, we aimed to elucidate the computations involved in temporal change detection from the perspective of neural implementation using fMRI data by leveraging the computational models examined in the previous chapter. We found that the key variable to guide a decision derived from a computationally frugal heuristic model correlated with the activity of the frontalparietal network including dlPFC and IPS, while similar variables derived from more computationally taxing Bayesian models did not show significant correlation with any of the brain regions. Our results suggest that humans might be relying on a simple heuristic model to implement temporal change detection.

[1]  Colin Camerer,et al.  Transformation of stimulus value signals into motor commands during simple choice , 2011, Proceedings of the National Academy of Sciences.

[2]  Karl J. Friston,et al.  Temporal Difference Models and Reward-Related Learning in the Human Brain , 2003, Neuron.

[3]  M. Shadlen,et al.  Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task , 2002, The Journal of Neuroscience.

[4]  J. Rieskamp,et al.  Deciding When to Decide: Time-Variant Sequential Sampling Models Explain the Emergence of Value-Based Decisions in the Human Brain , 2012, The Journal of Neuroscience.

[5]  Erik Wästlund,et al.  Unsold is unseen … or is it? Examining the role of peripheral vision in the consumer choice process using eye-tracking methodology , 2018, Appetite.

[6]  J. O'Doherty,et al.  Neural Mechanisms Underlying Human Consensus Decision-Making , 2015, Neuron.

[7]  Robert C. Wilson,et al.  Rational regulation of learning dynamics by pupil–linked arousal systems , 2012, Nature Neuroscience.

[8]  Shinsuke Shimojo,et al.  Neural Computations Underlying Arbitration between Model-Based and Model-free Learning , 2013, Neuron.

[9]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[10]  Peter Bossaerts,et al.  Neural correlates of mentalizing-related computations during strategic interactions in humans , 2008, Proceedings of the National Academy of Sciences.

[11]  Hongkeun Kim Involvement of the dorsal and ventral attention networks in oddball stimulus processing: A meta‐analysis , 2014, Human brain mapping.

[12]  Christopher Summerfield,et al.  Building Bridges between Perceptual and Economic Decision-Making: Neural and Computational Mechanisms , 2012, Front. Neurosci..

[13]  P. Dayan,et al.  Cortical substrates for exploratory decisions in humans , 2006, Nature.

[14]  Leslie G. Ungerleider,et al.  A general mechanism for perceptual decision-making in the human brain , 2004, Nature.

[15]  Klaus Wunderlich,et al.  Neural computations underlying action-based decision making in the human brain , 2009, Proceedings of the National Academy of Sciences.

[16]  A. Rangel,et al.  Biasing simple choices by manipulating relative visual attention , 2008, Judgment and Decision Making.

[17]  Timothy E. J. Behrens,et al.  Learning the value of information in an uncertain world , 2007, Nature Neuroscience.

[18]  Jonathan D. Cohen,et al.  Sequential effects: Superstition or rational behavior? , 2008, NIPS.

[19]  J. O'Doherty,et al.  The Role of the Ventromedial Prefrontal Cortex in Abstract State-Based Inference during Decision Making in Humans , 2006, The Journal of Neuroscience.

[20]  J. O'Doherty,et al.  Behavioral contagion during learning about another agent’s risk-preferences acts on the neural representation of decision-risk , 2016, Proceedings of the National Academy of Sciences.

[21]  A. Rangel,et al.  Informatic parcellation of the network involved in the computation of subjective value. , 2014, Social cognitive and affective neuroscience.

[22]  Jonathan D. Cohen,et al.  The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. , 2006, Psychological review.

[23]  J. O'Doherty,et al.  Insights from the application of computational neuroimaging to social neuroscience , 2013, Current Opinion in Neurobiology.

[24]  J. O'Doherty,et al.  Model‐Based fMRI and Its Application to Reward Learning and Decision Making , 2007, Annals of the New York Academy of Sciences.

[25]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[26]  S. Jbabdi,et al.  How can a Bayesian approach inform neuroscience? , 2012, The European journal of neuroscience.

[27]  Ryan P. Adams,et al.  Bayesian Online Changepoint Detection , 2007, 0710.3742.

[28]  Timothy E. J. Behrens,et al.  Perceptual Classification in a Rapidly Changing Environment , 2011, Neuron.

[29]  Leslie G. Ungerleider,et al.  The neural systems that mediate human perceptual decision making , 2008, Nature Reviews Neuroscience.

[30]  Robert C. Wilson,et al.  An Approximately Bayesian Delta-Rule Model Explains the Dynamics of Belief Updating in a Changing Environment , 2010, The Journal of Neuroscience.

[31]  Wolfgang M. Pauli,et al.  Learning, Reward, and Decision Making , 2017, Annual review of psychology.

[32]  J. Gläscher,et al.  Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making. , 2009, Cerebral cortex.

[33]  R. Dolan,et al.  Confidence in value-based choice , 2012, Nature Neuroscience.

[34]  M. A. Pisauro,et al.  Neural correlates of evidence accumulation during value-based decisions revealed via simultaneous EEG-fMRI , 2017, Nature Communications.

[35]  Roger Ratcliff,et al.  The Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks , 2008, Neural Computation.

[36]  Michael N. Shadlen,et al.  Temporal context calibrates interval timing , 2010, Nature Neuroscience.

[37]  Ian Krajbich,et al.  Visual fixations and the computation and comparison of value in simple choice , 2010, Nature Neuroscience.

[38]  Jan Gläscher,et al.  Visualization of Group Inference Data in Functional Neuroimaging , 2009, Neuroinformatics.

[39]  Joshua I. Gold,et al.  Bayesian Online Learning of the Hazard Rate in Change-Point Problems , 2010, Neural Computation.

[40]  C. Koch,et al.  Simultaneous modeling of visual saliency and value computation improves predictions of economic choice , 2013, Proceedings of the National Academy of Sciences.

[41]  R. Ratcliff,et al.  Sequential Sampling Models in Cognitive Neuroscience: Advantages, Applications, and Extensions. , 2016, Annual review of psychology.

[42]  R. Bogacz Optimal decision-making theories: linking neurobiology with behaviour , 2007, Trends in Cognitive Sciences.

[43]  T. Robbins,et al.  Defining the Neural Mechanisms of Probabilistic Reversal Learning Using Event-Related Functional Magnetic Resonance Imaging , 2002, The Journal of Neuroscience.

[44]  Peter N. C. Mohr,et al.  Genetic variation in dopaminergic neuromodulation influences the ability to rapidly and flexibly adapt decisions , 2009, Proceedings of the National Academy of Sciences.

[45]  L. Hunt,et al.  A mechanism for value-guided choice based on the excitation-inhibition balance in prefrontal cortex , 2012, Nature Neuroscience.

[46]  Daniel C. McNamee,et al.  Category-dependent and category-independent goal-value codes in human ventromedial prefrontal cortex , 2013, Nature Neuroscience.

[47]  M. Grueschow,et al.  The precision of value-based choices depends causally on fronto-parietal phase coupling , 2015, Nature Communications.

[48]  Christian C. Ruff,et al.  Neural Oscillations and Synchronization Differentially Support Evidence Accumulation in Perceptual and Value-Based Decision Making , 2014, Neuron.

[49]  Colin Camerer,et al.  In the Mind of the Market: Theory of Mind Biases Value Computation during Financial Bubbles , 2013, Neuron.

[50]  Peter Bossaerts,et al.  The Neural Representation of Unexpected Uncertainty during Value-Based Decision Making , 2013, Neuron.

[51]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[52]  Leslie G. Ungerleider,et al.  Involvement of human left dorsolateral prefrontal cortex in perceptual decision making is independent of response modality , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[53]  Joseph T. McGuire,et al.  Functionally Dissociable Influences on Learning Rate in a Dynamic Environment , 2014, Neuron.

[54]  Jean-Luc Anton,et al.  Region of interest analysis using an SPM toolbox , 2010 .

[55]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[56]  J. O'Doherty,et al.  Uncovering the spatio-temporal dynamics of value-based decision-making in the human brain: a combined fMRI–EEG study , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[57]  A. Rangel,et al.  Multialternative drift-diffusion model predicts the relationship between visual fixations and choice in value-based decisions , 2011, Proceedings of the National Academy of Sciences.

[58]  Antonio Rangel,et al.  The Decision Value Computations in the vmPFC and Striatum Use a Relative Value Code That is Guided by Visual Attention , 2011, The Journal of Neuroscience.

[59]  R Turner,et al.  Optimized EPI for fMRI studies of the orbitofrontal cortex , 2003, NeuroImage.

[60]  Angela J. Yu,et al.  Uncertainty, Neuromodulation, and Attention , 2005, Neuron.