Single-trial EEG dissociates motivation and conflict processes during decision-making under risk

ABSTRACT In making decisions under risk (i.e., choosing whether to gamble when the outcome probabilities are known), two aspects of decision are of particular concern. The first, if gambling, is how large are potential gains compared to losses? The subjectively larger, the more rewarding to gamble. Thus, this aspect of decision‐making, quantified through expected utility (EU), is motivation‐related. The second concern is how easy is it to reach the decision? When subjective desirability between gambling and not‐gambling is clearly different from each other (regardless of the direction), it is easier to decide. This aspect, quantified through utility distance (UD), is conflict‐related. It is unclear how the brain simultaneously processes these two aspects of decision‐making. Forty‐five participants decided whether to gamble during electroencephalogram (EEG) recording. To compute trial‐by‐trial variability in EU and UD, we fit participants' choices to models inspired by Expected‐Utility and Prospect theories using hierarchical‐Bayesian modeling. To examine unique influences of EU and UD, we conducted model‐based single‐trial EEG analyses with EU and UD as simultaneous regressors. While both EU and UD were positively associated with P3‐like activity and delta‐band power, the contribution of EU was around 200ms earlier. Thus, during decision‐making under risk, people may allocate their attention to motivation‐related aspects before conflict‐related aspects. Next, following learning the options and before reporting their decision, higher EU was associated with stronger alpha and beta suppression, while higher UD was associated with a stronger contingent‐negativity‐variation‐like activity. This suggests distinct roles of EU and UD on anticipation‐related processes. Overall, we identified time and frequency characteristics of EEG signals that differentially traced motivation‐related and conflict‐related information during decision‐making under risk. HIGHLIGHTSModel‐based EEG teased apart unique influences of motivation & conflict processes.During risky decisions, both were associated with P3‐like and delta‐band activity.The P3‐like/delta activity of motivation processes was around 200ms earlier.Motivation processes involved stronger alpha and beta suppression.Conflict processes involved stronger CNV‐like activity.

[1]  Kait Clark,et al.  Visual search performance is predicted by both prestimulus and poststimulus electrical brain activity , 2016, Scientific Reports.

[2]  Marty G Woldorff,et al.  Timing and Sequence of Brain Activity in Top-Down Control of Visual-Spatial Attention , 2007, PLoS biology.

[3]  R. Nusslock,et al.  Willing to wait: Elevated reward-processing EEG activity associated with a greater preference for larger-but-delayed rewards , 2016, Neuropsychologia.

[4]  Jiqiang Guo,et al.  Stan: A Probabilistic Programming Language. , 2017, Journal of statistical software.

[5]  W. Sharpe.  CAPITAL ASSET PRICES: A THEORY OF MARKET EQUILIBRIUM UNDER CONDITIONS OF RISK* , 1964 .

[6]  C. Brunia,et al.  Motor and non-motor aspects of slow brain potentials , 1994, Biological Psychology.

[7]  S. Kelly,et al.  A supramodal accumulation-to-bound signal that determines perceptual decisions in humans , 2012, Nature Neuroscience.

[8]  Erich Schröger,et al.  Digital filter design for electrophysiological data – a practical approach , 2015, Journal of Neuroscience Methods.

[9]  L. J. Chapman,et al.  The measurement of handedness , 1987, Brain and Cognition.

[10]  M. Lee.  How cognitive modeling can benefit from hierarchical Bayesian models. , 2011 .

[11]  Vince D. Calhoun,et al.  Moving Beyond ERP Components: A Selective Review of Approaches to Integrate EEG and Behavior , 2018, Front. Hum. Neurosci..

[12]  Tobias S. Andersen,et al.  Classification of independent components of EEG into multiple artifact classes. , 2015, Psychophysiology.

[13]  D. Barr,et al.  Random effects structure for confirmatory hypothesis testing: Keep it maximal. , 2013, Journal of memory and language.

[14]  David R. Cox.  The analysis of binary data , 1970 .

[15]  Colin Camerer,et al.  Thinking like a trader selectively reduces individuals' loss aversion , 2009, Proceedings of the National Academy of Sciences.

[16]  Jeffrey L. Birk,et al.  Neural responses to negative feedback are related to negative emotionality in healthy adults. , 2012, Social cognitive and affective neuroscience.

[17]  J. Kissler,et al.  Emotion and attention in visual word processing—An ERP study , 2009, Biological Psychology.

[18]  M. Woldorff,et al.  Utilization of reward-prospect enhances preparatory attention and reduces stimulus conflict , 2014, Cognitive, Affective, & Behavioral Neuroscience.

[19]  Geert J. M. van Boxtel,et al.  Negative Slow Waves as Indices of Anticipation: The Bereitschaftspotential, the Contingent Negative Variation, and the Stimulus-Preceding Negativity , 2011 .

[20]  Timothy J. Pleskac,et al.  Decisions from experience: Why small samples? , 2010, Cognition.

[21]  M. Carrillo-de-la-Peña,et al.  The effect of motivational instructions on P300 amplitude , 2000, Neurophysiologie Clinique/Clinical Neurophysiology.

[22]  W. Walter,et al.  Contingent Negative Variation : An Electric Sign of Sensori-Motor Association and Expectancy in the Human Brain , 1964, Nature.

[23]  Frederick Mosteller,et al.  An Experimental Measurement of Utility , 1951, Journal of Political Economy.

[24]  G. Pourtois,et al.  Independent effects of motivation and spatial attention in the human visual cortex , 2016, Social cognitive and affective neuroscience.

[25]  R. Duncan Luce,et al.  Individual Choice Behavior , 1959 .

[26]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[27]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[28]  Philip A. Gable,et al.  Neural activity underlying motor-action preparation and cognitive narrowing in approach-motivated goal states , 2016, Cognitive, affective & behavioral neuroscience.

[29]  R. Perneta,et al.  Cluster-based computational methods for mass univariate analyses of event-related brain potentials/fields: A simulation study , 2014 .

[30]  A. Tversky,et al.  Loss Aversion in Riskless Choice: A Reference-Dependent Model , 1991 .

[31]  James F. Cavanagh,et al.  Cortical delta activity reflects reward prediction error and related behavioral adjustments, but at different times , 2015, NeuroImage.

[32]  A. Gelman.  Prior distributions for variance parameters in hierarchical models (comment on article by Browne and Draper) , 2004 .

[33]  O. Jensen,et al.  Asymmetric Amplitude Modulations of Brain Oscillations Generate Slow Evoked Responses , 2008, The Journal of Neuroscience.

[34]  R. Nusslock,et al.  Motivated to win: Relationship between anticipatory and outcome reward-related neural activity , 2015, Brain and Cognition.

[35]  E. Basar,et al.  Wavelet analysis of oddball P300. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[36]  Santosh Mathan,et al.  EEG indices of reward motivation and target detectability in a rapid visual detection task , 2013, NeuroImage.

[37]  R. Wilcox.  Introduction to Robust Estimation and Hypothesis Testing , 1997 .

[38]  E. Bernat,et al.  Theta and delta band activity explain N2 and P3 ERP component activity in a go/no-go task , 2014, Clinical Neurophysiology.

[39]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[40]  Markus Ullsperger,et al.  Real and Fictive Outcomes Are Processed Differently but Converge on a Common Adaptive Mechanism , 2013, Neuron.

[41]  A. Tversky,et al.  Advances in prospect theory: Cumulative representation of uncertainty , 1992 .

[42]  Woojae Kim,et al.  A Model-Based fMRI Analysis with Hierarchical Bayesian Parameter Estimation. , 2013, Journal of neuroscience, psychology, and economics.

[43]  E. Weber,et al.  Predicting Risk-Sensitivity in Humans and Lower Animals: Risk as Variance or Coefficient of Variation , 2004, Psychological review.

[44]  Ya Zheng,et al.  Temporal dynamics of reward anticipation in the human brain , 2017, Biological Psychology.

[45]  I. Daum,et al.  It is less than you expected: The feedback-related negativity reflects violations of reward magnitude expectations , 2010, Neuropsychologia.

[46]  S. Kelly,et al.  The classic P300 encodes a build‐to‐threshold decision variable , 2015, The European journal of neuroscience.

[47]  Jonathan R. Folstein,et al.  Influence of cognitive control and mismatch on the N2 component of the ERP: a review. , 2007, Psychophysiology.

[48]  Lei Zhang,et al.  Revealing Neurocomputational Mechanisms of Reinforcement Learning and Decision-Making With the hBayesDM Package , 2016, bioRxiv.

[49]  P. Glimcher,et al.  Title: the Neural Representation of Subjective Value under Risk and Ambiguity 1 2 , 2009 .

[50]  John K. Kruschke,et al.  Doing Bayesian Data Analysis: A Tutorial with R, JAGS, and Stan , 2014 .

[51]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[52]  J. Intriligator,et al.  On the relationship between background EEG and the P300 event-related potential , 1994, Biological Psychology.

[53]  David B. Dunson,et al.  Bayesian Data Analysis , 2010 .

[54]  E. Basar,et al.  Detection of P300 Waves in Single Trials by the Wavelet Transform (WT) , 1999, Brain and Language.

[55]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[56]  J. Cavanagh,et al.  Frontal midline theta reflects anxiety and cognitive control: Meta-analytic evidence , 2015, Journal of Physiology-Paris.

[57]  Joseph W. Kable,et al.  The valuation system: A coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value , 2013, NeuroImage.

[58]  D. Rubin,et al.  Inference from Iterative Simulation Using Multiple Sequences , 1992 .

[59]  Aki Vehtari,et al.  Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC , 2015, Statistics and Computing.

[60]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[61]  Lucas S. Broster,et al.  Beyond valence and magnitude: A flexible evaluative coding system in the brain , 2011, Neuropsychologia.

[62]  Michael X Cohen,et al.  Analyzing Neural Time Series Data: Theory and Practice , 2014 .

[63]  Colin Camerer,et al.  Amygdala damage eliminates monetary loss aversion , 2010, Proceedings of the National Academy of Sciences.

[64]  Durk Talsma,et al.  Attentional orienting across the sensory modalities , 2008, Brain and Cognition.

[65]  Atsushi Sato,et al.  Effects of value and reward magnitude on feedback negativity and P300 , 2005, Neuroreport.

[66]  Samantha J. Broyd,et al.  An electrophysiological monetary incentive delay (e-MID) task: A way to decompose the different components of neural response to positive and negative monetary reinforcement , 2012, Journal of Neuroscience Methods.

[67]  R. Duncan Luce,et al.  Individual Choice Behavior: A Theoretical Analysis , 1979 .

[68]  Kentaro Katahira,et al.  How hierarchical models improve point estimates of model parameters at the individual level , 2016 .

[69]  D B Lindsley,et al.  Brain wave components of the contingent negative variation in humans. , 1976, Science.

[70]  R. Poldrack,et al.  Prospect theory on the brain? Toward a cognitive neuroscience of decision under risk. , 2005, Brain research. Cognitive brain research.

[71]  Tadeusz W Kononowicz,et al.  The contingent negative variation (CNV): timing isn’t everything , 2016, Current Opinion in Behavioral Sciences.

[72]  Sabrina M. Tom,et al.  The Neural Basis of Loss Aversion in Decision-Making Under Risk , 2007, Science.

[73]  Greg Hajcak,et al.  Error-related negativities elicited by monetary loss and cues that predict loss , 2007, Neuroreport.

[74]  Heather L. Urry,et al.  Uninstructed emotion regulation choice in four studies of cognitive reappraisal. , 2015, Personality and individual differences.

[75]  D. Bernoulli.  Exposition of a New Theory on the Measurement of Risk , 1954 .

[76]  Matthew W. Miller,et al.  The effects of reward magnitude on reward processing: An averaged and single trial event-related potential study , 2016, Biological Psychology.

[77]  J. Polich.  Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[78]  Colin F Camerer,et al.  Emotion regulation reduces loss aversion and decreases amygdala responses to losses. , 2013, Social cognitive and affective neuroscience.

[79]  D. Foti,et al.  Teasing apart the anticipatory and consummatory processing of monetary incentives: An event-related potential study of reward dynamics. , 2015, Psychophysiology.

[80]  Rita Z. Goldstein,et al.  The effect of graded monetary reward on cognitive event-related potentials and behavior in young healthy adults. , 2006, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[81]  T. Robbins,et al.  Counterfactual Processing of Economic Action-Outcome Alternatives in Obsessive-Compulsive Disorder: Further Evidence of Impaired Goal-Directed Behavior , 2014, Biological Psychiatry.

[82]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[83]  M. Frank,et al.  Frontal theta as a mechanism for cognitive control , 2014, Trends in Cognitive Sciences.

[84]  Student.  BELIEF IN THE LAW OF SMALL NUMBERS , 1994 .

[85]  S. Luck.  An Introduction to the Event-Related Potential Technique , 2005 .

[86]  M. Junghöfer,et al.  Emotion and attention: event-related brain potential studies. , 2006, Progress in brain research.

[87]  Narun Pornpattananangkul,et al.  Beyond the FRN: Broadening the time-course of EEG and ERP components implicated in reward processing. , 2018, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[88]  P. Finn,et al.  P300 from men with a family history of alcoholism under different incentive conditions. , 1997, Journal of studies on alcohol.

[89]  Kyungmin Su,et al.  The PREP pipeline: standardized preprocessing for large-scale EEG analysis , 2015, Front. Neuroinform..

[90]  Florent Meyniel,et al.  Better Get Back to Work: A Role for Motor Beta Desynchronization in Incentive Motivation , 2014, The Journal of Neuroscience.

[91]  Caroline Di Bernardi Luft,et al.  Learning from feedback: The neural mechanisms of feedback processing facilitating better performance , 2014, Behavioural Brain Research.

[92]  Elizabeth A. Phelps,et al.  Acute stress does not affect risky monetary decision-making , 2016, Neurobiology of Stress.

[93]  P. Gustafson,et al.  Conservative prior distributions for variance parameters in hierarchical models , 2006 .

[94]  J. Polich,et al.  Affective valence, stimulus attributes, and P300: color vs. black/white and normal vs. scrambled images. , 2009, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[95]  H. Fruhstorfer,et al.  Differentiation between slow cortical potentials associated with motor and mental acts in man , 2005, Experimental Brain Research.

[96]  Colin Camerer,et al.  Neuroeconomics: decision making and the brain , 2008 .

[97]  G. Buzsáki.  Rhythms of the brain , 2006 .

[98]  Andrei Ciuparu,et al.  Sources of bias in single‐trial normalization procedures , 2016, The European journal of neuroscience.

[99]  Jonas K. Olofsson,et al.  Affective picture processing: An integrative review of ERP findings , 2008, Biological Psychology.

[100]  R. Hertwig,et al.  Decisions from Experience and the Effect of Rare Events in Risky Choice , 2004, Psychological science.

[101]  M. Frank,et al.  Hypothetical decision making in schizophrenia: The role of expected value computation and “irrational” biases , 2013, Psychiatry Research.

[102]  Guillaume A. Rousselet,et al.  LIMO EEG: A Toolbox for Hierarchical LInear MOdeling of ElectroEncephaloGraphic Data , 2011, Comput. Intell. Neurosci..

[103]  S. Kelly,et al.  Internal and External Influences on the Rate of Sensory Evidence Accumulation in the Human Brain , 2013, The Journal of Neuroscience.

[104]  Mircea Ariel Schoenfeld,et al.  Magneto- and electroencephalographic manifestations of reward anticipation and delivery , 2012, NeuroImage.

[105]  A. Pérez-Villalba.  Rhythms of the Brain, G. Buzsáki. Oxford University Press, Madison Avenue, New York (2006), Price: GB £42.00, p. 448, ISBN: 0-19-530106-4 , 2008 .