Electrophysiological investigation of reward anticipation and outcome evaluation during slot machine play

Slot machines are a popular form of gambling, offering a tractable way to experimentally model reward processes. This study used a 3-reel slot paradigm to assess psychologically distinct phases of reward processing, reflecting anticipation, and early- and late-stage outcome processing. EEG measures of winning, nearly missing (a losing outcome revealed at the final, third reel), and "totally" missing (a losing outcome revealed earlier, at the second reel) were collected from healthy adults (n=54). Condition effects were evaluated in: i) event-related potential (ERP) components reflecting anticipatory attention (stimulus preceding negativity, SPN) and outcome processing (reward positivity, RewP and late-positive potential, LPP) and ii) total power and phase synchrony of theta and delta band oscillations. Behaviorally, trial initiation was fastest after a near miss outcome and slowest after a winning outcome. As expected, a significant SPN was observed for possible wins (AA) vs. total misses (AB), consistent with reward anticipation. Larger win (AAA) vs. near miss (AAB) amplitudes were observed for the RewP; LPP amplitudes were largest for wins (AAA), intermediate for near misses (AAB), and smallest for total misses (ABC), reflecting significant early (RewP) and late-stage (LPP) outcome processing effects. There was an effect of reel position on the RewP, with larger amplitude in the final reel (AAA-AAB) relative to the 2nd-reel locked difference waves (AA-AB). Across all outcomes, near misses elicited the largest and most phase-synchronized theta responses, while wins elicited larger and more phase-synchronized delta responses than total misses, with near miss delta synchrony not differing from wins or total misses. Phase locking measures contrasting win vs. near miss delta and theta synchronization, within time windows corresponding to ERP measurements, covaried with RewP, but not SPN or LPP, amplitude. Lastly, EEG measures showed differential relationships with age and self-reported consummatory pleasure. In the context of slot machine play, where reward anticipation and attainment place minimal demands on effort and skill, ERP and time-frequency methods capture distinct neurophysiological signatures of reward anticipation and outcome processing.

[1]  Tobias U. Hauser,et al.  The feedback-related negativity (FRN) revisited: New insights into the localization, meaning and network organization , 2014, NeuroImage.

[2]  K. R. Ridderinkhof,et al.  A computational account of altered error processing in older age: Dopamine and the error-related negativity , 2002, Cognitive, affective & behavioral neuroscience.

[3]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[4]  J. Stapleton,et al.  The Effect of Losses Disguised as Wins and Near Misses in Electronic Gaming Machines: A Systematic Review , 2017, Journal of Gambling Studies.

[5]  J. Hewig,et al.  A miss is as good as a mile? Processing of near and full outcomes in a gambling paradigm. , 2014, Psychophysiology.

[6]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[7]  A. Mognon,et al.  ADJUST: An automatic EEG artifact detector based on the joint use of spatial and temporal features. , 2011, Psychophysiology.

[8]  Clay B. Holroyd,et al.  The feedback correct-related positivity: sensitivity of the event-related brain potential to unexpected positive feedback. , 2008, Psychophysiology.

[9]  Sander Nieuwenhuis,et al.  Mediofrontal negativities in the absence of responding. , 2005, Brain research. Cognitive brain research.

[10]  K. Berridge,et al.  Parsing reward , 2003, Trends in Neurosciences.

[11]  Viktor Müller,et al.  Life Span Differences in Electrophysiological Correlates of Monitoring Gains and Losses during Probabilistic Reinforcement Learning , 2011, Journal of Cognitive Neuroscience.

[12]  L. Clark,et al.  Gambling Near-Misses Enhance Motivation to Gamble and Recruit Win-Related Brain Circuitry , 2009, Neuron.

[13]  D. Foti,et al.  Teasing apart the anticipatory and consummatory processing of monetary incentives: An event-related potential study of reward dynamics. , 2015, Psychophysiology.

[14]  R. Nusslock,et al.  Reward processing and mood-related symptoms: An RDoC and translational neuroscience perspective. , 2017, Journal of affective disorders.

[15]  Brian Knutson,et al.  FMRI Visualization of Brain Activity during a Monetary Incentive Delay Task , 2000, NeuroImage.

[16]  Qiuling Luo,et al.  The near-miss effect in slot-machine gambling: modulation of feedback-related negativity by subjective value , 2011, Neuroreport.

[17]  Cody Ding,et al.  Neural correlates of near-misses effect in gambling , 2011, Neuroscience Letters.

[18]  James F. Cavanagh,et al.  Frontal theta links prediction errors to behavioral adaptation in reinforcement learning , 2010, NeuroImage.

[19]  David Cucurell,et al.  Brain oscillatory activity of skill and chance gamblers during a slot machine game , 2019, Cognitive, Affective, & Behavioral Neuroscience.

[20]  Clay B. Holroyd,et al.  The Impact of Deliberative Strategy Dissociates ERP Components Related to Conflict Processing vs. Reinforcement Learning , 2012, Front. Neurosci..

[21]  Naomi S. Kort,et al.  Role of N-Methyl-D-Aspartate Receptors in Action-Based Predictive Coding Deficits in Schizophrenia , 2017, Biological Psychiatry.

[22]  J. Ford,et al.  Deficient auditory predictive coding during vocalization in the psychosis risk syndrome and in early illness schizophrenia: the final expanded sample , 2018, Psychological Medicine.

[23]  Katherine R. Luking,et al.  Mechanisms Underlying Motivational Deficits in Psychopathology: Similarities and Differences in Depression and Schizophrenia. , 2016, Current topics in behavioral neurosciences.

[24]  F. Donkers,et al.  Mediofrontal negativities to averted gains and losses in the slot-machine task : a further investigation , 2005 .

[25]  Zachary P. Infantolino,et al.  Time-Frequency Reward-Related Delta Prospectively Predicts the Development of Adolescent-Onset Depression. , 2018, Biological psychiatry. Cognitive neuroscience and neuroimaging.

[26]  D. Lynam,et al.  Individual differences in the time course of reward processing: Stage-specific links with depression and impulsivity , 2016, Biological Psychology.

[27]  R. L. Reid.  The psychology of the near miss , 1986, Journal of gambling behavior.

[28]  M. Nakayama,et al.  Effects of monetary reward and punishment on stimulus-preceding negativity. , 2006, Psychophysiology.

[29]  Narun Pornpattananangkul,et al.  Beyond the FRN: Broadening the time-course of EEG and ERP components implicated in reward processing. , 2018, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[30]  Mark Griffiths,et al.  Fruit machine gambling: The importance of structural characteristics , 1993, Journal of Gambling Studies.

[31]  Selin Aviyente,et al.  Utilizing time-frequency amplitude and phase synchrony measure to assess feedback processing in a gambling task. , 2018, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[32]  D. Meyer,et al.  A Neural System for Error Detection and Compensation , 1993 .

[33]  Alexander M. Nitsch,et al.  A Single-Trial Estimation of the Feedback-Related Negativity and Its Relation to BOLD Responses in a Time-Estimation Task , 2014, The Journal of Neuroscience.

[34]  C. Brunia,et al.  Wait and see. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[35]  M. Frank,et al.  Frontal theta as a mechanism for cognitive control , 2014, Trends in Cognitive Sciences.

[36]  J. Karvanen,et al.  Trimmed estimators for robust averaging of event-related potentials , 2005, Journal of Neuroscience Methods.

[37]  Hiroaki Masaki,et al.  Affective-motivational influences on feedback-related ERPs in a gambling task , 2006, Brain Research.

[38]  Michael X. Cohen,et al.  Reward expectation modulates feedback-related negativity and EEG spectra , 2007, NeuroImage.

[39]  C. Gonsalvez,et al.  Can event-related potentials serve as neural markers for wins, losses, and near-wins in a gambling task? A principal components analysis. , 2013, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[40]  David Cucurell,et al.  Human oscillatory activity associated to reward processing in a gambling task , 2008, Neuropsychologia.

[41]  Edward M. Bernat,et al.  Alcohol impairs brain reactivity to explicit loss feedback , 2011, Psychopharmacology.

[42]  Adrian R. Willoughby,et al.  The Medial Frontal Cortex and the Rapid Processing of Monetary Gains and Losses , 2002, Science.

[43]  Anthony H. Winefield,et al.  Poker‐machine gambling: An analysis of within session characteristics , 1999 .

[44]  K. Berridge,et al.  Pleasure Systems in the Brain , 2015, Neuron.

[45]  Clay B. Holroyd,et al.  The research domain criteria framework: The case for anterior cingulate cortex , 2016, Neuroscience & Biobehavioral Reviews.

[46]  J. Pernier,et al.  Oscillatory gamma-band (30-70 Hz) activity induced by a visual search task in humans. , 1997, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[47]  S. Makeig,et al.  Mining event-related brain dynamics , 2004, Trends in Cognitive Sciences.

[48]  Matthew S. Tata,et al.  Right frontal cortex generates reward-related theta-band oscillatory activity , 2009, NeuroImage.

[49]  J. Pernier,et al.  Oscillatory γ-Band (30–70 Hz) Activity Induced by a Visual Search Task in Humans , 1997, The Journal of Neuroscience.

[50]  James F. Cavanagh,et al.  Cortical delta activity reflects reward prediction error and related behavioral adjustments, but at different times , 2015, NeuroImage.

[51]  Philip A. Gable,et al.  The sweetness of successful goal pursuit: Approach-motivated pregoal states enhance the reward positivity during goal pursuit. , 2017, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[52]  Lilianne R. Mujica-Parodi,et al.  Ventral striatal and medial prefrontal BOLD activation is correlated with reward-related electrocortical activity: A combined ERP and fMRI study , 2011, NeuroImage.

[53]  O. John,et al.  Anticipatory and consummatory components of the experience of pleasure: A scale development study , 2006 .

[54]  Edward M Bernat,et al.  Time-frequency theta and delta measures index separable components of feedback processing in a gambling task. , 2015, Psychophysiology.

[55]  Mark R Dixon,et al.  Neurobehavioral evidence for the "Near-Miss" effect in pathological gamblers. , 2010, Journal of the experimental analysis of behavior.

[56]  R. B. Reilly,et al.  FASTER: Fully Automated Statistical Thresholding for EEG artifact Rejection , 2010, Journal of Neuroscience Methods.

[57]  A. Amsel.  The role of frustrative nonreward in noncontinuous reward situations. , 1958, Psychological bulletin.

[58]  Jonathan Parke,et al.  The Psychology of the Fruit Machine: The Role of Structural Characteristics (Revisited) , 2006, International Journal of Mental Health and Addiction.

[59]  Jonathan A. Fugelsang,et al.  The Frustrating Effects of Just Missing the Jackpot: Slot Machine Near-Misses Trigger Large Skin Conductance Responses, But No Post-reinforcement Pauses , 2013, Journal of Gambling Studies.

[60]  R. Nusslock,et al.  Motivated to win: Relationship between anticipatory and outcome reward-related neural activity , 2015, Brain and Cognition.

[61]  Greg H. Proudfit.  The reward positivity: from basic research on reward to a biomarker for depression. , 2015, Psychophysiology.

[62]  J. Hohnsbein,et al.  Effects of crossmodal divided attention on late ERP components. II. Error processing in choice reaction tasks. , 1991, Electroencephalography and clinical neurophysiology.

[63]  Benjamin T. Dunkley,et al.  Almost winning: Induced MEG theta power in insula and orbitofrontal cortex increases during gambling near-misses and is associated with BOLD signal and gambling severity , 2014, NeuroImage.

[64]  Edward M Bernat,et al.  Externalizing psychopathology and gain-loss feedback in a simulated gambling task: dissociable components of brain response revealed by time-frequency analysis. , 2011, Journal of abnormal psychology.

[65]  Thomas D. Sambrook,et al.  A neural reward prediction error revealed by a meta-analysis of ERPs using great grand averages. , 2015, Psychological bulletin.

[66]  C. Brunia,et al.  Waiting to perceive: Reward or punishment? , 2011, Clinical Neurophysiology.

[67]  M. Treadway,et al.  Reward processing dysfunction in major depression, bipolar disorder and schizophrenia , 2015, Current opinion in psychiatry.

[68]  John R. Anderson,et al.  Learning from experience: Event-related potential correlates of reward processing, neural adaptation, and behavioral choice , 2012, Neuroscience & Biobehavioral Reviews.

[69]  Hiroshi Nittono,et al.  Motivational significance and cognitive effort elicit different late positive potentials , 2015, Clinical Neurophysiology.

[70]  David Cucurell,et al.  Human oscillatory activity in near-miss events. , 2015, Social cognitive and affective neuroscience.

[71]  Greg Hajcak,et al.  The persistence of attention to emotion: brain potentials during and after picture presentation. , 2008, Emotion.

[72]  Steven J. Luck,et al.  ERPLAB: an open-source toolbox for the analysis of event-related potentials , 2014, Front. Hum. Neurosci..

[73]  M. Bradley,et al.  Emotional perception: correlation of functional MRI and event-related potentials. , 2006, Cerebral cortex.

[74]  M. Coles,et al.  How bad was it? Differences in the time course of sensitivity to the magnitude of loss in problem gamblers and controls , 2013, Behavioural Brain Research.

[75]  G. Hajcak,et al.  Differentiating neural responses to emotional pictures: evidence from temporal-spatial PCA. , 2009, Psychophysiology.

[76]  J. Cavanagh,et al.  Frontal midline theta reflects anxiety and cognitive control: Meta-analytic evidence , 2015, Journal of Physiology-Paris.

[77]  C. Braun,et al.  Event-Related Brain Potentials Following Incorrect Feedback in a Time-Estimation Task: Evidence for a Generic Neural System for Error Detection , 1997, Journal of Cognitive Neuroscience.

[78]  Arne D. Ekstrom,et al.  Expected reward modulates encoding-related theta activity before an event , 2013, NeuroImage.

[79]  Greg H. Proudfit,et al.  Anterior cingulate activity to monetary loss and basal ganglia activity to monetary gain uniquely contribute to the feedback negativity , 2015, Clinical Neurophysiology.

[80]  Clay B. Holroyd,et al.  Feedback information and the reward positivity. , 2017, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[81]  Dan Foti,et al.  Variation in reward- and error-related neural measures attributable to age, gender, race, and ethnicity. , 2017, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.