Post-response βγ power predicts the degree of choice-based learning in internally guided decision-making

Choosing an option increases a person’s preference for that option. This phenomenon, called choice-based learning (CBL), has been investigated separately in the contexts of internally guided decision-making (IDM, e.g., preference judgment), for which no objectively correct answer exists, and externally guided decision making (EDM, e.g., perceptual decision making), for which one objectively correct answer exists. For the present study, we compared decision making of these two types to examine differences of underlying neural processes of CBL. As IDM and EDM tasks, occupation preference judgment and salary judgment were used, respectively. To compare CBL for the two types of decision making, we developed a novel measurement of CBL: decision consistency. When CBL occurs, decision consistency is higher in the last-half trials than in first-half trials. Electroencephalography (EEG) data have demonstrated that the change of decision consistency is positively correlated with the fronto-central beta–gamma power after response in the first-half trials for IDM, but not for EDM. Those results demonstrate for the first time the difference of CBL between IDM and EDM. The fronto-central beta–gamma power is expected to reflect a key process of CBL, specifically for IDM.

[1]  Vivian V. Valentin,et al.  Determining the Neural Substrates of Goal-Directed Learning in the Human Brain , 2007, The Journal of Neuroscience.

[2]  Niall W. Duncan,et al.  Human Neuroscience , 2022 .

[3]  B. Roska,et al.  Cell-Type-Specific Electric Stimulation for Vision Restoration , 2014, Neuron.

[4]  Hideki Ohira,et al.  Self-Knowledge Reduces Conflict by Biasing One of Plural Possible Answers , 2010, Personality & social psychology bulletin.

[5]  J. O'Doherty,et al.  Model‐Based fMRI and Its Application to Reward Learning and Decision Making , 2007, Annals of the New York Academy of Sciences.

[6]  J. O'Doherty,et al.  Is Avoiding an Aversive Outcome Rewarding? Neural Substrates of Avoidance Learning in the Human Brain , 2006, PLoS biology.

[7]  Antao Chen,et al.  Disentangling the impacts of outcome valence and outcome frequency on the post-error slowing , 2015, Scientific Reports.

[8]  Hideaki Kawabata,et al.  I Choose, Therefore I Like: Preference for Faces Induced by Arbitrary Choice , 2013, PloS one.

[9]  David Cucurell,et al.  Human oscillatory activity associated to reward processing in a gambling task , 2008, Neuropsychologia.

[10]  Elliot T. Berkman,et al.  The neural basis of rationalization: cognitive dissonance reduction during decision-making. , 2011, Social cognitive and affective neuroscience.

[11]  E. Goldberg,et al.  Adaptive Decision Making, Ecological Validity, and the Frontal Lobes , 2000, Journal of clinical and experimental neuropsychology.

[12]  François Mauguière,et al.  Brain responses to success and failure: Direct recordings from human cerebral cortex , 2010, Human brain mapping.

[13]  A. Rodríguez-Fornells,et al.  Neuroscience and Biobehavioral Reviews the Role of High-frequency Oscillatory Activity in Reward Processing and Learning , 2022 .

[14]  Hasan Ayaz,et al.  Decision-making conflict and the neural efficiency hypothesis of intelligence: A functional near-infrared spectroscopy investigation , 2015, NeuroImage.

[15]  Shinobu Kitayama,et al.  Neural mechanisms of dissonance: An fMRI investigation of choice justification , 2013, NeuroImage.

[16]  Katja Wiech,et al.  The neural basis of intuitive and counterintuitive moral judgment , 2011, Social cognitive and affective neuroscience.

[17]  N. Logothetis,et al.  Is the frontal lobe involved in conscious perception? , 2014, Front. Psychol..

[18]  A. Morris,et al.  Fast Pairs: A visual word recognition paradigm for measuring entrenchment, top-down effects, and subjective phenomenology , 2008, Consciousness and Cognition.

[19]  J. Gläscher,et al.  Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making. , 2009, Cerebral cortex.

[20]  K. Doya.  Modulators of decision making , 2008, Nature Neuroscience.

[21]  Saori C. Tanaka,et al.  Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops , 2004, Nature Neuroscience.

[22]  Colin Camerer,et al.  A framework for studying the neurobiology of value-based decision making , 2008, Nature Reviews Neuroscience.

[23]  Jane L. Risen,et al.  How choice affects and reflects preferences: revisiting the free-choice paradigm. , 2010, Journal of personality and social psychology.

[24]  Ernest Mas-Herrero,et al.  Beta oscillations and reward processing: Coupling oscillatory activity and hemodynamic responses , 2015, NeuroImage.

[25]  Hasan Ayaz,et al.  In search of integrative processes: basic psychological need satisfaction predicts medial prefrontal activation during decisional conflict. , 2013, Journal of experimental psychology. General.

[26]  J. Brehm.  Postdecision changes in the desirability of alternatives. , 1956, Journal of abnormal psychology.

[27]  Terrence J. Sejnowski,et al.  Enhanced detection of artifacts in EEG data using higher-order statistics and independent component analysis , 2007, NeuroImage.

[28]  Josep Marco-Pallarés,et al.  The role of beta-gamma oscillations in unexpected rewards processing , 2012, NeuroImage.

[29]  J. Grafman,et al.  Human fronto–mesolimbic networks guide decisions about charitable donation , 2006, Proceedings of the National Academy of Sciences.

[30]  Mircea Ariel Schoenfeld,et al.  Magneto- and electroencephalographic manifestations of reward anticipation and delivery , 2012, NeuroImage.

[31]  Andrew D. Engell,et al.  The Neural Bases of Cognitive Conflict and Control in Moral Judgment , 2004, Neuron.

[32]  Elkhonon Goldberg,et al.  Adaptive versus Veridical Decision Making and the Frontal Lobes , 1999, Consciousness and Cognition.

[33]  Yu Bai,et al.  Resting-state EEG power predicts conflict-related brain activity in internally guided but not in externally guided decision-making , 2013, NeuroImage.

[34]  Masato Okada,et al.  Individual differences in heart rate variability are associated with the avoidance of negative emotional events , 2014, Biological Psychology.

[35]  R. Dolan,et al.  Brain, emotion and decision making: the paradigmatic example of regret , 2007, Trends in Cognitive Sciences.

[36]  Yu Bai,et al.  Dual learning processes underlying human decision-making in reversal learning tasks: functional significance and evidence from the model fit to human behavior , 2014, Front. Psychol..

[37]  Sterling C. Johnson,et al.  The Cerebral Response during Subjective Choice with and without Self-reference , 2005, Journal of Cognitive Neuroscience.

[38]  Nikolai Axmacher,et al.  Good Vibrations: Cross-frequency Coupling in the Human Nucleus Accumbens during Reward Processing , 2009, Journal of Cognitive Neuroscience.

[39]  M. Schoenfeld,et al.  Temporal dynamics of reward processing revealed by magnetoencephalography , 2011, Human brain mapping.

[40]  R. Adolphs,et al.  A Causal Role for Posterior Medial Frontal Cortex in Choice-Induced Preference Change , 2015, The Journal of Neuroscience.

[41]  G. Buzsáki,et al.  A 4 Hz Oscillation Adaptively Synchronizes Prefrontal, VTA, and Hippocampal Activities , 2011, Neuron.

[42]  G. Northoff,et al.  Distinction between Externally vs. Internally Guided Decision-Making: Operational Differences, Meta-Analytical Comparisons and Their Theoretical Implications , 2012, Front. Neurosci..

[43]  Benedetto De Martino,et al.  How Choice Reveals and Shapes Expected Hedonic Outcome , 2009, The Journal of Neuroscience.

[44]  James Myers,et al.  Frequency effects in the processing of Chinese inflection , 2006 .

[45]  M. Berger,et al.  High Gamma Power Is Phase-Locked to Theta Oscillations in Human Neocortex , 2006, Science.

[46]  Norihiro Sadato,et al.  Neural correlates of cognitive dissonance and choice-induced preference change , 2010, Proceedings of the National Academy of Sciences.

[47]  J. O'Doherty,et al.  The problem with value , 2014, Neuroscience & Biobehavioral Reviews.

[48]  Carlos Alós-Ferrer,et al.  Choice-Induced Preference Change and the Free-Choice Paradigm: A Clarification , 2012 .

[49]  R. Dolan,et al.  Action and Valence Modulate Choice and Choice-Induced Preference Change , 2015, PloS one.

[50]  Shinobu Kitayama,et al.  How choice modifies preference: Neural correlates of choice justification , 2011, NeuroImage.

[51]  J. V. Wood,et al.  On building, defending, and regulating the self : a psychological perspective , 2005 .

[52]  G. Elliott Wimmer,et al.  Neural Antecedents of the Endowment Effect , 2008, Neuron.

[53]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[54]  Gabriel José Corrê Mograbi.  Neural Basis of Decision-Making and Assessment: Issues on Testability and Philosophical Relevance** , 2011, Mens sana monographs.

[55]  Hideki Ohira,et al.  Valence-separated representation of reward prediction error in feedback-related negativity and positivity , 2015, Neuroreport.

[56]  J. O'Doherty,et al.  Dissociating Valence of Outcome from Behavioral Control in Human Orbital and Ventral Prefrontal Cortices , 2003, The Journal of Neuroscience.

[57]  G. Northoff,et al.  Rest-stimulus interaction in the brain: a review , 2010, Trends in Neurosciences.

[58]  Michael X. Cohen,et al.  Reward expectation modulates feedback-related negativity and EEG spectra , 2007, NeuroImage.

[59]  D Yves von Cramon,et al.  Decision-making and the frontal lobes , 2006, Current opinion in neurology.

[60]  K. Sakai,et al.  Autonomous Mechanism of Internal Choice Estimate Underlies Decision Inertia , 2014, Neuron.

[61]  Anne G E Collins,et al.  A Reinforcement Learning Mechanism Responsible for the Valuation of Free Choice , 2014, Neuron.

[62]  K. Murayama,et al.  Choice-Induced Preference Change in the Free-Choice Paradigm: A Critical Methodological Review , 2013, Front. Psychology.

[63]  Brian R. Tietz,et al.  Deciding Which Way to Go: How Do Insects Alter Movements to Negotiate Barriers? , 2012, Front. Neurosci..

[64]  A free-choice premium in the basal ganglia , 2015, Trends in Cognitive Sciences.

[65]  J. Feingold.  Beta oscillations in frontal cortex and striatum represent post-processing of successful behavior , 2011 .

[66]  Matthew L. Dixon,et al.  The lateral prefrontal cortex and complex value-based learning and decision making , 2014, Neuroscience & Biobehavioral Reviews.