Success and failure of controlling the real‐time functional magnetic resonance imaging neurofeedback signal are reflected in the striatum

Over the last decades, neurofeedback has been applied in variety of research contexts and therapeutic interventions. Despite this extensive use, its neural mechanisms are still under debate. Several scientific advances have suggested that different networks become jointly active during neurofeedback, including regions generally involved in self‐regulation, regions related to the specific mental task driving the neurofeedback and regions generally involved in feedback learning (Sitaram et al., 2017, Nature Reviews Neuroscience, 18, 86).

[1]  T. Verstynen,et al.  Converging Structural and Functional Connectivity of Orbitofrontal, Dorsolateral Prefrontal, and Posterior Parietal Cortex in the Human Striatum , 2014, The Journal of Neuroscience.

[2]  M. Roesch,et al.  Reward Prediction Error Signaling in Posterior Dorsomedial Striatum Is Action Specific , 2012, The Journal of Neuroscience.

[3]  Y. Koush,et al.  Continuous vs. intermittent neurofeedback to regulate auditory cortex activity of tinnitus patients using real-time fMRI - A pilot study , 2017, NeuroImage: Clinical.

[4]  T. Kjaer,et al.  Increased dopamine tone during meditation-induced change of consciousness. , 2002, Brain research. Cognitive brain research.

[5]  Jung Hoon Sul,et al.  Role of Striatum in Updating Values of Chosen Actions , 2009, The Journal of Neuroscience.

[6]  B Hommel,et al.  The cognitive representation of action: Automatic integration of perceived action effects , 1996, Psychological research.

[7]  Adrian M. Owen,et al.  Striatum in stimulus–response learning via feedback and in decision making , 2014, NeuroImage.

[8]  Saori C. Tanaka,et al.  Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops , 2004, Nature Neuroscience.

[9]  Joseph W. Kable,et al.  The valuation system: A coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value , 2013, NeuroImage.

[10]  Ahmed El Hady Closed Loop Neuroscience , 2016 .

[11]  Rainer Goebel,et al.  Neurofeedback: A promising tool for the self-regulation of emotion networks , 2010, NeuroImage.

[12]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[13]  K. Doya,et al.  Representation of Action-Specific Reward Values in the Striatum , 2005, Science.

[14]  David E. J. Linden,et al.  Mental Imagery and Brain Regulation—New Links Between Psychotherapy and Neuroscience , 2019, Front. Psychiatry.

[15]  Joseph J. Paton,et al.  A Scalable Population Code for Time in the Striatum , 2015, Current Biology.

[16]  Rafael Malach,et al.  Covert neurofeedback without awareness shapes cortical network spontaneous connectivity , 2016, Proceedings of the National Academy of Sciences.

[17]  Vivian V. Valentin,et al.  Determining the Neural Substrates of Goal-Directed Learning in the Human Brain , 2007, The Journal of Neuroscience.

[18]  R T Constable,et al.  Orbitofrontal cortex neurofeedback produces lasting changes in contamination anxiety and resting-state connectivity , 2013, Translational Psychiatry.

[19]  M. Woldorff,et al.  Dorsal anterior cingulate cortex resolves conflict from distracting stimuli by boosting attention toward relevant events. , 2004, Cerebral cortex.

[20]  E. Tricomi,et al.  Basal ganglia engagement during feedback processing after a substantial delay , 2013, Cognitive, affective & behavioral neuroscience.

[21]  Dimitri Van De Ville,et al.  Meta-analysis of real-time fMRI neurofeedback studies using individual participant data: How is brain regulation mediated? , 2016, NeuroImage.

[22]  Jerzy Bodurka,et al.  Randomized Clinical Trial of Real-Time fMRI Amygdala Neurofeedback for Major Depressive Disorder: Effects on Symptoms and Autobiographical Memory Recall. , 2017, The American journal of psychiatry.

[23]  E. Fetz Volitional control of neural activity: implications for brain–computer interfaces , 2007, The Journal of physiology.

[24]  A. Schnider,et al.  Neurofeedback training of alpha-band coherence enhances motor performance , 2015, Clinical Neurophysiology.

[25]  J. Kwon,et al.  Unravelling the Intrinsic Functional Organization of the Human Striatum: A Parcellation and Connectivity Study Based on Resting-State fMRI , 2014, PloS one.

[26]  Karl J. Friston,et al.  Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning , 2004, Science.

[27]  Rudolf N. Cardinal,et al.  Neural systems implicated in delayed and probabilistic reinforcement , 2006, Neural Networks.

[28]  E. Davelaar Mechanisms of Neurofeedback: A Computation-theoretic Approach , 2017, Neuroscience.

[29]  D. Heeger,et al.  Linear Systems Analysis of Functional Magnetic Resonance Imaging in Human V1 , 1996, The Journal of Neuroscience.

[30]  Xenophon Papademetris,et al.  More accurate Talairach coordinates for neuroimaging using non-linear registration , 2008, NeuroImage.

[31]  R. DeShon,et al.  Combining effect size estimates in meta-analysis with repeated measures and independent-groups designs. , 2002 .

[32]  K. Doya,et al.  A Neural Correlate of Reward-Based Behavioral Learning in Caudate Nucleus: A Functional Magnetic Resonance Imaging Study of a Stochastic Decision Task , 2004, The Journal of Neuroscience.

[33]  J. Lacroix,et al.  The acquisition of autonomic control through biofeedback: some tests of discrimination theory. , 1981, Psychophysiology.

[34]  Irene Liu,et al.  Improved modulation of rostrolateral prefrontal cortex using real-time fMRI training and meta-cognitive awareness , 2011, NeuroImage.

[35]  Jarrod A. Lewis-Peacock,et al.  Closed-loop brain training: the science of neurofeedback , 2017, Nature Reviews Neuroscience.

[36]  T. Egner,et al.  Emotional processing in anterior cingulate and medial prefrontal cortex , 2011, Trends in Cognitive Sciences.

[37]  R. Goebel,et al.  Real-Time Functional Magnetic Resonance Imaging Neurofeedback for Treatment of Parkinson's Disease , 2011, The Journal of Neuroscience.

[38]  Samuel M. McClure,et al.  Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum , 2003, Neuron.

[39]  B. Balleine,et al.  The Role of the Dorsal Striatum in Reward and Decision-Making , 2007, The Journal of Neuroscience.

[40]  Bart Vanrumste,et al.  Journal of Neuroengineering and Rehabilitation Open Access Review on Solving the Inverse Problem in Eeg Source Analysis , 2022 .

[41]  Bettina Sorger,et al.  fMRI neurofeedback facilitates anxiety regulation in females with spider phobia , 2015, Front. Behav. Neurosci..

[42]  B. Balleine,et al.  A specific role for posterior dorsolateral striatum in human habit learning , 2009, The European journal of neuroscience.

[43]  Wolfgang Grodd,et al.  Regulation of anterior insular cortex activity using real-time fMRI , 2007, NeuroImage.

[44]  Kasper Winther Andersen,et al.  The Crossed Projection to the Striatum in Two Species of Monkey and in Humans: Behavioral and Evolutionary Significance , 2016, Cerebral cortex.

[45]  J. Gross,et al.  The Neural Bases of Emotion Regulation: Reappraisal and Suppression of Negative Emotion , 2008, Biological Psychiatry.

[46]  Bettina Sorger,et al.  When the Brain Takes ‘BOLD’ Steps: Real-Time fMRI Neurofeedback Can Further Enhance the Ability to Gradually Self-regulate Regional Brain Activation , 2016, Neuroscience.

[47]  J. Cohen,et al.  Dissociating the role of the dorsolateral prefrontal and anterior cingulate cortex in cognitive control. , 2000, Science.

[48]  Aribert Rothenberger,et al.  Distinct EEG effects related to neurofeedback training in children with ADHD: a randomized controlled trial. , 2009, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[49]  T. Robbins,et al.  Neurobehavioural mechanisms of reward and motivation , 1996, Current Opinion in Neurobiology.

[50]  Britta K. Hölzel,et al.  The neuroscience of mindfulness meditation , 2015, Nature Reviews Neuroscience.

[51]  Erik D. Reichle,et al.  Meta-awareness, perceptual decoupling and the wandering mind , 2011, Trends in Cognitive Sciences.

[52]  M. Delgado,et al.  Modulation of Caudate Activity by Action Contingency , 2004, Neuron.

[53]  Steve M. Potter,et al.  Closed-loop neuroscience and neuroengineering , 2014, Front. Neural Circuits.

[54]  R. Goebel,et al.  fMRI Neurofeedback Training for Increasing Anterior Cingulate Cortex Activation in Adult Attention Deficit Hyperactivity Disorder. An Exploratory Randomized, Single-Blinded Study , 2017, PloS one.

[55]  B. Balleine,et al.  Calculating Consequences: Brain Systems That Encode the Causal Effects of Actions , 2008, The Journal of Neuroscience.

[56]  E. Tricomi,et al.  Goals and task difficulty expectations modulate striatal responses to feedback , 2014, Cognitive, Affective, & Behavioral Neuroscience.

[57]  N. Birbaumer,et al.  Learned regulation of brain metabolism , 2013, Trends in Cognitive Sciences.

[58]  J. Sawyer,et al.  Information About Migraine Disability Influences Physicians' Perceptions of Illness Severity and Treatment Needs , 2001, Headache.

[59]  P. Montague,et al.  Activity in human ventral striatum locked to errors of reward prediction , 2002, Nature Neuroscience.

[60]  Takeo Watanabe,et al.  Learning to Associate Orientation with Color in Early Visual Areas by Associative Decoded fMRI Neurofeedback , 2016, Current Biology.

[61]  Gary H Glover,et al.  Modulation of subgenual anterior cingulate cortex activity with real‐time neurofeedback , 2011, Human brain mapping.

[62]  M. Kawato,et al.  Functional MRI neurofeedback training on connectivity between two regions induces long-lasting changes in intrinsic functional network , 2015, Front. Hum. Neurosci..

[63]  Olaf Blanke,et al.  Cortical and subcortical mechanisms of brain‐machine interfaces , 2017, Human brain mapping.

[64]  Dimitri Van De Ville,et al.  Dynamic reconfiguration of human brain functional networks through neurofeedback , 2013, NeuroImage.

[65]  N CardinalRudolf Neural systems implicated in delayed and probabilistic reinforcement , 2006 .

[66]  C. Li,et al.  Causal Interactions Within a Frontal-Cingulate-Parietal Network During Cognitive Control: Convergent Evidence from a Multisite-Multitask Investigation. , 2016, Cerebral cortex.

[67]  H. Scheich,et al.  Human striatum is differentially activated by delayed, omitted, and immediate registering feedback , 2012, Front. Hum. Neurosci..

[68]  Nikolaus R. McFarland,et al.  Striatonigrostriatal Pathways in Primates Form an Ascending Spiral from the Shell to the Dorsolateral Striatum , 2000, The Journal of Neuroscience.

[69]  Mitsuo Kawato,et al.  Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops: fMRI examination in stimulus-action-reward association learning , 2006, Neural Networks.

[70]  Benjamin Y. Hayden,et al.  Differential Contributions of Ventral and Dorsal Striatum to Early and Late Phases of Cognitive Set Reconfiguration , 2016, Journal of Cognitive Neuroscience.

[71]  Thomas H. B. FitzGerald,et al.  Reward-Related Activity in Ventral Striatum Is Action Contingent and Modulated by Behavioral Relevance , 2014, The Journal of Neuroscience.

[72]  J. Talairach,et al.  Co-Planar Stereotaxic Atlas of the Human Brain: 3-Dimensional Proportional System: An Approach to Cerebral Imaging , 1988 .