Decoded fMRI neurofeedback can induce bidirectional confidence changes within single participants

ABSTRACT Neurofeedback studies using real‐time functional magnetic resonance imaging (rt‐fMRI) have recently incorporated the multi‐voxel pattern decoding approach, allowing for fMRI to serve as a tool to manipulate fine‐grained neural activity embedded in voxel patterns. Because of its tremendous potential for clinical applications, certain questions regarding decoded neurofeedback (DecNef) must be addressed. Specifically, can the same participants learn to induce neural patterns in opposite directions in different sessions? If so, how does previous learning affect subsequent induction effectiveness? These questions are critical because neurofeedback effects can last for months, but the short‐ to mid‐term dynamics of such effects are unknown. Here we employed a within‐subjects design, where participants underwent two DecNef training sessions to induce behavioural changes of opposing directionality (up or down regulation of perceptual confidence in a visual discrimination task), with the order of training counterbalanced across participants. Behavioral results indicated that the manipulation was strongly influenced by the order and the directionality of neurofeedback training. We applied nonlinear mathematical modeling to parametrize four main consequences of DecNef: main effect of change in confidence, strength of down‐regulation of confidence relative to up‐regulation, maintenance of learning effects, and anterograde learning interference. Modeling results revealed that DecNef successfully induced bidirectional confidence changes in different sessions within single participants. Furthermore, the effect of up‐ compared to down‐regulation was more prominent, and confidence changes (regardless of the direction) were largely preserved even after a week‐long interval. Lastly, the effect of the second session was markedly diminished as compared to the effect of the first session, indicating strong anterograde learning interference. These results are interpreted in the framework of reinforcement learning and provide important implications for its application to basic neuroscience, to occupational and sports training, and to therapy. HighlightsfMRI decoded neurofeedback induced bidirectional confidence changes within‐subjects.Nonlinear equation modeling revealed both changes were statistically significant.Neurofeedback effects were largely preserved (85%) after a one‐week delay.Anterograde learning interference reduced session two neurofeedback effects by 80%.Results have strong implications for both basic science and clinical applications.

[1]  R. Christopher,et al.  Applications of real-time fMRI , 2008 .

[2]  G. McCarthy,et al.  Decisions under Uncertainty: Probabilistic Context Influences Activation of Prefrontal and Parietal Cortices , 2005, The Journal of Neuroscience.

[3]  Niels Birbaumer,et al.  Real-time functional MRI neurofeedback: a tool for psychiatry , 2014, Current opinion in psychiatry.

[4]  Niels Birbaumer,et al.  Using real-time fMRI to learn voluntary regulation of the anterior insula in the presence of threat-related stimuli. , 2012, Social cognitive and affective neuroscience.

[5]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[6]  Maurizio Corbetta,et al.  The human brain is intrinsically organized into dynamic, anticorrelated functional networks. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Rafael Malach,et al.  Covert neurofeedback without awareness shapes cortical network spontaneous connectivity , 2016, Proceedings of the National Academy of Sciences.

[8]  J. Krakauer,et al.  Adaptation to Visuomotor Transformations: Consolidation, Interference, and Forgetting , 2005, The Journal of Neuroscience.

[9]  Takeo Watanabe,et al.  Differential Activation Patterns in the Same Brain Region Led to Opposite Emotional States , 2016, PLoS biology.

[10]  S. Hallerb,et al.  Real-time fMRI neurofeedback : progress and challenges , 2017 .

[11]  Xiaoping P. Hu,et al.  Real‐time fMRI using brain‐state classification , 2007, Human brain mapping.

[12]  M. Chun,et al.  A neuromarker of sustained attention from whole-brain functional connectivity , 2015, Nature Neuroscience.

[13]  S. W. Rieger,et al.  Learning Control Over Emotion Networks Through Connectivity‐Based Neurofeedback , 2015, Cerebral cortex.

[14]  R. Dolan,et al.  Confidence in value-based choice , 2012, Nature Neuroscience.

[15]  Gary H. Glover,et al.  Learned regulation of spatially localized brain activation using real-time fMRI , 2004, NeuroImage.

[16]  H. Lau,et al.  Attention induces conservative subjective biases in visual perception , 2011, Nature Neuroscience.

[17]  Michael S. Pratte,et al.  Decoding patterns of human brain activity. , 2012, Annual review of psychology.

[18]  Geraint Rees,et al.  Relating Introspective Accuracy to Individual Differences in Brain Structure , 2010, Science.

[19]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[20]  Hatim A. Zariwala,et al.  Neural correlates, computation and behavioural impact of decision confidence , 2008, Nature.

[21]  J. O'Doherty,et al.  Direct Instrumental Conditioning of Neural Activity Using Functional Magnetic Resonance Imaging-Derived Reward Feedback , 2007, The Journal of Neuroscience.

[22]  Masa-aki Sato,et al.  Sparse estimation automatically selects voxels relevant for the decoding of fMRI activity patterns , 2008, NeuroImage.

[23]  Jarrod A. Lewis-Peacock,et al.  Closed-loop brain training: the science of neurofeedback , 2017, Nature Reviews Neuroscience.

[24]  Han Yuan,et al.  Resting-State Functional Connectivity Modulation and Sustained Changes After Real-Time Functional Magnetic Resonance Imaging Neurofeedback Training in Depression , 2014, Brain Connect..

[25]  Dimitri Van De Ville,et al.  Connectivity-based neurofeedback: Dynamic causal modeling for real-time fMRI☆ , 2013, Neuroimage.

[26]  M. Shadlen,et al.  Representation of Confidence Associated with a Decision by Neurons in the Parietal Cortex , 2009, Science.

[27]  N. Birbaumer,et al.  Learned regulation of brain metabolism , 2013, Trends in Cognitive Sciences.

[28]  Jonathan D. Cohen,et al.  Closed-loop training of attention with real-time brain imaging , 2015, Nature Neuroscience.

[29]  Wolfgang Grodd,et al.  Principles of a brain-computer interface (BCI) based on real-time functional magnetic resonance imaging (fMRI) , 2004, IEEE Transactions on Biomedical Engineering.

[30]  Anders M. Dale,et al.  Automatic parcellation of human cortical gyri and sulci using standard anatomical nomenclature , 2010, NeuroImage.

[31]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[32]  David R. Anderson,et al.  Model selection and multimodel inference : a practical information-theoretic approach , 2003 .

[33]  K. Deisseroth.  Optogenetics: 10 years of microbial opsins in neuroscience , 2015, Nature Neuroscience.

[34]  Takeo Watanabe,et al.  Perceptual learning incepted by decoded fMRI neurofeedback without stimulus presentation , 2012 .

[35]  John W. Krakauer,et al.  Independent learning of internal models for kinematic and dynamic control of reaching , 1999, Nature Neuroscience.

[36]  M. Kawato,et al.  Multivoxel neurofeedback selectively modulates confidence without changing perceptual performance , 2016, Nature Communications.

[37]  Tony Ro,et al.  Action-Specific Disruption of Perceptual Confidence , 2015, Psychological science.

[38]  Barbara F. Händel,et al.  Cortical representations of confidence in a visual perceptual decision , 2014, Nature Communications.

[39]  Gary C. Sing,et al.  Reduction in Learning Rates Associated with Anterograde Interference Results from Interactions between Different Timescales in Motor Adaptation , 2010, PLoS Comput. Biol..

[40]  Takeo Watanabe,et al.  Interference and feature specificity in visual perceptual learning , 2009, Vision Research.

[41]  R. Passingham,et al.  Theta-burst transcranial magnetic stimulation to the prefrontal cortex impairs metacognitive visual awareness , 2010 .

[42]  Daniel M Wolpert,et al.  Kinematics and Dynamics Are Not Represented Independently in Motor Working Memory: Evidence from an Interference Study , 2002, The Journal of Neuroscience.

[43]  Á. Pascual-Leone,et al.  Noninvasive human brain stimulation. , 2007, Annual review of biomedical engineering.

[44]  D. Wolpert,et al.  Failure to Consolidate the Consolidation Theory of Learning for Sensorimotor Adaptation Tasks , 2004, The Journal of Neuroscience.

[45]  Geraint Rees,et al.  Connectivity Changes Underlying Neurofeedback Training of Visual Cortex Activity , 2014, PloS one.

[46]  E. Bizzi,et al.  Consolidation in human motor memory , 1996, Nature.

[47]  M. Kawato,et al.  Functional MRI neurofeedback training on connectivity between two regions induces long-lasting changes in intrinsic functional network , 2015, Front. Hum. Neurosci..

[48]  R T Constable,et al.  Orbitofrontal cortex neurofeedback produces lasting changes in contamination anxiety and resting-state connectivity , 2013, Translational Psychiatry.

[49]  Satoshi Hirose,et al.  An empirical solution for over-pruning with a novel ensemble-learning method for fMRI decoding , 2015, Journal of Neuroscience Methods.

[50]  M. Kawato,et al.  Random presentation enables subjects to adapt to two opposing forces on the hand , 2004, Nature Neuroscience.

[51]  M. D’Esposito,et al.  Causal evidence for frontal cortex organization for perceptual decision making , 2016, Proceedings of the National Academy of Sciences.

[52]  Stephen LaConte,et al.  Decoding fMRI brain states in real-time , 2011, NeuroImage.

[53]  Aaron C. Koralek,et al.  Corticostriatal plasticity is necessary for learning intentional neuroprosthetic skills , 2012, Nature.

[54]  Ingrid R. Olson,et al.  Dissociation Between Memory Accuracy and Memory Confidence Following Bilateral Parietal Lesions , 2009, Cerebral cortex.

[55]  Todd W. Thompson,et al.  When the brain is prepared to learn: Enhancing human learning using real-time fMRI , 2011, NeuroImage.

[56]  Michael Erb,et al.  Physiological self-regulation of regional brain activity using real-time functional magnetic resonance imaging (fMRI): methodology and exemplary data , 2003, NeuroImage.

[57]  Michael N. Shadlen,et al.  Effects of Cortical Microstimulation on Confidence in a Perceptual Decision , 2014, Neuron.

[58]  H. Akaike.  A new look at the statistical model identification , 1974 .

[59]  Simon W. Bock,et al.  Manipulating motor performance and memory through real-time fMRI neurofeedback , 2015, Biological Psychology.

[60]  R. Dolan,et al.  Subliminal Instrumental Conditioning Demonstrated in the Human Brain , 2008, Neuron.

[61]  Takeo Watanabe,et al.  Learning to Associate Orientation with Color in Early Visual Areas by Associative Decoded fMRI Neurofeedback , 2016, Current Biology.

[62]  S. Bressler,et al.  Large-scale brain networks in cognition: emerging methods and principles , 2010, Trends in Cognitive Sciences.

[63]  Mitsuo Kawato,et al.  Task-specific disruption of perceptual learning. , 2005 .

[64]  A. Koulakov,et al.  Orbitofrontal Cortex Is Required for Optimal Waiting Based on Decision Confidence , 2014, Neuron.

[65]  R. Miall,et al.  Adaptation to rotated visual feedback: a re-examination of motor interference , 2003, Experimental Brain Research.