Endogenous controllability of closed-loop brain-machine interfaces for pain

The ultimate aim of closed-loop brain-machine systems for pain is to directly titrate the ongoing level of an intervention to pain-related neural activity. However pain is highly susceptible to endogenous modulation, raising the possibility that active or passive changes in neural activity provoked by the operation of the system could enhance or interfere with the signals upon which it is based. We studied healthy subjects receiving intermittent pain stimuli in a real-time fMRI-based closed-loop feedback-stimulation task. We showed that multi-voxel pattern decoding of pain intensity could be used to train a control algorithm to learn to deliver less painful stimuli (adaptive decoded neurofeedback). However, the system engaged two types of endogenous processes in the brain. First, despite the inherent incentive for subjects to enhance the neural decodability of pain, decodability was either reduced or unchanged in classic pain-processing regions, including insula, dorsolateral prefrontal, and somatosensory cortices. However, increased decodability was observed in a putative pain modulatory region - the pregenual anterior cingulate cortex (pgACC). Second, we found that pain perception itself was modulated by an endogenous computational uncertainty signal engaged as subjects learned the success rate of the system in reducing pain - an effect that also correlated with pgACC responses. The results illustrate how regionally and computationally specific co-adaptive brain-machine learning influences the efficacy of closed-loop systems for pain, and shows that pgACC acts as a key hub in the endogenous controllability of pain.

[1]  J. Farrar,et al.  The dorsal posterior insula subserves a fundamental role in human pain , 2015, Nature Neuroscience.

[2]  T. Robbins,et al.  The control of tonic pain by active relief learning , 2017, bioRxiv.

[3]  Richard J. Davidson,et al.  Individual Differences in the Effects of Perceived Controllability on Pain Perception: Critical Role of the Prefrontal Cortex , 2007, Journal of Cognitive Neuroscience.

[4]  P. Tiňo,et al.  Learning Predictive Statistics: Strategies and Brain Mechanisms , 2017, The Journal of Neuroscience.

[5]  Irene Tracey,et al.  The Cerebral Signature for Pain Perception and Its Modulation , 2007, Neuron.

[6]  P. Dayan,et al.  Serotonin Selectively Modulates Reward Value in Human Decision-Making , 2012, The Journal of Neuroscience.

[7]  Christian Büchel,et al.  Functional dissociation of stimulus intensity encoding and predictive coding of pain in the insula , 2017, eLife.

[8]  A I Basbaum,et al.  Endogenous pain control systems: brainstem spinal pathways and endorphin circuitry. , 1984, Annual review of neuroscience.

[9]  Takeo Watanabe,et al.  Perceptual Learning Incepted by Decoded fMRI Neurofeedback Without Stimulus Presentation , 2011, Science.

[10]  Joachim M. Buhmann,et al.  Decoding the perception of pain from fMRI using multivariate pattern analysis , 2012, NeuroImage.

[11]  Olivia K. Faull,et al.  Connectivity‐based segmentation of the periaqueductal gray matter in human with brainstem optimized diffusion MRI , 2015, Human brain mapping.

[12]  B. Seymour,et al.  Technology for Chronic Pain , 2014, Current Biology.

[13]  Katja Wiech,et al.  Deconstructing the sensation of pain: The influence of cognitive processes on pain perception , 2016, Science.

[14]  Martin A Lindquist,et al.  Quantifying cerebral contributions to pain beyond nociception , 2017, Nature Communications.

[15]  B. Seymour,et al.  Fear reduction without fear through reinforcement of neural activity that bypasses conscious exposure , 2016, Nature Human Behaviour.

[16]  J. O'Doherty,et al.  Is Avoiding an Aversive Outcome Rewarding? Neural Substrates of Avoidance Learning in the Human Brain , 2006, PLoS biology.

[17]  S. Clare,et al.  Imaging how attention modulates pain in humans using functional MRI. , 2002, Brain : a journal of neurology.

[18]  John D E Gabrieli,et al.  Control over brain activation and pain learned by using real-time functional MRI. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[19]  Ravi S. Menon,et al.  Imaging Attentional Modulation of Pain in the Periaqueductal Gray in Humans , 2002, The Journal of Neuroscience.

[20]  Tor D. Wager,et al.  How expectations shape pain , 2012, Neuroscience Letters.

[21]  Florent Meyniel,et al.  Human Inferences about Sequences: A Minimal Transition Probability Model , 2016, bioRxiv.

[22]  S. Debener,et al.  Trial-by-Trial Fluctuations in the Event-Related Electroencephalogram Reflect Dynamic Changes in the Degree of Surprise , 2008, The Journal of Neuroscience.

[23]  Janaina Mourão Miranda,et al.  Quantitative prediction of subjective pain intensity from whole-brain fMRI data using Gaussian processes , 2010, NeuroImage.

[24]  Claudia Plant,et al.  Decoding an individual's sensitivity to pain from the multivariate analysis of EEG data. , 2012, Cerebral cortex.

[25]  M. Lindquist,et al.  An fMRI-based neurologic signature of physical pain. , 2013, The New England journal of medicine.

[26]  A. Craig How do you feel? Interoception: the sense of the physiological condition of the body , 2002, Nature Reviews Neuroscience.

[27]  Hans Knutsson,et al.  Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive rates , 2016, Proceedings of the National Academy of Sciences.

[28]  Rainer Goebel,et al.  Information-based functional brain mapping. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[29]  Till Sprenger,et al.  Distraction modulates connectivity of the cingulo-frontal cortex and the midbrain during pain—an fMRI analysis , 2004, Pain.

[30]  Thomas E. Nichols,et al.  Placebo Effects Mediated by Endogenous Opioid Activity on μ-Opioid Receptors , 2005, The Journal of Neuroscience.

[31]  Prasad Shirvalkar,et al.  Closed-Loop Deep Brain Stimulation for Refractory Chronic Pain , 2018, Front. Comput. Neurosci..

[32]  Anders M. Dale,et al.  An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest , 2006, NeuroImage.

[33]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[34]  Anthony K. P. Jones,et al.  Confidence in beliefs about pain predicts expectancy effects on pain perception and anticipatory processing in right anterior insula , 2008, PAIN.

[35]  C. Büchel,et al.  Mechanisms of placebo analgesia: rACC recruitment of a subcortical antinociceptive network , 2006, Pain.

[36]  C. Büchel,et al.  Activation of the Opioidergic Descending Pain Control System Underlies Placebo Analgesia , 2009, Neuron.

[37]  Martin N. Hebart,et al.  The Decoding Toolbox (TDT): a versatile software package for multivariate analyses of functional imaging data , 2015, Front. Neuroinform..

[38]  Masa-aki Sato,et al.  Sparse estimation automatically selects voxels relevant for the decoding of fMRI activity patterns , 2008, NeuroImage.