State-Dependent Decoding Algorithms Improve the Performance of a Bidirectional BMI in Anesthetized Rats

Brain-machine interfaces (BMIs) promise to improve the quality of life of patients suffering from sensory and motor disabilities by creating a direct communication channel between the brain and the external world. Yet, their performance is currently limited by the relatively small amount of information that can be decoded from neural activity recorded form the brain. We have recently proposed that such decoding performance may be improved when using state-dependent decoding algorithms that predict and discount the large component of the trial-to-trial variability of neural activity which is due to the dependence of neural responses on the network's current internal state. Here we tested this idea by using a bidirectional BMI to investigate the gain in performance arising from using a state-dependent decoding algorithm. This BMI, implemented in anesthetized rats, controlled the movement of a dynamical system using neural activity decoded from motor cortex and fed back to the brain the dynamical system's position by electrically microstimulating somatosensory cortex. We found that using state-dependent algorithms that tracked the dynamics of ongoing activity led to an increase in the amount of information extracted form neural activity by 22%, with a consequently increase in all of the indices measuring the BMI's performance in controlling the dynamical system. This suggests that state-dependent decoding algorithms may be used to enhance BMIs at moderate computational cost.

[1]  Leon O. Chua,et al.  Adaptive Neuromorphic Architecture (ANA) , 2013, Neural Networks.

[2]  Nicholas V. Annetta,et al.  Restoring cortical control of functional movement in a human with quadriplegia , 2016, Nature.

[3]  Gian Nicola Angotzi,et al.  A programmable closed-loop recording and stimulating wireless system for behaving small laboratory animals , 2014, Scientific Reports.

[4]  Giacomo Indiveri,et al.  A reconfigurable on-line learning spiking neuromorphic processor comprising 256 neurons and 128K synapses , 2015, Front. Neurosci..

[5]  E. Bizzi,et al.  Linear combinations of primitives in vertebrate motor control. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Mikhail A. Lebedev,et al.  How to read neuron-dropping curves? , 2014, Front. Syst. Neurosci..

[7]  Ankoor S. Shah,et al.  An oscillatory hierarchy controlling neuronal excitability and stimulus processing in the auditory cortex. , 2005, Journal of neurophysiology.

[8]  Qin,et al.  A Brain–Spinal Interface Alleviating Gait Deficits after Spinal Cord Injury in Primates , 2017 .

[9]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[10]  Vincent D Costa,et al.  More than Meets the Eye: the Relationship between Pupil Size and Locus Coeruleus Activity , 2016, Neuron.

[11]  Giacomo Indiveri,et al.  A Bidirectional Brain-Machine Interface Featuring a Neuromorphic Hardware Decoder , 2016, Front. Neurosci..

[12]  L. Pinneo.  On noise in the nervous system. , 1966, Psychological review.

[13]  C. Kayser,et al.  Rhythmic Auditory Cortex Activity at Multiple Timescales Shapes Stimulus–Response Gain and Background Firing , 2015, The Journal of Neuroscience.

[14]  F Cincotti,et al.  Current trends in hardware and software for brain–computer interfaces (BCIs) , 2011, Journal of neural engineering.

[15]  C. R. Rao,et al.  The Utilization of Multiple Measurements in Problems of Biological Classification , 1948 .

[16]  Martin Bogdan,et al.  Real-Time Adaptive Microstimulation Increases Reliability of Electrically Evoked Cortical Potentials , 2011, IEEE Transactions on Biomedical Engineering.

[17]  Ferdinando A. Mussa-Ivaldi,et al.  A bidirectional brain-machine interface connecting alert rodents to a dynamical system , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[18]  K. Harris,et al.  Cortical state and attention , 2011, Nature Reviews Neuroscience.

[19]  N. Logothetis,et al.  From Neurons to Circuits: Linear Estimation of Local Field Potentials , 2009, The Journal of Neuroscience.

[20]  Ricardo M. Neves,et al.  Modeling the effect of locus coeruleus firing on cortical state dynamics and single-trial sensory processing , 2015, Proceedings of the National Academy of Sciences.

[21]  Guglielmo Foffani,et al.  Brain-Machine Interfaces beyond Neuroprosthetics , 2015, Neuron.

[22]  R. Quiroga,et al.  Extracting information from neuronal populations : information theory and decoding approaches , 2022 .

[23]  C. Gray,et al.  Cellular Mechanisms Contributing to Response Variability of Cortical Neurons In Vivo , 1999, The Journal of Neuroscience.

[24]  Petros Boufounos,et al.  A Deep Neural Network Architecture Using Dimensionality Reduction with Sparse Matrices , 2016, ICONIP.

[25]  Hannes Bleuler,et al.  Active tactile exploration enabled by a brain-machine-brain interface , 2011, Nature.

[26]  Rajesh P. N. Rao,et al.  Brain–computer interfaces: a powerful tool for scientific inquiry , 2014, Current Opinion in Neurobiology.

[27]  F. Haiss,et al.  Spatiotemporal Dynamics of Cortical Sensorimotor Integration in Behaving Mice , 2007, Neuron.

[28]  M. Sahani,et al.  State-Dependent Population Coding in Primary Auditory Cortex , 2015, The Journal of Neuroscience.

[29]  Miguel A. L. Nicolelis,et al.  Brain–machine interfaces: past, present and future , 2006, Trends in Neurosciences.

[30]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[31]  Stefano Panzeri,et al.  Space-by-time decomposition for single-trial decoding of M/EEG activity , 2016, NeuroImage.

[32]  Nicolas Brunel,et al.  Sensory neural codes using multiplexed temporal scales , 2010, Trends in Neurosciences.

[33]  Chiara Bartolozzi,et al.  Neuromorphic Electronic Circuits for Building Autonomous Cognitive Systems , 2014, Proceedings of the IEEE.

[34]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[35]  Richard Kempter,et al.  State-dependencies of learning across brain scales , 2015, Front. Comput. Neurosci..

[36]  Peter J. Ifft,et al.  Active tactile exploration enabled by a brain-machine-brain interface , 2011, Nature.

[37]  Richard A. Andersen,et al.  Toward More Versatile and Intuitive Cortical Brain–Machine Interfaces , 2014, Current Biology.

[38]  Stefano Panzeri,et al.  Correcting for the sampling bias problem in spike train information measures. , 2007, Journal of neurophysiology.

[39]  Eero P. Simoncelli,et al.  Attention stabilizes the shared gain of V4 populations , 2015, eLife.

[40]  Ali Khiat,et al.  Real-time encoding and compression of neuronal spikes by metal-oxide memristors , 2016, Nature Communications.

[41]  Marcelo A. Montemurro,et al.  Tight Data-Robust Bounds to Mutual Information Combining Shuffling and Model Selection Techniques , 2007, Neural Computation.

[42]  K. Harris,et al.  A Simple Model of Cortical Dynamics Explains Variability and State Dependence of Sensory Responses in Urethane-Anesthetized Auditory Cortex , 2009, The Journal of Neuroscience.

[43]  Wolfgang Maass,et al.  On the Computational Power of Winner-Take-All , 2000, Neural Computation.

[44]  M. Carandini,et al.  Cortical State Determines Global Variability and Correlations in Visual Cortex , 2015, The Journal of Neuroscience.

[45]  M Lawrence,et al.  Anesthesia and analgesia. , 2000, The Canadian veterinary journal = La revue veterinaire canadienne.

[46]  J. G. Gander,et al.  An introduction to signal detection and estimation , 1990 .

[47]  K. Harris,et al.  State-Dependent Representation of Amplitude-Modulated Noise Stimuli in Rat Auditory Cortex , 2011, The Journal of Neuroscience.

[48]  M. Carandini,et al.  The Nature of Shared Cortical Variability , 2015, Neuron.

[49]  Thomas Lenarz,et al.  Investigation of a New Electrode Array Technology for a Central Auditory Prosthesis , 2013, PloS one.

[50]  Shubhodeep Chakrabarti,et al.  Running Headline: Sensorimotor Integration in MI , 2022 .

[51]  Mikhail A. Lebedev,et al.  Brain-machine interfaces: an overview , 2014 .

[52]  Yuya Ito,et al.  Corrigendum: Mutations in CDCA7 and HELLS cause immunodeficiency–centromeric instability–facial anomalies syndrome , 2016, Nature Communications.

[53]  S. Micera,et al.  Mechanisms Underlying the Neuromodulation of Spinal Circuits for Correcting Gait and Balance Deficits after Spinal Cord Injury , 2016, Neuron.

[54]  Eero P. Simoncelli,et al.  Partitioning neuronal variability , 2014, Nature Neuroscience.

[55]  J. Gold,et al.  Relationships between Pupil Diameter and Neuronal Activity in the Locus Coeruleus, Colliculi, and Cingulate Cortex , 2016, Neuron.

[56]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[57]  L. Miller,et al.  Restoring sensorimotor function through intracortical interfaces: progress and looming challenges , 2014, Nature Reviews Neuroscience.

[58]  Karel Svoboda,et al.  Long-Range Neuronal Circuits Underlying the Interaction between Sensory and Motor Cortex , 2011, Neuron.

[59]  Ferdinando A. Mussa-Ivaldi,et al.  Shaping the Dynamics of a Bidirectional Neural Interface , 2012, PLoS Comput. Biol..

[60]  R. J. Vogelstein,et al.  Restoring the sense of touch with a prosthetic hand through a brain interface , 2013, Proceedings of the National Academy of Sciences.

[61]  G. Schalk,et al.  Evolution of brain-computer interfaces : going beyond classic motor physiology , 2009 .

[62]  Gytis Baranauskas,et al.  What limits the performance of current invasive brain machine interfaces? , 2014, Front. Syst. Neurosci..

[63]  E. Bizzi,et al.  Responses to spinal microstimulation in the chronically spinalized rat and their relationship to spinal systems activated by low threshold cutaneous stimulation , 1999, Experimental Brain Research.

[64]  Stefano Panzeri,et al.  Implications of the Dependence of Neuronal Activity on Neural Network States for the Design of Brain-Machine Interfaces , 2016, Front. Neurosci..

[65]  Stefano Panzeri,et al.  Using Matrix and Tensor Factorizations for the Single-Trial Analysis of Population Spike Trains , 2016, PLoS Comput. Biol..

[66]  R Krahe,et al.  Robustness and variability of neuronal coding by amplitude-sensitive afferents in the weakly electric fish eigenmannia. , 2000, Journal of neurophysiology.

[67]  Ferdinando A. Mussa-Ivaldi,et al.  Dynamic brain-machine interface: A novel paradigm for bidirectional interaction between brains and dynamical systems , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[68]  F A Mussa-Ivaldi,et al.  Computations underlying the execution of movement: a biological perspective. , 1991, Science.

[69]  Alexander S. Ecker,et al.  State Dependence of Noise Correlations in Macaque Primary Visual Cortex , 2014, Neuron.

[70]  Francois D. Szymanski,et al.  A Bidirectional Brain-Machine Interface Algorithm That Approximates Arbitrary Force-Fields , 2014, PloS one.

[71]  Chiara Bartolozzi,et al.  A modular configurable system for closed-loop bidirectional brain-machine interfaces , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[72]  W. Maass,et al.  State-dependent computations: spatiotemporal processing in cortical networks , 2009, Nature Reviews Neuroscience.