Hierarchical Bayesian Optimization of Spatiotemporal Neurostimulations for Targeted Motor Outputs

The development of neurostimulation techniques to evoke motor patterns is an active area of research. It serves as a crucial experimental tool to probe computation in neural circuits, and has applications in neuroprostheses used to aid recovery of motor function after stroke or injury to the nervous system. There are two important challenges when designing algorithms to unveil and control neurostimulation-to-motor correspondences, thereby linking spatiotemporal patterns of neural stimulation to muscle activation: (1) the exploration of motor maps needs to be fast and efficient (exhaustive search is to be avoided for clinical and experimental reasons) (2) online learning needs to be flexible enough to deal with noise and occasional spurious responses. We propose a stimulation search algorithm to address these issues, and demonstrate its efficacy with experiments in the motor cortex (M1) of a non-human primate model. Our solution is a novel iterative process using Bayesian Optimization via Gaussian Processes on a hierarchy of increasingly complex signal spaces. We show that our algorithm can successfully and rapidly learn correspondences between complex stimulation patterns and evoked muscle activation patterns, where standard approaches fail. Importantly, we uncover nonlinear circuit-level computations in M1 that would have been difficult to identify using conventional mapping techniques.

[1]  Solaiman Shokur,et al.  Non-invasive, Brain-controlled Functional Electrical Stimulation for Locomotion Rehabilitation in Individuals with Paraplegia , 2019, Scientific Reports.

[2]  George Howard,et al.  Global stroke statistics , 2017, International journal of stroke : official journal of the International Stroke Society.

[3]  Paul S. Weiss,et al.  The Brain Activity Map , 2013, Science.

[4]  Christopher K. I. Williams,et al.  Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning) , 2005 .

[5]  N. Dancause,et al.  Parallel Cortical Networks Formed by Modular Organization of Primary Motor Cortex Outputs , 2016, Current Biology.

[6]  L. Tsimring Noise in biology , 2014, Reports on progress in physics. Physical Society.

[7]  Silvestro Micera,et al.  Spatiotemporal neuromodulation therapies engaging muscle synergies improve motor control after spinal cord injury , 2016, Nature Medicine.

[8]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[9]  Nando de Freitas,et al.  A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning , 2010, ArXiv.

[10]  M. Graziano,et al.  Complex Movements Evoked by Microstimulation of Precentral Cortex , 2002, Neuron.

[11]  A. Bentivoglio,et al.  Motor cortex stimulation for movement disorders. , 2016, Journal of neurosurgical sciences.

[12]  Kevin M. Cury,et al.  DeepLabCut: markerless pose estimation of user-defined body parts with deep learning , 2018, Nature Neuroscience.

[13]  J. Kaas Plasticity of sensory and motor maps in adult mammals. , 1991, Annual review of neuroscience.

[14]  Jasper Snoek,et al.  Input Warping for Bayesian Optimization of Non-Stationary Functions , 2014, ICML.