Leveraging deep learning to control neural oscillators

Modulation of the firing times of neural oscillators has long been an important control objective, with applications including Parkinson's disease, Tourette's syndrome, epilepsy, and learning. One common goal for such modulation is desynchronization, wherein two or more oscillators are stimulated to transition from firing in phase with each other to firing out of phase. The optimization of such stimuli has been well studied, but this typically relies on either a reduction of the dimensionality of the system or complete knowledge of the parameters and state of the system. This limits the applicability of results to real problems in neural control. Here, we present a trained artificial neural network capable of accurately estimating the effects of square-wave stimuli on neurons using minimal output information from the neuron. We then apply the results of this network to solve several related control problems in desynchronization, including desynchronizing pairs of neurons and achieving clustered subpopulations of neurons in the presence of coupling and noise.

[1]  Jeff Moehlis,et al.  Locally optimal extracellular stimulation for chaotic desynchronization of neural populations , 2014, Journal of Computational Neuroscience.

[2]  Yoshiki Kuramoto,et al.  Chemical Oscillations, Waves, and Turbulence , 1984, Springer Series in Synergetics.

[3]  A. Winfree.  The geometry of biological time , 1991 .

[4]  Jeff Moehlis,et al.  Clustered Desynchronization from High-Frequency Deep Brain Stimulation , 2015, PLoS Comput. Biol..

[5]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[6]  A. Schnitzler,et al.  Normal and pathological oscillatory communication in the brain , 2005, Nature Reviews Neuroscience.

[7]  T. Netoff,et al.  Closed-loop neuromodulation for clustering neuronal populations. , 2020, Journal of neurophysiology.

[8]  M. Stead,et al.  Deep brain stimulation in tourette syndrome: a description of 3 patients with excellent outcome. , 2012, Mayo Clinic proceedings.

[9]  F. Lenz,et al.  Thalamic neuronal activity correlated with essential tremor , 1998, Journal of neurology, neurosurgery, and psychiatry.

[10]  Jeff Moehlis,et al.  Phase model-based neuron stabilization into arbitrary clusters , 2018, Journal of Computational Neuroscience.

[11]  Vladimir Litvak,et al.  Excessive synchronization of basal ganglia neurons at 20 Hz slows movement in Parkinson's disease , 2007, Experimental Neurology.

[12]  Amitabha Bose,et al.  Entrainment Maps , 2016, Journal of biological rhythms.

[13]  B. J. Whitaker,et al.  Phase clustering in globally coupled photochemical oscillators , 2008 .

[14]  J. Moehlis,et al.  Phase reduction and phase-based optimal control for biological systems: a tutorial , 2018, Biological Cybernetics.

[15]  M. Jaskólski,et al.  Circadian oscillator proteins across the kingdoms of life: structural aspects , 2019, BMC Biology.

[16]  Till Roenneberg,et al.  Demasking biological oscillators: properties and principles of entrainment exemplified by the Neurospora circadian clock. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[17]  W. Singer,et al.  Neural Synchrony in Brain Disorders: Relevance for Cognitive Dysfunctions and Pathophysiology , 2006, Neuron.

[18]  Jeff Moehlis,et al.  Optimal phase control of biological oscillators using augmented phase reduction , 2018, Biological Cybernetics.

[19]  Andrea A. Kühn,et al.  The relationship between local field potential and neuronal discharge in the subthalamic nucleus of patients with Parkinson's disease , 2005, Experimental Neurology.

[20]  Peter A Tass,et al.  Desynchronizing anti-resonance effect of m: n ON–OFF coordinated reset stimulation , 2011, Journal of neural engineering.

[21]  T. Otsuka,et al.  Conductance-based model of the voltage-dependent generation of a plateau potential in subthalamic neurons. , 2004, Journal of neurophysiology.

[22]  Germán Mato,et al.  Synchrony in Excitatory Neural Networks , 1995, Neural Computation.

[23]  Jeff Moehlis,et al.  Optimal Chaotic Desynchronization for Neural Populations , 2014, SIAM J. Appl. Dyn. Syst..

[24]  Jaimie M. Henderson,et al.  The STN beta-band profile in Parkinson's disease is stationary and shows prolonged attenuation after deep brain stimulation , 2009, Experimental Neurology.

[25]  Theoden Netoff,et al.  Dendritic mechanisms controlling the threshold and timing requirement of synaptic plasticity , 2011, Hippocampus.

[26]  Mandy Miller Koop,et al.  Intra-operative STN DBS attenuates the prominent beta rhythm in the STN in Parkinson's disease , 2006, Experimental Neurology.

[27]  H. Bergman,et al.  Pathological synchronization in Parkinson's disease: networks, models and treatments , 2007, Trends in Neurosciences.

[28]  Eric T. Shea-Brown,et al.  Optimal Inputs for Phase Models of Spiking Neurons , 2006 .

[29]  Eric Shea-Brown,et al.  On the Phase Reduction and Response Dynamics of Neural Oscillator Populations , 2004, Neural Computation.

[30]  Christian Hauptmann,et al.  Coordinated reset neuromodulation for Parkinson's disease: Proof-of-concept study , 2014, Movement disorders : official journal of the Movement Disorder Society.

[31]  Theoden I. Netoff,et al.  Origins and suppression of oscillations in a computational model of Parkinson’s disease , 2014, Journal of Computational Neuroscience.

[32]  Alex Arenas,et al.  Control of coupled oscillator networks with application to microgrid technologies , 2015, Science Advances.

[33]  Charles J. Wilson,et al.  Chaotic Desynchronization as the Therapeutic Mechanism of Deep Brain Stimulation , 2011, Front. Syst. Neurosci..

[34]  Jr-Shin Li,et al.  Optimal Subharmonic Entrainment of Weakly Forced Nonlinear Oscillators , 2014, SIAM J. Appl. Dyn. Syst..

[35]  Julio R. Banga,et al.  SUPPLEMENTARY FILE: Full observability and estimation of unknown inputs, states, and parameters of nonlinear biological models , 2019 .

[36]  Bard Ermentrout,et al.  Type I Membranes, Phase Resetting Curves, and Synchrony , 1996, Neural Computation.

[37]  Brian H. Houston,et al.  Frequency entrainment for micromechanical oscillator , 2003 .

[38]  Jeff Moehlis,et al.  Supervised Learning Algorithms for Controlling Underactuated Dynamical Systems , 2019 .

[39]  Cameron C. McIntyre,et al.  Modeling shifts in the rate and pattern of subthalamopallidal network activity during deep brain stimulation , 2010, Journal of Computational Neuroscience.

[40]  S. Shimojo,et al.  Cortical stimulation consolidates and reactivates visual experience: neural plasticity from magnetic entrainment of visual activity , 2013, Scientific Reports.

[41]  István Z. Kiss,et al.  Phase-selective entrainment of nonlinear oscillator ensembles , 2016, Nature Communications.