A proof-of-principle simulation for closed-loop control based on preexisting experimental thalamic DBS-enhanced instrumental learning

Deep brain stimulation (DBS) has been applied as an effective therapy for treating Parkinson's disease or essential tremor. Several open-loop DBS control strategies have been developed for clinical experiments, but they are limited by short battery life and inefficient therapy. Therefore, many closed-loop DBS control systems have been designed to tackle these problems by automatically adjusting the stimulation parameters via feedback from neural signals, which has been reported to reduce the power consumption. However, when the association between the biomarkers of the model and stimulation is unclear, it is difficult to develop an optimal control scheme for other DBS applications, i.e., DBS-enhanced instrumental learning. Furthermore, few studies have investigated the effect of closed-loop DBS control for cognition function, such as instrumental skill learning, and have been implemented in simulation environments. In this paper, we proposed a proof-of-principle design for a closed-loop DBS system, cognitive-enhancing DBS (ceDBS), which enhanced skill learning based on in vivo experimental data. The ceDBS acquired local field potential (LFP) signal from the thalamic central lateral (CL) nuclei of animals through a neural signal processing system. A strong coupling of the theta oscillation (4-7 Hz) and the learning period was found in the water reward-related lever-pressing learning task. Therefore, the theta-band power ratio, which was the averaged theta band to averaged total band (1-55 Hz) power ratio, could be used as a physiological marker for enhancement of instrumental skill learning. The on-line extraction of the theta-band power ratio was implemented on a field-programmable gate array (FPGA). An autoregressive with exogenous inputs (ARX)-based predictor was designed to construct a CL-thalamic DBS model and forecast the future physiological marker according to the past physiological marker and applied DBS. The prediction could further assist the design of a closed-loop DBS controller. A DBS controller based on a fuzzy expert system was devised to automatically control DBS according to the predicted physiological marker via a set of rules. The simulated experimental results demonstrate that the ceDBS based on the closed-loop control architecture not only reduced power consumption using the predictive physiological marker, but also achieved a desired level of physiological marker through the DBS controller.

[1]  N. Schiff Recovery of consciousness after severe brain injury: The role of arousal regulation mechanisms and some speculation on the heart-brain interface , 2010, Cleveland Clinic Journal of Medicine.

[2]  M. Belluscio,et al.  Closed-Loop Control of Epilepsy by Transcranial Electrical Stimulation , 2012, Science.

[3]  R. Joosten,et al.  Deep brain stimulation in the lateral orbitofrontal cortex impairs spatial reversal learning , 2013, Behavioural Brain Research.

[4]  Jakob Voigts,et al.  Neural ensemble communities: open-source approaches to hardware for large-scale electrophysiology , 2015, Current Opinion in Neurobiology.

[5]  H. Lüders,et al.  Deep Brain Stimulation in Epilepsy , 2001, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[6]  A. Lozano,et al.  Introduction: Deep brain stimulation: current assessment, new applications, and future innovations. , 2015, Neurosurgical focus.

[7]  F. Jaw,et al.  Central Thalamic Deep-Brain Stimulation Alters Striatal-Thalamic Connectivity in Cognitive Neural Behavior , 2016, Front. Neural Circuits.

[8]  M. Gelabert-González,et al.  [Deep brain stimulation in Parkinson's disease]. , 2013, Revista de neurologia.

[9]  Chris C. Tang,et al.  Improved Sequence Learning with Subthalamic Nucleus Deep Brain Stimulation: Evidence for Treatment-Specific Network Modulation , 2012, The Journal of Neuroscience.

[10]  Ahmad Ihsan Mohd Yassin,et al.  Classification of intelligence quotient via brainwave sub-band power ratio features and artificial neural network , 2014, Comput. Methods Programs Biomed..

[11]  D. Graupe,et al.  Pathological tremor prediction using surface electromyogram and acceleration: potential use in ‘ON–OFF’ demand driven deep brain stimulator design , 2013, Journal of neural engineering.

[12]  Luca Podofillini,et al.  Comparing the treatment of uncertainty in Bayesian networks and fuzzy expert systems used for a human reliability analysis application , 2015, Reliab. Eng. Syst. Saf..

[13]  N. Schiff Central Thalamic Deep‐Brain Stimulation in the Severely Injured Brain , 2009, Annals of the New York Academy of Sciences.

[14]  Mandy Miller Koop,et al.  Intra-operative STN DBS attenuates the prominent beta rhythm in the STN in Parkinson's disease , 2006, Experimental Neurology.

[15]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[16]  W. Grill,et al.  Closed-Loop Control of Deep Brain Stimulation: A Simulation Study , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  N. Schiff,et al.  Cognitive enhancement with central thalamic electrical stimulation , 2006, Proceedings of the National Academy of Sciences.

[18]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[19]  M. Nicolelis,et al.  Global Forebrain Dynamics Predict Rat Behavioral States and Their Transitions , 2004, The Journal of Neuroscience.

[20]  Naresh K. Sinha,et al.  Modern Control Systems , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[21]  J. Giacino,et al.  Longitudinal outcome of patients with disordered consciousness in the NIDRR TBI Model Systems Programs. , 2012, Journal of neurotrauma.

[22]  P. Brown,et al.  Annals of the New York Academy of Sciences What Brain Signals Are Suitable for Feedback Control of Deep Brain Stimulation in Parkinson's Disease? , 2022 .

[23]  Sudhin A. Shah,et al.  Central thalamic deep brain stimulation for cognitive neuromodulation – a review of proposed mechanisms and investigational studies , 2010, The European journal of neuroscience.

[24]  P. Brown,et al.  Adaptive Deep Brain Stimulation In Advanced Parkinson Disease , 2013, Annals of neurology.

[25]  Nicole C. Swann,et al.  Therapeutic deep brain stimulation reduces cortical phase-amplitude coupling in Parkinson's disease , 2015, Nature Neuroscience.

[26]  Bin Deng,et al.  Closed-Loop Control of Tremor-Predominant Parkinsonian State Based on Parameter Estimation , 2016 .

[27]  Nicholas D Schiff,et al.  Annals of the New York Academy of Sciences Moving toward a Generalizable Application of Central Thalamic Deep Brain Stimulation for Support of Forebrain Arousal Regulation in the Severely Injured Brain , 2022 .

[28]  Tipu Z. Aziz,et al.  A Fuzzy Inference System for Closed-Loop Deep Brain Stimulation in Parkinson’s Disease , 2015, Journal of Medical Systems.

[29]  Anantha Chandrakasan,et al.  An energy-efficient biomedical signal processing platform , 2010, 2010 Proceedings of ESSCIRC.

[30]  A. Priori,et al.  Adaptive deep brain stimulation (aDBS) controlled by local field potential oscillations , 2013, Experimental Neurology.

[31]  N. A. Korenevskiy,et al.  Application of Fuzzy Logic for Decision-Making in Medical Expert Systems , 2015 .

[32]  Yoshitaka Nakanishi,et al.  Spectral Analysis of Field Potential Recordings by Deep Brain Stimulation Electrode for Localization of Subthalamic Nucleus in Patients with Parkinson’s Disease , 2009, Stereotactic and Functional Neurosurgery.

[33]  Pedram Afshar,et al.  A translational platform for prototyping closed-loop neuromodulation systems , 2013, Front. Neural Circuits.

[34]  Bin Deng,et al.  Closed-Loop Control of the thalamocortical Relay Neuron's Parkinsonian State Based on Slow Variable , 2013, Int. J. Neural Syst..

[35]  Jean-Marie Aerts,et al.  Conceptualization and validation of an open-source closed-loop deep brain stimulation system in rat , 2015, Scientific Reports.

[36]  J. Dostrovsky,et al.  Beta oscillatory activity in the subthalamic nucleus and its relation to dopaminergic response in Parkinson's disease. , 2006, Journal of neurophysiology.

[37]  S. Haber,et al.  Closed-Loop Deep Brain Stimulation Is Superior in Ameliorating Parkinsonism , 2011, Neuron.

[38]  Sara Marceglia,et al.  The adaptive deep brain stimulation challenge. , 2016, Parkinsonism & related disorders.

[39]  K. Miller,et al.  Exaggerated phase–amplitude coupling in the primary motor cortex in Parkinson disease , 2013, Proceedings of the National Academy of Sciences.

[40]  T. Womelsdorf,et al.  Human Neuroscience , 2022 .

[41]  Bin Deng,et al.  Model-based iterative learning control of Parkinsonian state in thalamic relay neuron , 2014, Commun. Nonlinear Sci. Numer. Simul..

[42]  György Buzsáki,et al.  Neuroelectronics and Biooptics: Closed-Loop Technologies in Neurological Disorders. , 2015, JAMA neurology.

[43]  Andrea A. Kühn,et al.  High-Frequency Stimulation of the Subthalamic Nucleus Suppresses Oscillatory β Activity in Patients with Parkinson's Disease in Parallel with Improvement in Motor Performance , 2008, The Journal of Neuroscience.

[44]  T. Aziz,et al.  Characteristics of local field potentials correlate with pain relief by deep brain stimulation , 2016, Clinical Neurophysiology.