A Novel Closed-Loop Deep Brain Stimulation Technique for Parkinson’s Patients Rehabilitation Utilizing Machine Learning

Deep brain stimulation (DBS) is an effective treatment for movement problems caused by a variety of neurodegenerative illnesses, including Parkinson’s disease (PD). Researchers have created closed-loop DBS (CL-DBS) techniques for reducing hand tremors in many disorders, notably Parkinson’s patients, in recent years. As shown in the studies, hand tremor and rigidity symptoms are two sides of the same coin, with hand tremor leading to rigidity fluctuations and vice versa. The following are the primary contributions of this study: 1) depicts the correlation between the two indicators and 2) the suggestion of a proximal policy optimization (PPO)-based non-integer proportional integral derivative (PID) control technique to reduce hand tremor and stiffness at the same time, where the reward function is developed to alter DBS settings when illness levels vary. The PPO technique is combined with the main controller to provide adaptive learning. The controller parameters of the non-integer PID scheme are regarded as changeable controller coefficients in the proposed strategy, which will be adaptively built by the PPO technique via online learning of its neural networks (NNs). In order to demonstrate the advantages and adaptability of the procedure with different models and patients, the recommended strategy is an analysis by computer simulation in a variety of contexts (performance, robustness, and noise) and compared to current methodologies like integer-order PID (IOPID) and fractional-order PID (FOPID). The simulation outcomes showed that the created system performed better and more effectively than previous approaches in coping with parameter changes and outside noise, in addition to simultaneously reducing hand tremor and stiffness.

[1]  K. Loparo,et al.  Adaptive closed-loop control strategy inhibiting pathological basal ganglia oscillations , 2022, Biomed. Signal Process. Control..

[2]  D. Owens,et al.  Multiperiodic Repetitive Control for Functional Electrical Stimulation-Based Wrist Tremor Suppression , 2022, IEEE Transactions on Control Systems Technology.

[3]  M. Khooban,et al.  Smart Sensor Control for Rehabilitation in Parkinson's Patients , 2022, IEEE Transactions on Emerging Topics in Computational Intelligence.

[4]  Tong Liang,et al.  Reinforcement-Learning-Based Vibration Control for a Vehicle Semi-Active Suspension System via the PPO Approach , 2022, Applied Sciences.

[5]  Rastko R. Selmic,et al.  Multi-Agent Formation Control With Obstacle Avoidance Using Proximal Policy Optimization , 2021, 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[6]  Mohammad Hassan Khooban,et al.  A Novel Nonlinear Deep Reinforcement Learning Controller for DC–DC Power Buck Converters , 2021, IEEE Transactions on Industrial Electronics.

[7]  Behnam Faraji,et al.  Ultra-Local Model Control of Parkinson's Patients Based on Machine Learning , 2021 .

[8]  Mohammad Hassan Khooban,et al.  An Intelligent Non-Integer PID Controller-Based Deep Reinforcement Learning: Implementation and Experimental Results , 2021, IEEE Transactions on Industrial Electronics.

[9]  M. Khooban,et al.  Machine Learning Approach Based on Ultra-Local Model Control for Treating Cancer Pain , 2021, IEEE Sensors Journal.

[10]  M. Khooban,et al.  An Adaptive ADRC Control for Parkinson’s Patients Using Machine Learning , 2021, IEEE Sensors Journal.

[11]  Shanshan Li,et al.  Model-Based Closed-Loop Suppression of Parkinsonian Beta Band Oscillations Through Origin Analysis , 2021, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  M. T. Pellecchia,et al.  Speech disorder and vocal tremor in postural instability/gait difficulty and tremor dominant subtypes of Parkinson’s disease , 2020, Journal of Neural Transmission.

[13]  M. Okun,et al.  Choosing a Parkinson Disease Treatment. , 2020, JAMA.

[14]  M. Khooban,et al.  DC/DC Power Converter Control-Based Deep Machine Learning Techniques: Real-Time Implementation , 2020, IEEE Transactions on Power Electronics.

[15]  Mohammad Hassan Khooban,et al.  A Close Loop Multi-Area Brain Stimulation Control for Parkinson’s Patients Rehabilitation , 2020, IEEE Sensors Journal.

[16]  M. Okun,et al.  Diagnosis and Treatment of Parkinson Disease: A Review. , 2020, JAMA.

[17]  M. Parmar,et al.  The future of stem cell therapies for Parkinson disease , 2020, Nature Reviews Neuroscience.

[18]  K I Ramachandran,et al.  Parkinson’s Tremor Suppression Using Active Vibration Control Method , 2019, IOP Conference Series: Materials Science and Engineering.

[19]  Zahra Esfahani,et al.  Optimal Canceling of the Physiological Tremor for Rehabilitation in Parkinson’s Disease , 2019, Journal of Exercise Science and Medicine.

[20]  Tor Ame Johansen,et al.  Deep Reinforcement Learning Attitude Control of Fixed-Wing UAVs Using Proximal Policy optimization , 2019, 2019 International Conference on Unmanned Aircraft Systems (ICUAS).

[21]  Mohammad Hassan Khooban,et al.  Design an optimal fuzzy fractional proportional integral derivative controller with derivative filter for load frequency control in power systems , 2019, Trans. Inst. Meas. Control.

[22]  Iman Izadi,et al.  Designing a robust backstepping controller for rehabilitation in Parkinson's disease: a simulation study. , 2016, IET systems biology.

[23]  Lixiang Li,et al.  Optimum design of fractional order PIλDμ controller for AVR system using chaotic ant swarm , 2012, Expert Syst. Appl..

[24]  Boris Rubinsky,et al.  Noncontact Tremor Characterization Using Low-Power Wideband Radar Technology , 2012, IEEE Transactions on Biomedical Engineering.

[25]  Boris Rubinsky,et al.  Tremor Acquisition System Based on UWB Wireless Sensor Network , 2010, 2010 International Conference on Body Sensor Networks.

[26]  Shahriar Gharibzadeh,et al.  Are rigidity and tremor two sides of the same coin in Parkinson's disease? , 2008, Comput. Biol. Medicine.

[27]  Shahriar Gharibzadeh,et al.  Modeling the Parkinson's tremor and its treatments. , 2005, Journal of theoretical biology.

[28]  Guy Carrault,et al.  A computer model of rigidity and related motor dysfunction in Parkinson's disease , 2003, Movement disorders : official journal of the Movement Disorder Society.

[29]  I. Milanov Motoneuron activity in patients with different types of tremor. , 2001, Electromyography and clinical neurophysiology.

[30]  I. Milanov Electromyographic differentiation of tremors , 2001, Clinical Neurophysiology.

[31]  Mazliham Mohd Su’Ud,et al.  Intelligent Deep Brain Stimulation Systems: A General Review , 2021, IEEE Access.

[32]  Nicholas Stone,et al.  AUTOTUNING OF A PID CONTROLLER FOR AN ACTIVE VIBRATION SUPPRESSION DEVICE FOR THE TREATMENT OF ESSENTIAL TREMOR , 2006 .

[33]  P. Delwaide Parkinsonian rigidity. , 2001, Functional neurology.