Model-Free Neuromuscular Electrical Stimulation by Stochastic Extremum Seeking

Stochastic extremum seeking (ES) approach is employed to adapt the gains of a proportional—integral—derivative (PID) control law for functional neuromuscular electrical stimulation. The proposed scheme is applied to control the position of the arm of healthy volunteers and stroke patients so that coordinated movements of flexion/extension for their elbow can be performed. This approach eliminates the initial tuning tests with patients since the controller parameters are automatically computed in real time. The PID parameters are updated by means of a discrete version of multivariable stochastic ES in order to minimize a cost function which brings the desired performance requirements. Experimental results with healthy volunteers as well as stroke patients show the usual specifications commonly considered in physiotherapy for functional rehabilitation are eventually satisfied in terms of steady-state error, settling time, and percentage overshoot. Quantitative results show a reduction of 62.30% in terms of the root-mean-square error—from 9.02° to 3.40°—when comparing the tracking curves of the last cycle to the first cycle in the experiments with all subjects.

[1]  Mark French,et al.  Multiple-Model Adaptive Control of Functional Electrical Stimulation , 2015, IEEE Transactions on Control Systems Technology.

[2]  Richard W. Bohannon,et al.  Interrater reliability of a modified Ashworth scale of muscle spasticity. , 1987, Physical therapy.

[3]  Liu Hsu,et al.  Output-feedback global tracking for unknown control direction plants with application to extremum-seeking control , 2011, Autom..

[4]  Miroslav Krstic On the applicability of PID control to nonlinear second-order systems , 2017 .

[5]  Chris Manzie,et al.  A Framework for Extremum Seeking Control of Systems With Parameter Uncertainties , 2013, IEEE Transactions on Automatic Control.

[6]  Ying Tan,et al.  Extremum Seeking for Constrained Inputs , 2013, IEEE Transactions on Automatic Control.

[7]  W. Marsden I and J , 2012 .

[8]  C. Lynch,et al.  Functional Electrical Stimulation , 2017, IEEE Control Systems.

[9]  Nicholas Kirsch,et al.  Further Results on Predictor-Based Control of Neuromuscular Electrical Stimulation , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  A. Fugl-Meyer,et al.  The post-stroke hemiplegic patient. 1. a method for evaluation of physical performance. , 1975, Scandinavian journal of rehabilitation medicine.

[11]  M. Krstić,et al.  Stochastic Averaging and Stochastic Extremum Seeking , 2012 .

[12]  Alexander Scheinker,et al.  Application of Extremum Seeking for Time-Varying Systems to Resonance Control of RF Cavities , 2017, IEEE Transactions on Control Systems Technology.

[13]  M. Krstic,et al.  PID tuning using extremum seeking: online, model-free performance optimization , 2006, IEEE Control Systems.

[14]  W. E. Dixon,et al.  Predictor-Based Compensation for Electromechanical Delay During Neuromuscular Electrical Stimulation , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[15]  Y. Hara,et al.  Neurorehabilitation with new functional electrical stimulation for hemiparetic upper extremity in stroke patients. , 2008, Journal of Nippon Medical School = Nippon Ika Daigaku zasshi.

[16]  Warren E. Dixon,et al.  Isometric Torque Control for Neuromuscular Electrical Stimulation With Time-Varying Input Delay , 2016, IEEE Transactions on Control Systems Technology.

[17]  Martin Guay,et al.  Distributed Control of High-Altitude Balloon Formation by Extremum-Seeking Control , 2018, IEEE Transactions on Control Systems Technology.

[18]  Warren E. Dixon,et al.  Extremum-seeking nonlinear controllers for a human exercise machine , 2006 .

[19]  S. Rinaldi,et al.  Positive Linear Systems: Theory and Applications , 2000 .

[20]  Marcus Johnson,et al.  Closed-Loop Neural Network-Based NMES Control for Human Limb Tracking , 2012, IEEE Transactions on Control Systems Technology.

[21]  Miroslav Krstic,et al.  Constrained extremum seeking in 1 dimension , 2014, 53rd IEEE Conference on Decision and Control.

[22]  Tiago Roux Oliveira,et al.  Extremum Seeking applied to Neuromuscular Electrical Stimulation , 2016 .

[23]  Nicholas R. Gans,et al.  Simplex Guided Extremum Seeking Control With Convergence Detection to Improve Global Performance , 2016, IEEE Transactions on Control Systems Technology.

[24]  Dragan Nesic,et al.  Extremum Seeking Control of Cascaded Raman Optical Amplifiers , 2008, IEEE Transactions on Control Systems Technology.

[25]  Warren E. Dixon,et al.  Switched tracking control of a human limb during asynchronous neuromuscular electrical stimulation , 2015, 2015 American Control Conference (ACC).

[26]  Warren E. Dixon,et al.  An extremum seeking method for non-isometric neuromuscular electrical stimulation , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[27]  Miroslav Krstic,et al.  Gradient based projection method for constrained optimization , 2013, 52nd IEEE Conference on Decision and Control.

[28]  Liu Hsu,et al.  Global output-feedback extremum seeking control via monitoring functions , 2013, 52nd IEEE Conference on Decision and Control.

[29]  L. Sheffler,et al.  Neuromuscular electrical stimulation in neurorehabilitation , 2007, Muscle & nerve.

[30]  Kartik B. Ariyur,et al.  Real-Time Optimization by Extremum-Seeking Control , 2003 .

[31]  W.E. Dixon,et al.  Nonlinear Neuromuscular Electrical Stimulation Tracking Control of a Human Limb , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[32]  D. Popovic,et al.  Extremum seeking methods for optimization of variable cam timing engine operation , 2006, IEEE Transactions on Control Systems Technology.

[33]  Timothy W. Cooke,et al.  Improving the assessment of outcomes in stroke: use of a structured interview to assign grades on the modified Rankin Scale. , 2002, Stroke.

[34]  Chris Manzie,et al.  Aerodynamic Shape Optimization via Global Extremum Seeking , 2015, IEEE Transactions on Control Systems Technology.

[35]  Denis Dochain,et al.  A proportional-integral extremum-seeking controller design technique , 2017, Autom..

[36]  Nicola A. Maffiuletti,et al.  Physiological and methodological considerations for the use of neuromuscular electrical stimulation , 2010, European Journal of Applied Physiology.

[37]  Chris Manzie,et al.  Extremum Seeking With Stochastic Perturbations , 2009, IEEE Transactions on Automatic Control.

[38]  Denis Dochain,et al.  A time-varying extremum-seeking control approach , 2013, ACC.

[39]  Tiago Roux Oliveira,et al.  Time-scaling based sliding mode control for Neuromuscular Electrical Stimulation under uncertain relative degrees. , 2017, Medical engineering & physics.

[40]  Miroslav Krstic,et al.  Stability of extremum seeking feedback for general nonlinear dynamic systems , 2000, Autom..

[41]  Anup Parikh,et al.  Automatic Control of Cycling Induced by Functional Electrical Stimulation With Electric Motor Assistance , 2017, IEEE Transactions on Automation Science and Engineering.

[42]  Miroslav Krstic,et al.  Power Optimization for Photovoltaic Microconverters Using Multivariable Newton-Based Extremum Seeking , 2012, IEEE Transactions on Control Systems Technology.

[43]  Aleksandra Marjanović,et al.  Control of Thermal Power Plant Combustion Distribution Using Extremum Seeking , 2017, IEEE Transactions on Control Systems Technology.

[44]  Miroslav Krstic,et al.  HCCI Engine Combustion-Timing Control: Optimizing Gains and Fuel Consumption Via Extremum Seeking , 2009, IEEE Transactions on Control Systems Technology.

[45]  Eric Rogers,et al.  Iterative learning control of FES applied to the upper extremity for rehabilitation , 2009 .

[46]  P. Olver Nonlinear Systems , 2013 .

[47]  Miroslav Krstic,et al.  Extremum Seeking Control , 2019, Encyclopedia of Systems and Control.

[48]  Christopher T. Freeman,et al.  Upper Limb Electrical Stimulation Using Input-Output Linearization and Iterative Learning Control , 2015, IEEE Transactions on Control Systems Technology.

[49]  Jörg Raisch,et al.  Iterative learning control of a drop foot neuroprosthesis — Generating physiological foot motion in paretic gait by automatic feedback control , 2016 .