Identification of electrically stimulated muscle after stroke

The design of controllers to enable the application of Functional Electrical Stimulation as part of a rehabilitation programme for stroke patients requires an accurate model of electrically stimulated muscle. In this paper, nonlinear dynamics of the electrically stimulated muscle under isometric conditions is investigated, leading to the requirement to identify a Hammerstein model structure. Here we develop a two-stage identification method based on a preliminary construction of the linear part that is used as an initial estimate. Then the two-stage method is applied to identify the nonlinear part and optimize the linear part. The separable least squares optimization algorithm and traditional ramp deconvolution method are implemented here and compared with the proposed method using a simulated muscle system that is based on experimental data from stroke patients. The results show that the proposed method outperforms two other previously proposed methods when implemented on the simulated muscle system with different noise levels.

[1]  M. Castro-Alamancos,et al.  Transfer of Function to a Specific Area of the Cortex After Induced Recovery from Brain Damage , 1992, The European journal of neuroscience.

[2]  S. Binder-Macleod,et al.  A mathematical model that predicts skeletal muscle force , 1997, IEEE Transactions on Biomedical Engineering.

[3]  D. Westwick,et al.  Separable Least Squares Identification of Nonlinear Hammerstein Models: Application to Stretch Reflex Dynamics , 2001, Annals of Biomedical Engineering.

[4]  Nozomu Hoshimiya,et al.  A method of multichannel PID control of two-degree-of-freedom wrist joint movements by functional electrical stimulation , 2003, Systems and Computers in Japan.

[5]  Fabio Previdi,et al.  Closed-loop control of FES supported standing up and sitting down using Virtual Reference Feedback Tuning , 2005 .

[6]  L. F. Frey Law,et al.  Mathematical models use varying parameter strategies to represent paralyzed muscle force properties: a sensitivity analysis , 2005, Journal of NeuroEngineering and Rehabilitation.

[7]  W. Farahat,et al.  A Method for Identification of Electrically Stimulated Muscle , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[8]  Carl de Boor,et al.  A Practical Guide to Splines , 1978, Applied Mathematical Sciences.

[9]  T. Hsia.  A multi-stage least squares method for identifying Hammerstein model nonlinear systems , 1976, 1976 IEEE Conference on Decision and Control including the 15th Symposium on Adaptive Processes.

[10]  Rahman Davoodi,et al.  Manual and automatic control of FES-assisted indoor rowing exercise , 2002, Proceedings of the Second Joint 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society] [Engineering in Medicine and Biology.

[11]  M. Verhaegen,et al.  Identifying MIMO Hammerstein systems in the context of subspace model identification methods , 1996 .

[12]  R. Kobetic,et al.  Tetanic responses of electrically stimulated paralyzed muscle at varying interpulse intervals , 1989, IEEE Transactions on Biomedical Engineering.

[13]  D N Rushton,et al.  Functional electrical stimulation and rehabilitation--an hypothesis. , 2003, Medical engineering & physics.

[14]  B J Andrews,et al.  Computer simulation of FES standing up in paraplegia: a self-adaptive fuzzy controller with reinforcement learning. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[15]  J. Bobet,et al.  A simple model of force generation by skeletal muscle during dynamic isometric contractions , 1998, IEEE Transactions on Biomedical Engineering.

[16]  Huaiyu Wu,et al.  Adaptive iteration learning control and its applications for FNS multi-joint motion , 2000, Proceedings of the 17th IEEE Instrumentation and Measurement Technology Conference [Cat. No. 00CH37066].

[17]  Mohamed Darouach,et al.  A robust and recursive identification method for MISO Hammerstein model , 1996 .

[18]  Yucai Zhu.  Identification of Hammerstein models for control using ASYM , 2000 .

[19]  Maarten J. IJzerman,et al.  Therapeutic electrical stimulation to improve motor control and functional abilities of the upper extremity after stroke: a systematic review , 2002, Clinical rehabilitation.

[20]  G. Zahalak,et al.  Muscle activation and contraction: constitutive relations based directly on cross-bridge kinetics. , 1990, Journal of biomechanical engineering.

[21]  M. Popovic,et al.  The effect of random modulation of functional electrical stimulation parameters on muscle fatigue , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  Er-Wei Bai,et al.  Decoupling the linear and nonlinear parts in Hammerstein model identification , 2004, Autom..

[23]  P. Crago,et al.  Modulation of Muscle Force by Recruitment During Intramuscular Stimulation , 1980, IEEE Transactions on Biomedical Engineering.

[24]  Maarten J. IJzerman,et al.  Relation between stimulation characteristics and clinical outcome in studies using electrical stimulation to improve motor control of the upper extremity in stroke. , 2005, Journal of rehabilitation medicine.

[25]  M. Pawlak.  On the series expansion approach to the identification of Hammerstein systems , 1991 .

[26]  Wlodzimierz Grebliclu.  Nonlinearitv Estimation in Hammerstein Systems Based on Ordered Observations , 1996 .

[27]  S. Sung.  System Identification Method for Hammerstein Processes , 2002 .

[28]  David H. Owens,et al.  Robust monotone gradient‐based discrete‐time iterative learning control , 2009 .

[29]  M. Ferrarin,et al.  A pilot study of myoelectrically controlled FES of upper extremity , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[30]  P. Stoica.  On the convergence of an iterative algorithm used for Hammerstein system identification , 1981 .

[31]  Wen-Xiao Zhao,et al.  Adaptive tracking and recursive identification for Hammerstein systems , 2009, Autom..

[32]  J. Basmajian,et al.  Agonist and antagonist activity during voluntary upper-limb movement in patients with stroke. , 1992, Physical therapy.

[33]  G. Shue,et al.  Muscle-joint models incorporating activation dynamics, moment-angle, and moment-velocity properties , 1995, IEEE Transactions on Biomedical Engineering.

[34]  H.J. Chizeck,et al.  Recursive parameter identification of constrained systems: an application to electrically stimulated muscle , 1991, IEEE Transactions on Biomedical Engineering.

[35]  Er-Wei Bai,et al.  Identification of linear systems with hard input nonlinearities of known structure , 2002, Autom..

[36]  Wlodzimierz Greblicki,et al.  Stochastic approximation in nonparametric identification of Hammerstein systems , 2002, IEEE Trans. Autom. Control..

[37]  Han-Fu Chen,et al.  Identification and Stochastic Adaptive Control , 1991 .

[38]  A.G. Alleyne,et al.  A survey of iterative learning control , 2006, IEEE Control Systems.

[39]  Anthony S Wexler,et al.  A mathematical model that predicts the force–frequency relationship of human skeletal muscle , 2002, Muscle & nerve.

[40]  S J Dorgan,et al.  A nonlinear mathematical model of electrically stimulated skeletal muscle. , 1997, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[41]  Ning Lan,et al.  Neural network generation of muscle stimulation patterns for control of arm movements , 1994 .

[42]  Er-Wei Bai.  An optimal two-stage identification algorithm for Hammerstein-Wiener nonlinear systems , 1998, Autom..

[43]  Suguru Arimoto,et al.  Bettering operation of Robots by learning , 1984, J. Field Robotics.

[44]  John F. MacGregor,et al.  A framework for subspace identification methods , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[45]  L. A. Bernotas,et al.  A Discrete-Time Model of Electrcally Stimulated Muscle , 1986, IEEE Transactions on Biomedical Engineering.

[46]  Akira Sano,et al.  Identification of a dynamical system with input nonlinearity , 1999 .

[47]  Fabio Previdi,et al.  Identification of black-box nonlinear models for lower limb movement control using functional electrical stimulation , 2002 .

[48]  Biao Huang,et al.  Identification of Hammerstein systems without explicit parameterisation of non-linearity , 2009, Int. J. Control.

[49]  K. Narendra,et al.  An iterative method for the identification of nonlinear systems using a Hammerstein model , 1966 .

[50]  Jörg Raisch,et al.  Online identification and nonlinear control of the electrically stimulated quadriceps muscle , 2005 .

[51]  Minyue Fu,et al.  A blind approach to Hammerstein model identification , 2002, IEEE Trans. Signal Process..

[52]  L. Vodovnik,et al.  Control of a skeletal joint by electrical stimulation of antagonists , 1967, Medical and biological engineering.

[53]  D. Howard,et al.  Artificial Neural Network Prediction Using Accelerometers to Control Upper Limb FES During Reaching and Grasping Following Stroke , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[54]  David T. Westwick,et al.  Identification of Hammerstein models with cubic spline nonlinearities , 2004, IEEE Transactions on Biomedical Engineering.

[55]  Stéphane Lecoeuche,et al.  Recursive subspace identification of Hammerstein models based on least squares support vector machines , 2009 .

[56]  Thierry Keller,et al.  Sliding mode closed-loop control of FES controlling the shank movement , 2004, IEEE Transactions on Biomedical Engineering.

[57]  E. Rogers,et al.  Feasibility of Iterative Learning Control Mediated by Functional Electrical Stimulation for Reaching After Stroke , 2009, Neurorehabilitation and neural repair.

[58]  W. Durfee,et al.  Methods for estimating isometric recruitment curves of electrically stimulated muscle , 1989, IEEE Transactions on Biomedical Engineering.

[59]  A. Prevo,et al.  The long-term outcome of arm function after stroke: results of a follow-up study. , 1999, Disability and rehabilitation.

[60]  M. J. Korenberg,et al.  The identification of nonlinear biological systems: Wiener and Hammerstein cascade models , 1986, Biological Cybernetics.

[61]  E. Rogers,et al.  Newton method based iterative learning control of the upper limb , 2008, 2008 American Control Conference.

[62]  M Munih,et al.  Variation of recruitment nonlinearity and dynamic response of ankle plantarflexors. , 2000, Medical engineering & physics.

[63]  R. Luus,et al.  A noniterative method for identification using Hammerstein model , 1971 .

[64]  D. Wade,et al.  Loss of arm function after stroke: measurement, frequency, and recovery. , 1986, International rehabilitation medicine.

[65]  E. Rogers,et al.  An Experimental Facility using Functional Electrical Stimulation for Stroke Rehabilitation of the Upper Limb , 2007, 2007 IEEE 10th International Conference on Rehabilitation Robotics.

[66]  Antony J Hodgson,et al.  Time and magnitude of torque generation is impaired in both arms following stroke , 2003, Muscle & nerve.

[67]  Er-Wei Bai,et al.  Least squares solutions of bilinear equations , 2006, Syst. Control. Lett..

[68]  Jonathan C. Jarvis,et al.  A nonlinear approach to modeling of electrically stimulated skeletal muscle , 2001, IEEE Transactions on Biomedical Engineering.

[69]  Han-Fu Chen,et al.  Pathwise convergence of recursive identification algorithms for Hammerstein systems , 2004, IEEE Transactions on Automatic Control.

[70]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[71]  Su Whan Sung,et al.  Relay Feedback Approaches for the Identification of Hammerstein-Type Nonlinear Processes , 2004 .

[72]  R. Stein,et al.  A comparison of models of force production during stimulated isometric ankle dorsiflexion in humans , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[73]  M. Boutayeb,et al.  Recursive identification method for MISO Wiener-Hammerstein model , 1995, IEEE Trans. Autom. Control..

[74]  Ann-Marie Hughes,et al.  A model of the upper extremity using FES for stroke rehabilitation. , 2009, Journal of biomechanical engineering.

[75]  M. Munih,et al.  Investigation of the Hammerstein hypothesis in the modeling of electrically stimulated muscle , 1998, IEEE Transactions on Biomedical Engineering.

[76]  W. Rymer,et al.  Muscle stiffness during transient and continuous movements of cat muscle: perturbation characteristics and physiological relevance , 1994, IEEE Transactions on Biomedical Engineering.

[77]  W. Greblicki,et al.  Identification of discrete Hammerstein systems using kernel regression estimates , 1986 .

[78]  Er-Wei Bai,et al.  Convergence of the iterative Hammerstein system identification algorithm , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[79]  Eric Rogers,et al.  Iterative learning control of FES applied to the upper extremity for rehabilitation , 2009 .

[80]  Kevin L. Moore,et al.  Iterative Learning Control: Brief Survey and Categorization , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[81]  R K Shields,et al.  Mathematical models of human paralyzed muscle after long-term training. , 2007, Journal of biomechanics.

[82]  Biao Huang,et al.  A blind approach to closed-loop identification of Hammerstein systems , 2007, Int. J. Control.

[83]  Henrik Gollee,et al.  Robust control of electrically-stimulated muscle using polynomial H∞ design , 2001 .

[84]  M. Munih,et al.  Setup and procedure for online identification of electrically stimulated muscle with Matlab Simulink , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[85]  Er-Wei Bai,et al.  Iterative identification of Hammerstein systems , 2007, Autom..

[86]  Samuel C. K. Lee,et al.  Mathematical model that predicts the force–intensity and force–frequency relationships after spinal cord injuries , 2007, Muscle & nerve.

[87]  E. Rogers,et al.  Robustness analysis of an adjoint optimal iterative learning controller with experimental verification , 2008 .

[88]  R. Stein,et al.  A linear time-varying model of force generation in skeletal muscle , 1993, IEEE Transactions on Biomedical Engineering.

[89]  R. Riener,et al.  Model-based control of FES-induced single joint movements , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[90]  M. Ladouceur,et al.  Clinical and Therapeutic Applications of Neuromuscular Stimulation: A Review of Current Use and Speculation into Future Developments , 2001, Neuromodulation : journal of the International Neuromodulation Society.

[91]  H.J. Chizeck,et al.  Robust closed-loop control of isometric muscle force using pulsewidth modulation , 1988, IEEE Transactions on Biomedical Engineering.

[92]  M. Solomonow,et al.  The dynamic response model of nine different skeletal muscles , 1990, IEEE Transactions on Biomedical Engineering.

[93]  Enrique Baeyens,et al.  Subspace-based Identification Algorithms for Hammerstein and Wiener Models , 2005, Eur. J. Control.

[94]  A. Huxley.  Muscle structure and theories of contraction. , 1957, Progress in biophysics and biophysical chemistry.

[95]  W. Durfee,et al.  Estimation of force-activation, force-length, and force-velocity properties in isolated, electrically stimulated muscle , 1994, IEEE Transactions on Biomedical Engineering.

[96]  Johan A. K. Suykens,et al.  Subspace identification of Hammerstein systems using least squares support vector machines , 2005, IEEE Transactions on Automatic Control.

[97]  Eric Rogers,et al.  Further results on the experimental evaluation of iterative learning control algorithms for non-minimum phase plants , 2007, Int. J. Control.

[98]  R.B. Stein,et al.  Identification of electrically stimulated quadriceps muscles in paraplegic subjects , 1999, IEEE Transactions on Biomedical Engineering.

[99]  Er-Wei Bai.  A blind approach to the Hammerstein-Wiener model identification , 2002, Autom..