Iterative Learning Control in Health Care: Electrical Stimulation and Robotic-Assisted Upper-Limb Stroke Rehabilitation

Annually, 15 million people worldwide suffer a stroke, and 5 million are left permanently disabled. A stroke is usually caused when a blood clot blocks a vessel in the brain and acts like a dam, stopping the blood reaching the regions downstream. Alternatively, it may be caused by a hemorrhage, in which a vessel ruptures and leaks blood into surrounding areas. As a result, some of the connecting nerve cells die, and the person commonly suffers partial paralysis on one side of the body, termed hemiplegia. Cells killed in this way cannot regrow, but the brain has some spare capacity and, hence, new connections can be made. The brain is continually and rapidly changing as new skills are learned, new connections are formed, and redundant ones disappear. A person who relearns skills after a stroke goes through the same process as someone learning to play tennis or a baby learning to walk, requiring sensory feedback during the repeated practice of a task. Unfortunately, the problem is that they can hardly move and, therefore, do not receive feedback on their performance.

[1]  A. Hill The heat of shortening and the dynamic constants of muscle , 1938 .

[2]  A. Fugl-Meyer,et al.  The post-stroke hemiplegic patient. 1. a method for evaluation of physical performance. , 1975, Scandinavian journal of rehabilitation medicine.

[3]  R. Lyle A performance test for assessment of upper limb function in physical rehabilitation treatment and research , 1981, International journal of rehabilitation research. Internationale Zeitschrift fur Rehabilitationsforschung. Revue internationale de recherches de readaptation.

[4]  Suguru Arimoto,et al.  Bettering operation of Robots by learning , 1984, J. Field Robotics.

[5]  L. A. Bernotas,et al.  A Discrete-Time Model of Electrcally Stimulated Muscle , 1986, IEEE Transactions on Biomedical Engineering.

[6]  Neville Hogan,et al.  Robust control of dynamically interacting systems , 1988 .

[7]  H.J. Chizeck,et al.  Robust closed-loop control of isometric muscle force using pulsewidth modulation , 1988, IEEE Transactions on Biomedical Engineering.

[8]  Milos R. Popovic,et al.  Functional Electrical Stimulation. , 2006, Artificial organs.

[9]  W. Durfee,et al.  Methods for estimating isometric recruitment curves of electrically stimulated muscle , 1989, IEEE Transactions on Biomedical Engineering.

[10]  M. Solomonow,et al.  The dynamic response model of nine different skeletal muscles , 1990, IEEE Transactions on Biomedical Engineering.

[11]  H.J. Chizeck,et al.  Feedback regulation of hand grasp opening and contact force during stimulation of paralyzed muscle , 1991, IEEE Transactions on Biomedical Engineering.

[12]  P. Crago,et al.  Feedback control of electrically stimulated muscle using simultaneous pulse width and stimulus period modulation , 1991, IEEE Transactions on Biomedical Engineering.

[13]  P. Crago,et al.  Nonlinear joint angle control for artificially stimulated muscle , 1992, IEEE Transactions on Biomedical Engineering.

[14]  P. Stratford,et al.  Reliability of the Fugl-Meyer assessment for testing motor performance in patients following stroke. , 1993, Physical therapy.

[15]  Ning Lan,et al.  Neural network generation of muscle stimulation patterns for control of arm movements , 1994 .

[16]  W. Durfee,et al.  Estimation of force-activation, force-length, and force-velocity properties in isolated, electrically stimulated muscle , 1994, IEEE Transactions on Biomedical Engineering.

[17]  R Happee,et al.  The control of shoulder muscles during goal directed movements, an inverse dynamic analysis. , 1992, Journal of biomechanics.

[18]  E. Rogers,et al.  Iterative learning control using optimal feedback and feedforward actions , 1996 .

[19]  M Munih,et al.  Feedback control of unsupported standing in paraplegia--part I: optimal control approach. , 1997, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[20]  Daniel Graupe,et al.  Neural network control of neuromuscular stimulation in paraplegics for independent ambulation , 1997, Proceedings of the 19th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 'Magnificent Milestones and Emerging Opportunities in Medical Engineering' (Cat. No.97CH36136).

[21]  Neurological Physiotherapy A problem-solving approach , 1997 .

[22]  J. Quintern,et al.  A physiologically based model of muscle activation verified by electrical stimulation , 1997 .

[23]  M. Munih,et al.  Investigation of the Hammerstein hypothesis in the modeling of electrically stimulated muscle , 1998, IEEE Transactions on Biomedical Engineering.

[24]  R Riener,et al.  Patient-driven control of FES-supported standing up: a simulation study. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[25]  N. Hogan,et al.  Robot-aided neurorehabilitation. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[26]  R. Zorowitz,et al.  Electromyogram-triggered neuromuscular stimulation for improving the arm function of acute stroke survivors: a randomized pilot study. , 1998, Archives of physical medicine and rehabilitation.

[27]  M. Popovic,et al.  Tuning of a nonanalytical hierarchical control system for reaching with FES , 1998, IEEE Transactions on Biomedical Engineering.

[28]  B J Andrews,et al.  Computer simulation of FES standing up in paraplegia: a self-adaptive fuzzy controller with reinforcement learning. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[29]  Richard A. Magill,et al.  Motor Learning. Concepts and Applications , 1998 .

[30]  A J Thompson,et al.  Measuring change in disability after inpatient rehabilitation: comparison of the responsiveness of the Barthel Index and the Functional Independence Measure , 1999, Journal of neurology, neurosurgery, and psychiatry.

[31]  S Hesse,et al.  Locomotor therapy in neurorehabilitation. , 2001, NeuroRehabilitation.

[32]  M. Ladouceur,et al.  Clinical and Therapeutic Applications of Neuromuscular Stimulation: A Review of Current Use and Speculation into Future Developments , 2001, Neuromodulation : journal of the International Neuromodulation Society.

[33]  Henrik Gollee,et al.  Robust control of electrically-stimulated muscle using polynomial H∞ design , 2001 .

[34]  R. Riener,et al.  Model-based control of FES-induced single joint movements , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[35]  M. Ferrarin,et al.  A pilot study of myoelectrically controlled FES of upper extremity , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[36]  Zoubin Ghahramani,et al.  Perspectives and problems in motor learning , 2001, Trends in Cognitive Sciences.

[37]  Ning Lan Stability analysis for postural control in a two-joint limb system , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[38]  Maarten J. IJzerman,et al.  Therapeutic electrical stimulation to improve motor control and functional abilities of the upper extremity after stroke: a systematic review , 2002, Clinical rehabilitation.

[39]  A. Geurts,et al.  Motor recovery after stroke: a systematic review of the literature. , 2002, Archives of physical medicine and rehabilitation.

[40]  Emanuele Carpanzano,et al.  Design of a gain scheduling controller for knee-joint angle control by using functional electrical stimulation , 2003, IEEE Trans. Control. Syst. Technol..

[41]  R. Teasell,et al.  An Evidence-Based Review of Stroke Rehabilitation , 2003, Topics in stroke rehabilitation.

[42]  Nozomu Hoshimiya,et al.  A method of multichannel PID control of two-degree-of-freedom wrist joint movements by functional electrical stimulation , 2003, Systems and Computers in Japan.

[43]  D N Rushton,et al.  Functional electrical stimulation and rehabilitation--an hypothesis. , 2003, Medical engineering & physics.

[44]  C. Winstein,et al.  A randomized controlled comparison of upper-extremity rehabilitation strategies in acute stroke: A pilot study of immediate and long-term outcomes. , 2004, Archives of physical medicine and rehabilitation.

[45]  Sergio M. Savaresi,et al.  Data-driven control design for neuroprotheses: a virtual reference feedback tuning (VRFT) approach , 2004, IEEE Transactions on Control Systems Technology.

[46]  G. Chard International Classification of Functioning, Disability and Health , 2004 .

[47]  Thierry Keller,et al.  Sliding mode closed-loop control of FES controlling the shank movement , 2004, IEEE Transactions on Biomedical Engineering.

[48]  Maarten J. IJzerman,et al.  Relation between stimulation characteristics and clinical outcome in studies using electrical stimulation to improve motor control of the upper extremity in stroke. , 2005, Journal of rehabilitation medicine.

[49]  Eric Rogers,et al.  P‐type iterative learning control for systems that contain resonance , 2005 .

[50]  A.G. Alleyne,et al.  A survey of iterative learning control , 2006, IEEE Control Systems.

[51]  D. Howard,et al.  Artificial Neural Network Prediction Using Accelerometers to Control Upper Limb FES During Reaching and Grasping Following Stroke , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[52]  P. Langhorne,et al.  Electrostimulation for promoting recovery of movement or functional ability after stroke , 2006 .

[53]  Maarten J. IJzerman,et al.  Systematic review of the effect of robot-aided therapy on recovery of the hemiparetic arm after stroke. , 2006, Journal of rehabilitation research and development.

[54]  J. Mizrahi,et al.  Partition Between Volitional and Induced Forces in Electrically Augmented Dynamic Isometric Muscle Contractions , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[55]  David H. Owens,et al.  Newton method based iterative learning control for discrete non-linear systems , 2006 .

[56]  A. Boonen,et al.  The international classification for functioning, disability and health , 2007, Clinical Rheumatology.

[57]  W. T. Ang,et al.  Functional electrical stimulation in rehabilitation engineering: a survey , 2007, i-CREATe '07.

[58]  G. P. Braz,et al.  Designing an FES Control Algorithm: Important Considerations , 2007 .

[59]  Kevin L. Moore,et al.  Iterative Learning Control: Brief Survey and Categorization , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[60]  H. Krebs,et al.  Effects of Robot-Assisted Therapy on Upper Limb Recovery After Stroke: A Systematic Review , 2008, Neurorehabilitation and neural repair.

[61]  Maarten J. IJzerman,et al.  Electrical stimulation of the upper extremity in stroke: cyclic versus EMG-triggered stimulation , 2008, Clinical rehabilitation.

[62]  Jörg Raisch,et al.  Iterativ Lernende Regelung einer Gang-Neuroprothese Iterative Learning Control of a Gait Neuroprosthesis , 2008, Autom..

[63]  Eric Rogers,et al.  Iterative learning control for a non-minimum phase plant based on a reference shift algorithm , 2008 .

[64]  M. Schoone-Harmsen,et al.  Robot-mediated ACtive REhabilitation (ACRE2) for the hemiplegic upper limb after a stroke: A pilot study , 2008 .

[65]  W. Harwin,et al.  The effect of the GENTLE/s robot-mediated therapy system on arm function after stroke , 2008, Clinical rehabilitation.

[66]  E. Rogers,et al.  Feasibility of Iterative Learning Control Mediated by Functional Electrical Stimulation for Reaching After Stroke , 2009, Neurorehabilitation and neural repair.

[67]  P H Chappell,et al.  A robotic workstation for stroke rehabilitation of the upper extremity using FES. , 2009, Medical engineering & physics.

[68]  Eric Rogers,et al.  Iterative learning control of FES applied to the upper extremity for rehabilitation , 2009 .

[69]  Vincent S. Huang,et al.  Robotic neurorehabilitation: a computational motor learning perspective , 2009, Journal of NeuroEngineering and Rehabilitation.

[70]  Ann-Marie Hughes,et al.  A model of the upper extremity using FES for stroke rehabilitation. , 2009, Journal of biomechanical engineering.

[71]  P H Chappell,et al.  Shoulder and elbow muscle activity during fully supported trajectory tracking in people who have had a stroke. , 2010, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[72]  Eric Rogers,et al.  Identification of electrically stimulated muscle models of stroke patients , 2010 .

[73]  D. Wolpert,et al.  Motor learning , 2010, Current Biology.

[74]  Eric Rogers,et al.  Functional electrical stimulation mediated by iterative learning control and 3D robotics reduces motor impairment in chronic stroke , 2011, Journal of NeuroEngineering and Rehabilitation.

[75]  Eric Rogers,et al.  Iterative Learning Control for Multiple Point-to-Point Tracking Application , 2011, IEEE Transactions on Control Systems Technology.

[76]  Eric Rogers,et al.  Recursive Identification of Hammerstein Systems , 2011 .

[77]  Eric Rogers,et al.  Phase-lead iterative learning control algorithms for functional electrical stimulation-based stroke rehabilitation , 2011 .

[78]  Thomas Seel,et al.  Iterative Learning Control for Variable Pass Length Systems , 2011 .

[79]  Eric Rogers,et al.  Stroke participants' perceptions of robotic and electrical stimulation therapy: a new approach , 2011, Disability and rehabilitation. Assistive technology.

[80]  Masayoshi Tomizuka,et al.  A Gait Rehabilitation Strategy Inspired by an Iterative Learning Algorithm , 2011 .

[81]  Eric Rogers,et al.  Recursive identification of Hammerstein systems with application to electrically stimulated muscle , 2012 .

[82]  Masayoshi Tomizuka,et al.  A gait rehabilitation strategy inspired by an iterative learning algorithm , 2012 .