Adaptive Switching in Practice: Improving Myoelectric Prosthesis Performance through Reinforcement Learning

Myoelectrically controlled prostheses are a class of assistive device that use electrical signals generated by muscle activation. These electromyographic (EMG) signals are used to control one or more electromechanical actuators that move prosthetic joints. Myoelectric control signals are typically measured with electrodes on the surface of the skin, with one pair of electrodes over each muscle site. In this manner, each muscle site directly controls one motion of the prosthesis, and various methods of switching can be used as needed to control additional motions of the prosthesis [1] [2] [3].

[1]  Stefano Stramigioli,et al.  Myoelectric forearm prostheses: state of the art from a user-centered perspective. , 2011, Journal of rehabilitation research and development.

[2]  S Micera,et al.  Control of Hand Prostheses Using Peripheral Information , 2010, IEEE Reviews in Biomedical Engineering.

[3]  Patrick M. Pilarski,et al.  Horde: a scalable real-time architecture for learning knowledge from unsupervised sensorimotor interaction , 2011, AAMAS.

[4]  Erik Scheme,et al.  Electromyogram pattern recognition for control of powered upper-limb prostheses: state of the art and challenges for clinical use. , 2011, Journal of rehabilitation research and development.

[5]  Richard S. Sutton,et al.  Time-Derivative Models of Pavlovian Reinforcement , 1990 .

[6]  R. S. Sutton,et al.  Dynamic switching and real-time machine learning for improved human control of assistive biomedical robots , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[7]  T Walley Williams,et al.  Progress on stabilizing and controlling powered upper-limb prostheses. , 2011, Journal of rehabilitation research and development.

[8]  Farbod Fahimi,et al.  The Development of a Myoelectric Training Tool for Above-Elbow Amputees , 2012, The open biomedical engineering journal.

[9]  Patrick M. Pilarski,et al.  Real-time prediction learning for the simultaneous actuation of multiple prosthetic joints , 2013, 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR).

[10]  Patrick M. Pilarski,et al.  Temporal-Difference Learning to Assist Human Decision Making during the Control of an Artificial Limb , 2013, ArXiv.

[11]  Patrick M. Pilarski,et al.  Adaptive artificial limbs: a real-time approach to prediction and anticipation , 2013, IEEE Robotics & Automation Magazine.