Simultaneous Multi-Joint Myoelectric Control of Transradial Prostheses

By Christopher L. Pulliam As the development of dexterous prosthetic hand and wrist units continues, there is a need for command interfaces that will enable a user to operate these multijoint devices in a natural, coordinated manner. Commercially available myoelectric control algorithms are unintuitive, allow only a single degree of freedom to be operated at a time, and typically require some type of a mode switch to transition between operating the various functions of the system. Pattern recognition-based control algorithms take advantage of distinct patterns of activity related to the intuitive movements of the missing limb, thus reducing the cognitive burden associated with traditional control methods. To date, however, the majority of these advanced approaches still limit users to sequential operation of the various prosthesis functions. This project aimed to develop an intuitive myoelectric command interface that would allow multiple joints (forearm pronation-supination, wrist flexion-extension, and hand opening-closing) of a transradial prosthesis to be controlled in a highly coordinated fashion. We demonstrated than a time-delayed artificial neural network controller could be trained to accurately predict motions of several key hand and wrist motions using myoelectric signals recorded from muscles in the forearm offline. The controller was then evaluated in real-time during simulations of several tasks in a virtual

[1]  Philip R. Troyk,et al.  Implantable Myoelectric Sensors (IMESs) for Intramuscular Electromyogram Recording , 2009, IEEE Transactions on Biomedical Engineering.

[2]  Daniel McDonnall,et al.  Implantable multichannel wireless electromyography for prosthesis control , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[3]  R. Magill Motor learning and control : concepts and applications , 2004 .

[4]  T Laurell,et al.  Myoelectric control of a computer animated hand: A new concept based on the combined use of a tree-structured artificial neural network and a data glove , 2006, Journal of medical engineering & technology.

[5]  Michael J. Black,et al.  Modeling and decoding motor cortical activity using a switching Kalman filter , 2004, IEEE Transactions on Biomedical Engineering.

[6]  D. Farina,et al.  Simultaneous and Proportional Estimation of Hand Kinematics From EMG During Mirrored Movements at Multiple Degrees-of-Freedom , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  Amar R. Marathe Improved decoding for brain-machine interfaces for continuous movement control , 2011 .

[8]  Kevin B. Englehart,et al.  A robust, real-time control scheme for multifunction myoelectric control , 2003, IEEE Transactions on Biomedical Engineering.

[9]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[10]  E. Biddiss,et al.  Upper-Limb Prosthetics: Critical Factors in Device Abandonment , 2007, American journal of physical medicine & rehabilitation.

[11]  M. Swiontkowski Targeted Muscle Reinnervation for Real-time Myoelectric Control of Multifunction Artificial Arms , 2010 .

[12]  W.M. Grill,et al.  Evaluation of command algorithms for control of upper-extremity neural prostheses , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  D. Reinkensmeyer,et al.  Alterations in reaching after stroke and their relation to movement direction and impairment severity. , 2002, Archives of physical medicine and rehabilitation.

[14]  R. Hébert,et al.  Validation of the Box and Block Test as a measure of dexterity of elderly people: reliability, validity, and norms studies. , 1994, Archives of physical medicine and rehabilitation.

[15]  J. G. Hincapie,et al.  Musculoskeletal Model-Guided, Customizable Selection of Shoulder and Elbow Muscles for a C5 SCI Neuroprosthesis , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[16]  C. Jurgensen Extension of the Minnesota Rate of Manipulation Test. , 1943 .

[17]  R.N. Scott,et al.  The application of neural networks to myoelectric signal analysis: a preliminary study , 1990, IEEE Transactions on Biomedical Engineering.

[18]  F. K. Lam,et al.  Fuzzy EMG classification for prosthesis control. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[19]  R. Kirsch,et al.  EMG-based prediction of shoulder and elbow kinematics in able-bodied and spinal cord injured individuals. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[20]  J. Cram,et al.  Introduction to Surface Electromyography , 1998 .

[21]  B Wodlinger,et al.  Selective recovery of fascicular activity in peripheral nerves , 2011, Journal of neural engineering.

[22]  J. L. Bérubé,et al.  Digital myoelectric signal processor with adaptive decision boundaries , 2006, Medical and Biological Engineering and Computing.

[23]  K. Kilgore,et al.  An implanted upper-extremity neuroprosthesis using myoelectric control. , 2008, The Journal of hand surgery.

[24]  R. Kobetic,et al.  Development of an implanted intramuscular EMG-triggered FES system for ambulation after incomplete spinal cord injury , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[25]  G. Cheron,et al.  A dynamic neural network identification of electromyography and arm trajectory relationship during complex movements , 1996, IEEE Transactions on Biomedical Engineering.

[26]  Kevin B. Englehart,et al.  A wavelet-based continuous classification scheme for multifunction myoelectric control , 2001, IEEE Transactions on Biomedical Engineering.

[27]  R.F. Weir,et al.  The Optimal Controller Delay for Myoelectric Prostheses , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[28]  D Graupe,et al.  A multifunctional prosthesis control system based on time series identification of EMG signals using microprocessors. , 1977, Bulletin of prosthetics research.

[29]  Brian Waryck,et al.  Comparison Of Two Myoelectric Multi-Articulating Prosthetic Hands , 2011 .

[30]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[31]  Helen Y N Lindner,et al.  Assessment of capacity for myoelectric control: evaluation of construct and rating scale. , 2009, Journal of rehabilitation medicine.

[32]  John M. Miguelez CLINICAL EXPERIENCES WITH THE MICHELANGELO HAND, A FOUR-YEAR REVIEW , 2011 .

[33]  Linda Resnik,et al.  Using virtual reality environment to facilitate training with advanced upper-limb prosthesis. , 2011, Journal of rehabilitation research and development.

[34]  Robert F. Kirsch,et al.  CONTINUOUS AND SIMULTANEOUS EMG-BASED NEURAL NETWORK CONTROL OF TRANSRADIAL PROSTHESES , 2011 .

[35]  Joris M. Lambrecht,et al.  Electromyogram-based neural network control of transhumeral prostheses. , 2011, Journal of rehabilitation research and development.

[36]  A R Marathe,et al.  Decoding position, velocity, or goal: does it matter for brain-machine interfaces? , 2011, Journal of neural engineering.

[37]  T. Kuiken,et al.  Quantifying Pattern Recognition—Based Myoelectric Control of Multifunctional Transradial Prostheses , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[38]  Y. Al-Ajam,et al.  The Use of a Bone-Anchored Device as a Hard-Wired Conduit for Transmitting EMG Signals From Implanted Muscle Electrodes , 2013, IEEE Transactions on Biomedical Engineering.

[39]  R.N. Scott,et al.  A new strategy for multifunction myoelectric control , 1993, IEEE Transactions on Biomedical Engineering.

[40]  R.Fff. Weir,et al.  A heuristic fuzzy logic approach to EMG pattern recognition for multifunctional prosthesis control , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[41]  Kathryn Ziegler-Graham,et al.  Estimating the prevalence of limb loss in the United States: 2005 to 2050. , 2008, Archives of physical medicine and rehabilitation.

[42]  N. P. Reddy,et al.  Toward direct biocontrol using surface EMG signals: control of finger and wrist joint models. , 2007, Medical engineering & physics.

[43]  Wei Wu,et al.  Bayesian Population Decoding of Motor Cortical Activity Using a Kalman Filter , 2006, Neural Computation.

[44]  R.F. Kirsch,et al.  Evaluation of Head Orientation and Neck Muscle EMG Signals as Command Inputs to a Human–Computer Interface for Individuals With High Tetraplegia , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[45]  Erik J. Scheme,et al.  Validation of a Selective Ensemble-Based Classification Scheme for Myoelectric Control Using a Three-Dimensional Fitts' Law Test , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[46]  Todd A Kuiken,et al.  Target Achievement Control Test: evaluating real-time myoelectric pattern-recognition control of multifunctional upper-limb prostheses. , 2011, Journal of rehabilitation research and development.

[47]  L. Philipson Adaptable myoelectric prosthetic control with functional visual feedback using microprocessor techniques , 2006, Medical and Biological Engineering and Computing.

[48]  K. Englehart,et al.  Resolving the Limb Position Effect in Myoelectric Pattern Recognition , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[49]  C. Light,et al.  Establishing a standardized clinical assessment tool of pathologic and prosthetic hand function: normative data, reliability, and validity. , 2002, Archives of physical medicine and rehabilitation.

[50]  R E Kass,et al.  Recursive bayesian decoding of motor cortical signals by particle filtering. , 2004, Journal of neurophysiology.

[51]  C. K. van der Sluis,et al.  Learning to control opening and closing a myoelectric hand. , 2010, Archives of physical medicine and rehabilitation.

[52]  Levi J. Hargrove,et al.  A Comparison of Surface and Intramuscular Myoelectric Signal Classification , 2007, IEEE Transactions on Biomedical Engineering.

[53]  Edward Shwedyk,et al.  Sequential Multistate EMG Signal Processor , 1979, IEEE Transactions on Biomedical Engineering.

[54]  J. Hollerbach,et al.  Time-varying stiffness of human elbow joint during cyclic voluntary movement , 2005, Experimental Brain Research.

[55]  Sher ry Folsom-Meek,et al.  Human Performance , 2020, Nature.

[56]  George N. Saridis,et al.  EMG Pattern Analysis and Classification for a Prosthetic Arm , 1982, IEEE Transactions on Biomedical Engineering.

[57]  Robert E. Kass,et al.  Comparison of brain–computer interface decoding algorithms in open-loop and closed-loop control , 2010, Journal of Computational Neuroscience.

[58]  Dario Farina,et al.  Simultaneous and Proportional Force Estimation for Multifunction Myoelectric Prostheses Using Mirrored Bilateral Training , 2011, IEEE Transactions on Biomedical Engineering.

[59]  A. Eliasson,et al.  Assessment of capacity for myoelectric control: a new Rasch-built measure of prosthetic hand control. , 2005, Journal of rehabilitation medicine.

[60]  V. Mathiowetz,et al.  Adult norms for the Box and Block Test of manual dexterity. , 1985, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[61]  L. Resnik,et al.  Advanced upper limb prosthetic devices: implications for upper limb prosthetic rehabilitation. , 2012, Archives of physical medicine and rehabilitation.

[62]  Robert D. Lipschutz,et al.  The use of targeted muscle reinnervation for improved myoelectric prosthesis control in a bilateral shoulder disarticulation amputee , 2004, Prosthetics and orthotics international.

[63]  O Bock,et al.  Evidence for processing stages in skill acquisition: a dual-task study. , 2001, Learning & memory.

[64]  G.S. Dhillon,et al.  Direct neural sensory feedback and control of a prosthetic arm , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[65]  W. Kirchner Age differences in short-term retention of rapidly changing information. , 1958, Journal of experimental psychology.

[66]  Ashok Muzumdar Powered upper limb prostheses : control, implementation and clinical application , 2004 .

[67]  Sally Adee,et al.  The revolution will be prosthetized , 2009, IEEE Spectrum.