Classification of EMG signals to control a prosthetic hand using time-frequesncy representations and Support Vector Machines

Myoelectric signals (MES) are viable control signals for externally-powered prosthetic devices. They may improve both the functionality and the cosmetic appearance of these devices. Conventional controllers, based on the signal's amplitude features in the control strategy, lack a large number of controllable states because signals from independent muscles are required for each degree of freedom (DoF) of the device. Myoelectric pattern recognition systems can overcome this problem by discriminating different residual muscle movements instead of contraction levels of individual muscles. However, the lack of long-term robustness in these systems and the design of counterintuitive control/command interfaces have resulted in low clinical acceptance levels. As a result, the development of robust, easy to use myoelectric pattern recognition-based control systems is the main challenge in the field of prosthetic control. This dissertation addresses the need to improve the controller's robustness by designing a pattern recognition-based control system that classifies the user's intention to actuate the prosthesis. This system is part of a cost-effective prosthetic hand prototype developed to achieve an acceptable level of functional dexterity using a simple to use interface. A Support Vector Machine (SVM) classifier implemented as a directed acyclic graph (DAG) was created. It used wavelet features from multiple surface EMG channels strategically placed over five forearm muscles. The classifiers were evaluated across seven subjects. They were able to discriminate five wrist motions with an accuracy of

[1]  Alireza Khadivi,et al.  SEMG classification for upper-limb prosthesis control using higher order statistics , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[2]  A Kossev,et al.  Discharge pattern of human motor units during dynamic concentric and eccentric contractions. , 1998, Electroencephalography and clinical neurophysiology.

[3]  D. Farina,et al.  Estimation of single motor unit conduction velocity from surface electromyogram signals detected with linear electrode arrays , 2001, Medical and Biological Engineering and Computing.

[4]  R.N. Scott,et al.  The application of neural networks to myoelectric signal analysis: a preliminary study , 1990, IEEE Transactions on Biomedical Engineering.

[5]  A. H. Bottomley MYO-ELECTRIC CONTROL OF POWERED PROSTHESES. , 1965, The Journal of bone and joint surgery. British volume.

[6]  O. Fokapu,et al.  Automatic identification of motor unit action potential trains from electromyographic signals using fuzzy techniques , 2003, Medical and Biological Engineering and Computing.

[7]  D Graupe,et al.  Stochastic analysis of myoelectric temporal signatures for multifunctional single-site activation of prostheses and orthoses. , 1985, Journal of biomedical engineering.

[8]  Alcimar Soares,et al.  The Development of a Virtual Myoelectric Prosthesis Controlled by an EMG Pattern Recognition System Based on Neural Networks , 2004, Journal of Intelligent Information Systems.

[9]  G. Inbar,et al.  Autoregressive Modeling of Surface EMG and Its Spectrum with Application to Fatigue , 1987, IEEE Transactions on Biomedical Engineering.

[10]  Winnie Jensen,et al.  Relationship between grasping force and features of single-channel intramuscular EMG signals , 2009, Journal of Neuroscience Methods.

[11]  S Onyshko,et al.  A low-power multichannel electromyographic signal data acquisition system. , 1987, Journal of medical engineering & technology.

[12]  M. Swiontkowski Targeted Muscle Reinnervation for Real-time Myoelectric Control of Multifunction Artificial Arms , 2010 .

[13]  Carlo J. De Luca,et al.  Physiology and Mathematics of Myoelectric Signals , 1979 .

[14]  Shin-Ki Kim,et al.  A Supervised Feature-Projection-Based Real-Time EMG Pattern Recognition for Multifunction Myoelectric Hand Control , 2007, IEEE/ASME Transactions on Mechatronics.

[15]  J. Clarys,et al.  Electromyography and the study of sports movements: a review. , 1993, Journal of sports sciences.

[16]  G. Kejlaa,et al.  Consumer concerns and the functional value of prostheses to upper limb amputees , 1993, Prosthetics and orthotics international.

[17]  R. N. Scott,et al.  A three-state myo-electric control , 1966, Medical and biological engineering.

[18]  R.N. Scott,et al.  A new strategy for multifunction myoelectric control , 1993, IEEE Transactions on Biomedical Engineering.

[19]  Blair A. Lock,et al.  Adaptive Pattern Recognition of Myoelectric Signals: Exploration of Conceptual Framework and Practical Algorithms , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  Nitish V. Thakor,et al.  Decoding of Individuated Finger Movements Using Surface Electromyography , 2009, IEEE Transactions on Biomedical Engineering.

[21]  R. N. Scott,et al.  Error rate in five-state myoelectric control systems , 2006, Medical and Biological Engineering and Computing.

[22]  Anders Fuglsang-Frederiksen,et al.  EMG power spectrum, turns-amplitude analysis and motor unit potential duration in neuromuscular disorders , 1990, Journal of the Neurological Sciences.

[23]  Kevin Englehart,et al.  Continuous multifunction myoelectric control using pattern recognition , 2003 .

[24]  K.B. Englehart,et al.  Multiple Binary Classifications via Linear Discriminant Analysis for Improved Controllability of a Powered Prosthesis , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[25]  R.Fff. Weir,et al.  A heuristic fuzzy logic approach to EMG pattern recognition for multifunctional prosthesis control , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[26]  Kathryn Ziegler-Graham,et al.  Estimating the prevalence of limb loss in the United States: 2005 to 2050. , 2008, Archives of physical medicine and rehabilitation.

[27]  Han-Pang Huang,et al.  Recognition of Electromyographic Signals Using Cascaded Kernel Learning Machine , 2007, IEEE/ASME Transactions on Mechatronics.

[28]  Jaap H van Dieën,et al.  Methodological aspects of SEMG recordings for force estimation--a tutorial and review. , 2010, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[29]  B. Bigland-ritchie,et al.  Conduction velocity and EMG power spectrum changes in fatigue of sustained maximal efforts. , 1981, Journal of applied physiology: respiratory, environmental and exercise physiology.

[30]  Bruce C. Wheeler,et al.  EMG feature evaluation for movement control of upper extremity prostheses , 1995 .

[31]  Hideo Nakamura,et al.  The application of independent component analysis to the multi-channel surface electromyographic signals for separation of motor unit action potential trains: part I-measuring techniques. , 2004, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[32]  Dario Farina,et al.  Decoding the neural drive to muscles from the surface electromyogram , 2010, Clinical Neurophysiology.

[33]  Ronald S. Lefever,et al.  A Procedure for Decomposing the Myoelectric Signal Into Its Constituent Action Potentials - Part I: Technique, Theory, and Implementation , 1982, IEEE Transactions on Biomedical Engineering.

[34]  Roberto Merletti,et al.  Control of Powered Upper Limb Prostheses , 2004 .

[35]  Zeynep Erim,et al.  Decomposition of Intramuscular EMG Signals Using a Heuristic Fuzzy Expert System , 2008, IEEE Transactions on Biomedical Engineering.

[36]  S Morimoto,et al.  Discharge properties of human motor units during sustained contraction at low level force. , 2001, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[37]  K. Raichle,et al.  Prosthesis use in persons with lower- and upper-limb amputation. , 2008, Journal of rehabilitation research and development.

[38]  Francesco Felici Neuromuscular responses to exercise investigated through surface EMG. , 2006, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[39]  Alberto Rainoldi,et al.  Applications in Rehabilitation Medicine and Related Fields , 2004 .

[40]  Ian D. Walker,et al.  Myoelectric teleoperation of a complex robotic hand , 1996, IEEE Trans. Robotics Autom..

[41]  S. Micera,et al.  Classification of upper arm EMG signals during object-specific grasp , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[42]  D F Stegeman,et al.  Recent progress in the diagnostic use of surface EMG for neurological diseases. , 2000, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[43]  Yousef Al-Assaf,et al.  Surface Myoelectric Signal Analysis: Dynamic Approaches for Change Detection and Classification , 2006, IEEE Transactions on Biomedical Engineering.

[44]  A. Willsky,et al.  Upper Extremity Limb Function Discrimination Using EMG Signal Analysis , 1983, IEEE Transactions on Biomedical Engineering.

[45]  Guanglin Li,et al.  Principal Components Analysis Preprocessing for Improved Classification Accuracies in Pattern-Recognition-Based Myoelectric Control , 2009, IEEE Transactions on Biomedical Engineering.

[46]  Alexander Adam,et al.  A simulation study for a surface EMG sensor that detects distinguishable motor unit action potentials , 2008, Journal of Neuroscience Methods.

[47]  C. K. Battye,et al.  The use of myo-electric currents in the operation of prostheses. , 1955, The Journal of bone and joint surgery. British volume.

[48]  P H Chappell,et al.  The Southampton Hand: an intelligent myoelectric prosthesis. , 1994, Journal of rehabilitation research and development.

[49]  Ronald S. Lefever,et al.  A Procedure for Decomposing the Myoelectric Signal Into Its Constituent Action Potentials-Part II: Execution and Test for Accuracy , 1982, IEEE Transactions on Biomedical Engineering.

[50]  Alan W. L. Chiu,et al.  Control of Prosthetic Device Using Support Vector Machine Signal Classification Technique , 2009 .

[51]  Giulio Sandini,et al.  Multi-subject/daily-life activity EMG-based control of mechanical hands , 2009, Journal of NeuroEngineering and Rehabilitation.

[52]  Huosheng Hu,et al.  Myoelectric control systems - A survey , 2007, Biomed. Signal Process. Control..

[53]  C M Light,et al.  Intelligent multifunction myoelectric control of hand prostheses , 2002, Journal of medical engineering & technology.

[54]  Mehran Jahed,et al.  Real-time intelligent pattern recognition algorithm for surface EMG signals , 2007, Biomedical engineering online.

[55]  R. Merletti,et al.  Surface EMG signal processing during isometric contractions. , 1997, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[56]  D. Childress,et al.  Design and evaluation of a prosthesis control system based on the concept of extended physiological proprioception. , 1984, Journal of rehabilitation research and development.

[57]  K Søgaard,et al.  An analysis of motor unit firing pattern during sustained low force contraction in fatigued muscle. , 2001, Acta physiologica et pharmacologica Bulgarica.

[58]  Roberto Merletti,et al.  Biophysics of the Generation of EMG Signals , 2004 .

[59]  A G Cresswell,et al.  Recruitment of single human low-threshold motor units with increasing loads at different muscle lengths. , 2004, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[60]  Roberto Merletti,et al.  The extraction of neural strategies from the surface EMG. , 2004, Journal of applied physiology.

[61]  Kevin B. Englehart,et al.  A wavelet-based continuous classification scheme for multifunction myoelectric control , 2001, IEEE Transactions on Biomedical Engineering.

[62]  Gyu-Ha Choe,et al.  A Study on the Control System of Myoelectric Hand Prosthesis , 2007 .

[63]  George N. Saridis,et al.  EMG Pattern Analysis and Classification for a Prosthetic Arm , 1982, IEEE Transactions on Biomedical Engineering.

[64]  J P Clarys,et al.  Electromyography in sports and occupational settings: an update of its limits and possibilities , 2000, Ergonomics.

[65]  D. Farina,et al.  Analysis of motor units with high-density surface electromyography. , 2008, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[66]  L. Lindstrom,et al.  Signal Processing for the Multistate Myoelectric Channel , 1977 .

[67]  H Al-Nashash,et al.  Surface myoelectric signal classification for prostheses control , 2005, Journal of medical engineering & technology.

[68]  Zhizeng Luo,et al.  Pattern Classification of Surface Electromyography Based on AR Model and High-order Neural Network , 2006, 2006 2nd IEEE/ASME International Conference on Mechatronics and Embedded Systems and Applications.

[69]  J E Paciga,et al.  Clinical evaluation of UNB 3-state myoelectric control for arm prostheses. , 1980, Bulletin of prosthetics research.

[70]  Bruce C. Wheeler,et al.  EMG FEATURE SELECTION FOR MOVEMENT CONTROL OF A CYBERNETIC ARM , 1995 .

[71]  Daniel Graupe,et al.  Functional Separation of EMG Signals via ARMA Identification Methods for Prosthesis Control Purposes , 1975, IEEE Transactions on Systems, Man, and Cybernetics.

[72]  Patrick van der Smagt,et al.  Surface EMG in advanced hand prosthetics , 2008, Biological Cybernetics.

[73]  Isahaq Abdullahi Chronic Pelvic Pain (Diagnosis and Treatment) , 2010 .

[74]  D Graupe,et al.  Multifunctional prosthesis and orthosis control via microcomputer identification of temporal pattern differences in single-site myoelectric signals. , 1982, Journal of biomedical engineering.

[75]  Dario Farina,et al.  Analysis of intramuscular electromyogram signals , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[76]  Zhizhong Wang,et al.  Classification of surface EMG signal using relative wavelet packet energy , 2005, Comput. Methods Programs Biomed..

[77]  M. Akay,et al.  Enhancement of spectral analysis of myoelectric signals during static contractions using wavelet methods , 1999, IEEE Transactions on Biomedical Engineering.

[78]  S. Riek,et al.  Recruitment of motor units in human forearm extensors. , 1992, Journal of neurophysiology.

[79]  Roberto Merletti,et al.  Basic Physiology and Biophysics of EMG Signal Generation , 2004 .

[80]  Joshua C. Kline,et al.  Decomposition of surface EMG signals. , 2006, Journal of neurophysiology.

[81]  S. Krishnan,et al.  Real-Time Classification of Forearm Electromyographic Signals Corresponding to User-Selected Intentional Movements for Multifunction Prosthesis Control , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[82]  Yoshikazu Ugawa,et al.  The effects of cerebellar stimulation on the motor cortical excitability in neurological disorders: A review , 2008, The Cerebellum.

[83]  Katsunori Shimohara,et al.  EMG pattern analysis and classification by neural network , 1989, Conference Proceedings., IEEE International Conference on Systems, Man and Cybernetics.

[84]  F. Mechler,et al.  Electrophysiological findings including single fibre EMG in a family with mitochondrial myopathy , 1982, Journal of the Neurological Sciences.

[85]  T. Kuiken,et al.  Quantifying Pattern Recognition—Based Myoelectric Control of Multifunctional Transradial Prostheses , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[86]  R N Scott,et al.  Multistate myoelectric control: the feasibility of 5-state control. , 1983 .

[87]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[88]  B Hudgins,et al.  Myoelectric signal processing for control of powered limb prostheses. , 2006, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[89]  P. Dario,et al.  Control of multifunctional prosthetic hands by processing the electromyographic signal. , 2002, Critical reviews in biomedical engineering.

[90]  R.N. Scott,et al.  Two-channel enhancement of a multifunction control system , 1995, IEEE Transactions on Biomedical Engineering.

[91]  D. Farina,et al.  Estimating motor unit discharge patterns from high-density surface electromyogram , 2009, Clinical Neurophysiology.

[92]  Dario Farina,et al.  Concentric-ring electrode systems for noninvasive detection of single motor unit activity , 2001, IEEE Transactions on Biomedical Engineering.

[93]  Gabriella Balestra,et al.  Computer analysis of the myoelectric signal , 1991, IEEE Micro.

[94]  E. Mackenzie,et al.  Limb Amputation and Limb Deficiency: Epidemiology and Recent Trends in the United States , 2002, Southern medical journal.

[95]  Dennis C. Tkach,et al.  Study of stability of time-domain features for electromyographic pattern recognition , 2010, Journal of NeuroEngineering and Rehabilitation.

[96]  E. Biddiss,et al.  Upper limb prosthesis use and abandonment: A survey of the last 25 years , 2007, Prosthetics and orthotics international.

[97]  Alexander Adam,et al.  Recruitment order of motor units in human vastus lateralis muscle is maintained during fatiguing contractions. , 2003, Journal of neurophysiology.

[98]  D Stashuk,et al.  EMG signal decomposition: how can it be accomplished and used? , 2001, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[99]  C. D. De Luca,et al.  Behaviour of human motor units in different muscles during linearly varying contractions , 1982, The Journal of physiology.

[100]  M. Osman Tokhi,et al.  A fuzzy clustering neural network architecture for multifunction upper-limb prosthesis , 2003, IEEE Transactions on Biomedical Engineering.

[101]  Kevin B. Englehart,et al.  A robust, real-time control scheme for multifunction myoelectric control , 2003, IEEE Transactions on Biomedical Engineering.

[102]  Richard T. Johnson,et al.  Development of the Utah Artificial Arm , 1982, IEEE Transactions on Biomedical Engineering.