Classification of Electromyographic Signals: Comparing Evolvable Hardware to Conventional Classifiers

Evolvable hardware (EHW) has shown itself to be a promising approach for prosthetic hand controllers. Besides competitive classification performance, EHW classifiers offer self-adaptation, fast training, and a compact implementation. However, EHW classifiers have not yet been sufficiently compared to state-of-the-art conventional classifiers. In this paper, we compare two EHW approaches to four conventional classification techniques: k-nearest-neighbor, decision trees, artificial neural networks, and support vector machines. We provide all classifiers with features extracted from electromyographic signals taken from forearm muscle contractions, and let the algorithms recognize eight to eleven different kinds of hand movements. We investigate classification accuracy on a fixed data set and stability of classification error rates when new data is introduced. For this purpose, we have recorded a short-term data set from three individuals over three consecutive days and a long-term data set from a single individual over three weeks. Experimental results demonstrate that EHW approaches are indeed able to compete with state-of-the-art classifiers in terms of classification performance.

[1]  Marco D. Santambrogio,et al.  A direct bitstream manipulation approach for Virtex4-based evolvable systems , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[2]  Bruce C. Wheeler,et al.  EMG feature evaluation for movement control of upper extremity prostheses , 1995 .

[3]  Mehrdad Salami,et al.  Data Compression for Digital Color Electrophotographic Printer with Evolvable Hardware , 1998, ICES.

[4]  S Micera,et al.  A hybrid approach to EMG pattern analysis for classification of arm movements using statistical and fuzzy techniques. , 1999, Medical engineering & physics.

[5]  Moritoshi Yasunaga,et al.  An Online EHW Pattern Recognition System Applied to Sonar Spectrum Classification , 2007, ICES.

[6]  Isamu Kajitani,et al.  Variable length chromosome GA for evolvable hardware , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[7]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[8]  Marimuthu Palaniswami,et al.  Incremental training of support vector machines , 2005, IEEE Transactions on Neural Networks.

[9]  Daniel Graupe,et al.  Functional Separation of EMG Signals via ARMA Identification Methods for Prosthesis Control Purposes , 1975, IEEE Transactions on Systems, Man, and Cybernetics.

[10]  John Weiner,et al.  Letter to the Editor , 1992, SIGIR Forum.

[11]  Taro Nakamura,et al.  Genetic Algorithm-Based Methodology for Pattern Recognition Hardware , 2000, ICES.

[12]  Marco Platzner,et al.  EvoCaches: Application-specific Adaptation of Cache Mappings , 2009, 2009 NASA/ESA Conference on Adaptive Hardware and Systems.

[13]  Marco Platzner,et al.  Advanced techniques for the creation and propagation of modules in cartesian genetic programming , 2008, GECCO '08.

[14]  John R. Koza,et al.  Routine high-return human-competitive evolvable hardware , 2004, Proceedings. 2004 NASA/DoD Conference on Evolvable Hardware, 2004..

[15]  Julian F. Miller,et al.  Designing Electronic Circuits Using Evolutionary Algorithms. Arithmetic Circuits: A Case Study , 2007 .

[16]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[17]  Moritoshi Yasunaga,et al.  An Online EHW Pattern Recognition System Applied to Face Image Recognition , 2009, EvoWorkshops.

[18]  P. Dario,et al.  Control of multifunctional prosthetic hands by processing the electromyographic signal. , 2002, Critical reviews in biomedical engineering.

[19]  Christophe G. Giraud-Carrier,et al.  A Note on the Utility of Incremental Learning , 2000, AI Commun..

[20]  Jim Torresen,et al.  Incremental evolution of a signal classification hardware architecture for prosthetic hand control , 2008, Int. J. Knowl. Based Intell. Eng. Syst..

[21]  J. Laidlaw,et al.  ANATOMY OF THE HUMAN BODY , 1967, The Ulster Medical Journal.

[22]  Jerome H. Friedman,et al.  On Bias, Variance, 0/1—Loss, and the Curse-of-Dimensionality , 2004, Data Mining and Knowledge Discovery.

[23]  Marco Platzner,et al.  MOVES: A Modular Framework for Hardware Evolution , 2007, Second NASA/ESA Conference on Adaptive Hardware and Systems (AHS 2007).

[24]  Jim Tørresen Evolving both Hardware Subsystems and the Selection of Variants of such into an Assembled System , 2002, ESM.

[25]  Jim Tørresen,et al.  A Scalable Approach to Evolvable Hardware , 2002, Genetic Programming and Evolvable Machines.

[26]  Kyrre Glette,et al.  Intermediate Level FPGA Reconfiguration for an Online EHW Pattern Recognition System , 2009, 2009 NASA/ESA Conference on Adaptive Hardware and Systems.

[27]  A.D.C. Chan,et al.  Optimized Gaussian mixture models for upper limb motion classification , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[28]  P. A. Parker,et al.  Improving myoelectric signal classification using wavelet packets and principal components analysis , 1999, Proceedings of the First Joint BMES/EMBS Conference. 1999 IEEE Engineering in Medicine and Biology 21st Annual Conference and the 1999 Annual Fall Meeting of the Biomedical Engineering Society (Cat. N.

[29]  Aiko M. Hormann,et al.  Programs for Machine Learning. Part I , 1962, Inf. Control..

[30]  Davide Anguita,et al.  A digital architecture for support vector machines: theory, algorithm, and FPGA implementation , 2003, IEEE Trans. Neural Networks.

[31]  Wenwei Yu,et al.  EMG prosthetic hand controller discriminating ten motions using real-time learning method , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[32]  P J Sparto,et al.  Wavelet and short-time Fourier transform analysis of electromyography for detection of back muscle fatigue. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[33]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[34]  Raúl Rojas,et al.  Neural Networks - A Systematic Introduction , 1996 .

[35]  F. K. Lam,et al.  Fuzzy EMG classification for prosthesis control. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[36]  Seppo J. Ovaska,et al.  So near and yet so far: New insight into properties of some well-known classifier paradigms , 2010, Inf. Sci..

[37]  C. Giraud-Carrier,et al.  A Constructive Incremental Learning Algorithm for Binary Classification Tasks , 2006, 2006 IEEE Mountain Workshop on Adaptive and Learning Systems.

[38]  Marco Platzner,et al.  Coping with Resource Fluctuations: The Run-time Reconfigurable Functional Unit Row Classifier Architecture , 2010, ICES.

[39]  Shin-Ki Kim,et al.  A Supervised Feature-Projection-Based Real-Time EMG Pattern Recognition for Multifunction Myoelectric Hand Control , 2007, IEEE/ASME Transactions on Mechatronics.

[40]  Rajesh P. N. Rao,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. 1 Online Electromyographic Control of a Robotic , 2022 .

[41]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[42]  Hugo de Garis,et al.  EVOLVABLE HARDWARE Genetic Programming of a Darwin Machine , 1993 .

[43]  Chih-Jen Lin,et al.  A Comparison of Methods for Multi-class Support Vector Machines , 2015 .

[44]  Lukas Sekanina,et al.  DESIGN OF THE SPECIAL FAST RECONFIGURABLE CHIP USING COMMON FPGA , 2001 .

[45]  Adrian D. C. Chan,et al.  Continuous myoelectric control for powered prostheses using hidden Markov models , 2005, IEEE Transactions on Biomedical Engineering.

[46]  Hitoshi Iba,et al.  Evolvable Hardware and Its Applications to Pattern Recognition and Fault-Tolerant Systems , 1995, Towards Evolvable Hardware.

[47]  Blair A. Lock,et al.  A Real-Time Pattern Recognition Based Myoelectric Control Usability Study Implemented in a Virtual Environment , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[48]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[49]  Ian D. Walker,et al.  Myoelectric teleoperation of a complex robotic hand , 1996, IEEE Trans. Robotics Autom..

[50]  Patrick van der Smagt,et al.  Learning EMG control of a robotic hand: towards active prostheses , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[51]  Pedro M. Domingos A Unified Bias-Variance Decomposition for Zero-One and Squared Loss , 2000, AAAI/IAAI.

[52]  Marco Platzner,et al.  A Comparison of Evolvable Hardware Architectures for Classification Tasks , 2008, ICES.

[53]  F. Finley,et al.  Myocoder studies of multiple myopotential response. , 1967, Archives of physical medicine and rehabilitation.

[54]  Hitoshi Iba,et al.  Evolving hardware with genetic learning: a first step towards building a Darwin machine , 1993 .

[55]  Hiroshi Yokoi,et al.  A Gate-Level EHW Chip: Implementing GA Operations and Reconfigurable Hardware on a Single LSI , 1998, ICES.

[56]  Guruprasad Madhavan,et al.  Electromyography: Physiology, Engineering and Non-Invasive Applications , 2005, Annals of Biomedical Engineering.

[57]  Isamu Kajitani,et al.  Hardware Evolution at Function Level , 1996, PPSN.

[58]  Hiroshi Yokoi,et al.  An evolvable hardware chip for prosthetic hand controller , 1999, Proceedings of the Seventh International Conference on Microelectronics for Neural, Fuzzy and Bio-Inspired Systems.

[59]  Roberto Merletti,et al.  Control of Powered Upper Limb Prostheses , 2004 .

[60]  P. Herberts Myoelectric signals in control of prostheses. Studies on arm amputees and normal individuals. , 1969, Acta orthopaedica Scandinavica.

[61]  I. Yoshihara,et al.  Evolvable sonar spectrum discrimination chip designed by genetic algorithm , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[62]  M. Osman Tokhi,et al.  A fuzzy clustering neural network architecture for multifunction upper-limb prosthesis , 2003, IEEE Transactions on Biomedical Engineering.

[63]  S H Park,et al.  EMG pattern recognition based on artificial intelligence techniques. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[64]  Lukás Sekanina,et al.  Evolutionary Design Space Exploration for Median Circuits , 2004, EvoWorkshops.

[65]  A. E. Kobrinski,et al.  Problems of bioelectric control , 1960 .

[66]  Jim Torresen,et al.  Two-Step Incremental Evolution of a Prosthetic Hand Controller Based on Digital Logic Gates , 2001, ICES.

[67]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[68]  Lutz Hamel,et al.  Knowledge Discovery with Support Vector Machines , 2009 .

[69]  Kevin B. Englehart,et al.  A wavelet-based continuous classification scheme for multifunction myoelectric control , 2001, IEEE Transactions on Biomedical Engineering.

[70]  Elias S. Manolakos,et al.  IP-cores design for the kNN classifier , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[71]  Kevin B. Englehart,et al.  A robust, real-time control scheme for multifunction myoelectric control , 2003, IEEE Transactions on Biomedical Engineering.

[72]  Marco Platzner,et al.  Towards multi-movement hand prostheses: Combining adaptive classification with high precision sockets , 2009 .

[73]  Gunnar Tufte,et al.  Biologically-Inspired: A Rule-Based Self-Reconfiguration of a Virtex Chip , 2004, International Conference on Computational Science.

[74]  Ingo Mierswa,et al.  YALE: rapid prototyping for complex data mining tasks , 2006, KDD '06.

[75]  Julian Francis Miller,et al.  Evolution and Acquisition of Modules in Cartesian Genetic Programming , 2004, EuroGP.

[76]  Klaus-Robert Müller,et al.  Incremental Support Vector Learning: Analysis, Implementation and Applications , 2006, J. Mach. Learn. Res..

[77]  Finley Fr,et al.  Myocoder studies of multiple myopotential response. , 1967 .

[78]  P. A. Parker,et al.  Time-frequency based classification of the myoelectric signal: static vs. dynamic contractions , 2000, Proceedings of the 22nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Cat. No.00CH37143).

[79]  Vasant Honavar,et al.  Learn++: an incremental learning algorithm for supervised neural networks , 2001, IEEE Trans. Syst. Man Cybern. Part C.

[80]  Jun Yu,et al.  Time-frequency analysis of myoelectric signals during dynamic contractions: a comparative study , 2000, IEEE Transactions on Biomedical Engineering.

[81]  Han-Pang Huang,et al.  EMG classification for prehensile postures using cascaded architecture of neural networks with self-organizing maps , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[82]  Andres Upegui,et al.  Evolving Hardware by Dynamically Reconfiguring Xilinx FPGAs , 2005, ICES.

[83]  Marco Platzner,et al.  Comparing Evolvable Hardware to Conventional Classifiers for Electromyographic Prosthetic Hand Control , 2008, 2008 NASA/ESA Conference on Adaptive Hardware and Systems.

[84]  Hua-feng Chen,et al.  A parallel and scalable digital architecture for training support vector machines , 2009, Journal of Zhejiang University SCIENCE C.

[85]  R. N. Scott,et al.  A three-state myo-electric control , 1966, Medical and biological engineering.

[86]  R.N. Scott,et al.  A new strategy for multifunction myoelectric control , 1993, IEEE Transactions on Biomedical Engineering.

[87]  Moritoshi Yasunaga,et al.  Online Evolution for a High-Speed Image Recognition System Implemented On a Virtex-II Pro FPGA , 2007, Second NASA/ESA Conference on Adaptive Hardware and Systems (AHS 2007).