Bilinear Modeling of EMG Signals to Extract User-Independent Features for Multiuser Myoelectric Interface

In this study, we propose a multiuser myoelectric interface that can easily adapt to novel users. When a user performs different motions (e.g., grasping and pinching), different electromyography (EMG) signals are measured. When different users perform the same motion (e.g., grasping), different EMG signals are also measured. Therefore, designing a myoelectric interface that can be used by multiple users to perform multiple motions is difficult. To cope with this problem, we propose for EMG signals a bilinear model that is composed of two linear factors:1) user dependent and 2) motion dependent. By decomposing the EMG signals into these two factors, the extracted motion-dependent factors can be used as user-independent features. We can construct a motion classifier on the extracted feature space to develop the multiuser interface. For novel users, the proposed adaptation method estimates the user-dependent factor through only a few interactions. The bilinear EMG model with the estimated user-dependent factor can extract the user-independent features from the novel user data. We applied our proposed method to a recognition task of five hand gestures for robotic hand control using four-channel EMG signals measured from subject forearms. Our method resulted in 73% accuracy, which was statistically significantly different from the accuracy of standard non-multiuser interfaces, as the result of a two-sample t-test at a significance level of 1%.

[1]  Rajesh P. N. Rao,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. 1 Online Electromyographic Control of a Robotic , 2022 .

[2]  Joshua B. Tenenbaum,et al.  Separating Style and Content with Bilinear Models , 2000, Neural Computation.

[3]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[4]  Frank W. Jobe,et al.  EMG analysis of the scapular muscles during a shoulder rehabilitation program , 1992, The American journal of sports medicine.

[5]  Jun Morimoto,et al.  Learning Stylistic Dynamic Movement Primitives from multiple demonstrations , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Jun Morimoto,et al.  Real-time stylistic prediction for whole-body human motions , 2012, Neural Networks.

[7]  Patrick van der Smagt,et al.  Learning EMG control of a robotic hand: towards active prostheses , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[8]  Jun Morimoto,et al.  Full-body exoskeleton robot control for walking assistance by style-phase adaptive pattern generation , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Jun Morimoto,et al.  XoR: Hybrid drive exoskeleton robot that can balance , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  David J. Fleet,et al.  Multifactor Gaussian process models for style-content separation , 2007, ICML '07.

[11]  Daniel Graupe,et al.  Functional Separation of EMG Signals via ARMA Identification Methods for Prosthesis Control Purposes , 1975, IEEE Transactions on Systems, Man, and Cybernetics.

[12]  Hiroshi Yokoi,et al.  Real-time Learning Method for Adaptable Motion-Discrimination using Surface EMG Signal , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Adel Al-Jumaily,et al.  Orthogonal Fuzzy Neighborhood Discriminant Analysis for Multifunction Myoelectric Hand Control , 2010, IEEE Transactions on Biomedical Engineering.

[14]  H. Kawamoto,et al.  Power assist method for HAL-3 using EMG-based feedback controller , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[15]  Charles Jorgensen,et al.  Gestures as Input: Neuroelectric Joysticks and Keyboards , 2003, IEEE Pervasive Comput..

[16]  Bruce C. Wheeler,et al.  EMG feature evaluation for movement control of upper extremity prostheses , 1995 .

[17]  Junuk Chu,et al.  A Real-Time EMG Pattern Recognition System Based on Linear-Nonlinear Feature Projection for a Multifunction Myoelectric Hand , 2006, IEEE Transactions on Biomedical Engineering.

[18]  Adrian D. C. Chan,et al.  Continuous myoelectric control for powered prostheses using hidden Markov models , 2005, IEEE Transactions on Biomedical Engineering.

[19]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[20]  H. H. Sears,et al.  PROPORTIONAL MYOELECTRIC HAND CONTROL: AN EVALUATION , 1991, American journal of physical medicine & rehabilitation.

[21]  T. Kuiken,et al.  Quantifying Pattern Recognition—Based Myoelectric Control of Multifunctional Transradial Prostheses , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  Kazuyo Tanaka,et al.  A myoelectric interface for robotic hand control using support vector machine , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  K.B. Englehart,et al.  Multiple Binary Classifications via Linear Discriminant Analysis for Improved Controllability of a Powered Prosthesis , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[24]  R.N. Scott,et al.  The application of neural networks to myoelectric signal analysis: a preliminary study , 1990, IEEE Transactions on Biomedical Engineering.

[25]  F. K. Lam,et al.  Fuzzy EMG classification for prosthesis control. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[26]  Marty Robinson.  Proportional Control - True Physiological Control - , 1995 .

[27]  Jun Morimoto,et al.  Extraction of latent kinematic relationships between human users and assistive robots , 2012, 2012 IEEE International Conference on Robotics and Automation.

[28]  R.N. Scott,et al.  A new strategy for multifunction myoelectric control , 1993, IEEE Transactions on Biomedical Engineering.

[29]  Giulio Sandini,et al.  Model adaptation with least-squares SVM for adaptive hand prosthetics , 2009, 2009 IEEE International Conference on Robotics and Automation.

[30]  Bernd Freisleben,et al.  HaWCoS: the "hands-free" wheelchair control system , 2002, ASSETS.

[31]  Toshio Tsuji,et al.  EMG-based human-robot interface for rehabilitation aid , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[32]  Jun Morimoto,et al.  Learning and adaptation of a Stylistic Myoelectric Interface: EMG-based robotic control with individual user differences , 2011, 2011 IEEE International Conference on Robotics and Biomimetics.

[33]  Adrian D. C. Chan,et al.  A Gaussian mixture model based classification scheme for myoelectric control of powered upper limb prostheses , 2005, IEEE Transactions on Biomedical Engineering.

[34]  D Graupe,et al.  Multifunctional prosthesis and orthosis control via microcomputer identification of temporal pattern differences in single-site myoelectric signals. , 1982, Journal of biomedical engineering.

[35]  Chih-Jen Lin,et al.  A Comparison of Methods for Multi-class Support Vector Machines , 2015 .

[36]  Tanja Schultz,et al.  Towards continuous speech recognition using surface electromyography , 2006, INTERSPEECH.

[37]  Bruce C. Wheeler,et al.  Evaluation of emg features for movement control of prostheses , 1993, Proceedings of the 15th Annual International Conference of the IEEE Engineering in Medicine and Biology Societ.

[38]  Adrian D. C. Chan,et al.  Myoelectric Control Development Toolbox , 2007 .

[39]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .