Role of Muscle Synergies in Real-Time Classification of Upper Limb Motions using Extreme Learning Machines

BackgroundMyoelectric signals offer significant insights in interpreting the motion intention and extent of effort involved in performing a movement, with application in prostheses, orthosis and exoskeletons. Feature extraction plays a vital role, and follows two approaches: EMG and synergy features. More recently, muscle synergy based features are being increasingly explored, since it simplifies dimensionality of control, and are considered to be more robust to signal variations. Another important aspect in a myoelectrically controlled devices is the learning capability and speed of performance for online decoding. Extreme learning machine (ELM) is a relatively new neural-network based learning algorithm: its performance hasn’t been explored in the context of online control, which is a more reliable measure compared to offline analysis. To this purpose we aim at focusing our investigation on a myoelectric-based interface which is able to identify and online classify, upper limb motions involving shoulder and elbow. The main objective is to compare the performance of the decoder trained using ELM, for two different features: EMG and synergy features.MethodsThe experiments are broadly divided in two phases training/calibration and testing respectively. ELM is used to train the decoder using data acquired during the calibration phase. The performance of the decoder is then tested in online motion control by using a simulated graphical user interface replicating the human limb: subjects are requested to control a virtual arm by using their muscular activity. The decoder performance is quantified using ad-hoc metrics based on the following indicators: motion selection time, motion completion time, and classification accuracy.ResultsPerformance has been evaluated for both offline and online contexts. The offline classification results indicated better performance in the case of EMG features, whereas a better classification accuracy for synergy feature was observed for online decoding. Also the other indicators as motion selection time and motion completion time, showed better trend in the case of synergy than time-domain features.ConclusionThis work demonstrates better robustness of online decoding of upper-limb motions and motor intentions when using synergy feature. Furthermore, we have quantified the performance of the decoder trained using ELM for online control, providing a potential and viable option for real-time myoelectric control in assistive technology.

[1]  Erik Cambria,et al.  Sentiment Data Flow Analysis by Means of Dynamic Linguistic Patterns , 2015, IEEE Computational Intelligence Magazine.

[2]  Bernard Widrow,et al.  New Trends of Learning in Computational Intelligence [Guest Editorial] , 2015, IEEE Comput. Intell. Mag..

[3]  Leonardo Cappello,et al.  A series elastic composite actuator for soft arm exosuits , 2015, 2015 IEEE International Conference on Rehabilitation Robotics (ICORR).

[4]  A. Geurts,et al.  Definition dependent properties of the cortical silent period in upper-extremity muscles, a methodological study , 2014, Journal of NeuroEngineering and Rehabilitation.

[5]  Erik Cambria,et al.  Towards an intelligent framework for multimodal affective data analysis , 2015, Neural Networks.

[6]  N.V. Thakor,et al.  Towards the Control of Individual Fingers of a Prosthetic Hand Using Surface EMG Signals , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[7]  Lauren H Smith,et al.  A comparison of the real-time controllability of pattern recognition to conventional myoelectric control for discrete and simultaneous movements , 2012, Journal of NeuroEngineering and Rehabilitation.

[8]  F Previdi,et al.  Iteratively Learning Electromyography (EMG)-based Functional Electrical Stimulation (FES) for Stroke Rehabilitation , 2012, Biomedizinische Technik. Biomedical engineering.

[9]  Andrea d'Avella,et al.  Matrix factorization algorithms for the identification of muscle synergies: evaluation on simulated and experimental data sets. , 2006, Journal of neurophysiology.

[10]  B Hudgins,et al.  Myoelectric signal processing for control of powered limb prostheses. , 2006, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[11]  P. Dario,et al.  Control of multifunctional prosthetic hands by processing the electromyographic signal. , 2002, Critical reviews in biomedical engineering.

[12]  Ya-Hsin Hsueh,et al.  An EMG Feedback Control Functional Electrical Stimulation Cycling System , 2011, J. Signal Process. Syst..

[13]  Leonardo Cappello,et al.  Control implementation of compliant composite material actuators for wearable robotic exoskeleton , 2015, 2015 IEEE International Conference on Rehabilitation Robotics (ICORR).

[14]  Judith Redi,et al.  Circular-ELM for the reduced-reference assessment of perceived image quality , 2013, Neurocomputing.

[15]  Michael J. Black,et al.  Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegia , 2008, Journal of neural engineering.

[16]  Panagiotis Artemiadis,et al.  A hybrid BMI-based exoskeleton for paresis: EMG control for assisting arm movements , 2017, Journal of neural engineering.

[17]  Silvestro Micera,et al.  On the Shared Control of an EMG-Controlled Prosthetic Hand: Analysis of User–Prosthesis Interaction , 2008, IEEE Transactions on Robotics.

[18]  David G Lloyd,et al.  Neuromusculoskeletal modeling: estimation of muscle forces and joint moments and movements from measurements of neural command. , 2004, Journal of applied biomechanics.

[19]  Dario Farina,et al.  Extracting Signals Robust to Electrode Number and Shift for Online Simultaneous and Proportional Myoelectric Control by Factorization Algorithms , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  Panagiotis K. Artemiadis,et al.  EMG-Based Position and Force Estimates in Coupled Human-Robot Systems: Towards EMG-Controlled Exoskeletons , 2008, ISER.

[21]  Bernard Widrow,et al.  New Trends of Learning in Computational Intelligence (Part II) [Guest Editorial] , 2015, IEEE Comput. Intell. Mag..

[22]  Dario Farina,et al.  Is Accurate Mapping of EMG Signals on Kinematics Needed for Precise Online Myoelectric Control? , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[23]  Stacie A. Chvatal,et al.  Decomposing Muscle Activity in Motor TasksMethods and Interpretation , 2010 .

[24]  Nicola Vitiello,et al.  Intention-Based EMG Control for Powered Exoskeletons , 2012, IEEE Transactions on Biomedical Engineering.

[25]  B. Hudgins,et al.  REAL-TIME MYOELECTRIC CONTROL IN A VIRTUAL ENVIRONMENT TO RELATE USABILITY VS. ACCURACY , 2005 .

[26]  Dario Farina,et al.  Influence of the training set on the accuracy of surface EMG classification in dynamic contractions for the control of multifunction prostheses , 2011, Journal of NeuroEngineering and Rehabilitation.

[27]  Dario Farina,et al.  Effect of arm position on the prediction of kinematics from EMG in amputees , 2012, Medical & Biological Engineering & Computing.

[28]  Ferat Sahin,et al.  Camera control with EMG signals using Principal Component Analysis and support vector machines , 2011, 2011 IEEE International Systems Conference.

[29]  Chi Zhu,et al.  Power assistance for human elbow motion support using minimal EMG signals with admittance control , 2011, 2011 IEEE International Conference on Mechatronics and Automation.

[30]  Francesco Lacquaniti,et al.  Control of Fast-Reaching Movements by Muscle Synergy Combinations , 2006, The Journal of Neuroscience.

[31]  Giulio Sandini,et al.  Multi-subject/daily-life activity EMG-based control of mechanical hands , 2009, Journal of NeuroEngineering and Rehabilitation.

[32]  E. Bizzi,et al.  Muscle synergy patterns as physiological markers of motor cortical damage , 2012, Proceedings of the National Academy of Sciences.

[33]  Erik Cambria,et al.  Muscle synergies for reliable classification of arm motions using myoelectric interface , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[34]  T. Kuiken,et al.  Quantifying Pattern Recognition—Based Myoelectric Control of Multifunctional Transradial Prostheses , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[35]  Enrico Pagello,et al.  Modeling the Human Knee for Assistive Technologies , 2012, IEEE Transactions on Biomedical Engineering.

[36]  Günter Hommel,et al.  A Human--Exoskeleton Interface Utilizing Electromyography , 2008, IEEE Transactions on Robotics.

[37]  Paolo Gastaldo,et al.  An ELM-based model for affective analogical reasoning , 2015, Neurocomputing.

[38]  Sundaram Suresh,et al.  A Meta-Cognitive Learning Algorithm for an Extreme Learning Machine Classifier , 2013, Cognitive Computation.

[39]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[40]  Fei Wang,et al.  SEMG-based hand motion recognition using cumulative residual entropy and extreme learning machine , 2012, Medical & Biological Engineering & Computing.

[41]  Angkoon Phinyomark,et al.  EMG feature evaluation for improving myoelectric pattern recognition robustness , 2013, Expert Syst. Appl..

[42]  Yoshiaki Hayashi,et al.  An EMG-Based Control for an Upper-Limb Power-Assist Exoskeleton Robot , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[43]  Dario Farina,et al.  Identifying representative synergy matrices for describing muscular activation patterns during multidirectional reaching in the horizontal plane. , 2010, Journal of neurophysiology.

[44]  Patrick van der Smagt,et al.  EMG-based teleoperation and manipulation with the DLR LWR-III , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[45]  Sijiang Du,et al.  Temporal vs. spectral approach to feature extraction from prehensile EMG signals , 2004, Proceedings of the 2004 IEEE International Conference on Information Reuse and Integration, 2004. IRI 2004..

[46]  Panagiotis K. Artemiadis,et al.  A Switching Regime Model for the EMG-Based Control of a Robot Arm , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[47]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[48]  Guang-Bin Huang,et al.  Trends in extreme learning machines: A review , 2015, Neural Networks.

[49]  Dennis C. Tkach,et al.  Study of stability of time-domain features for electromyographic pattern recognition , 2010, Journal of NeuroEngineering and Rehabilitation.

[50]  Panagiotis Artemiadis,et al.  Embedded Human Control of Robots Using Myoelectric Interfaces , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[51]  M. Goldfarb,et al.  A Method for the Control of Multigrasp Myoelectric Prosthetic Hands , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[52]  Francesco Piazza,et al.  Acoustic template-matching for automatic emergency state detection: An ELM based algorithm , 2015, Neurocomputing.

[53]  Desney S. Tan,et al.  Demonstrating the feasibility of using forearm electromyography for muscle-computer interfaces , 2008, CHI.

[54]  Huosheng Hu,et al.  Myoelectric control systems - A survey , 2007, Biomed. Signal Process. Control..