Real-time robustness evaluation of regression based myoelectric control against arm position change and donning/doffing

There are some practical factors, such as arm position change and donning/doffing, which prevent robust myoelectric control. The objective of this study is to precisely characterize the impacts of the two representative factors on myoelectric controllability in practical control situations, thereby providing useful references that can be potentially used to find better solutions for clinically reliable myoelectric control. To this end, a real-time target acquisition task was performed by fourteen subjects including one individual with congenital upper-limb deficiency, where the impacts of arm position change, donning/doffing and a combination of both factors on control performance was systematically evaluated. The changes in online performance were examined with seven different performance metrics to comprehensively evaluate various aspects of myoelectric controllability. As a result, arm position change significantly affects offline prediction accuracy, but not online control performance due to real-time feedback, thereby showing no significant correlation between offline and online performance. Donning/doffing was still problematic in online control conditions. It was further observed that no benefit was attained when using a control model trained with multiple position data in terms of arm position change, and the degree of electrode shift caused by donning/doffing was not severely associated with the degree of performance loss under practical conditions (around 1 cm electrode shift). Since this study is the first to concurrently investigate the impacts of arm position change and donning/doffing in practical myoelectric control situations, all findings of this study provide new insights into robust myoelectric control with respect to arm position change and donning/doffing.

[1]  Klaus-Robert Müller,et al.  Spatial Filtering for Robust Myoelectric Control , 2012, IEEE Transactions on Biomedical Engineering.

[2]  Blair A. Lock,et al.  Determining the Optimal Window Length for Pattern Recognition-Based Myoelectric Control: Balancing the Competing Effects of Classification Error and Controller Delay , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  Patrick van der Smagt,et al.  Surface EMG in advanced hand prosthetics , 2008, Biological Cybernetics.

[4]  Fan Zhang,et al.  Reduction of the effect of arm position variation on real-time performance of motion classification , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[5]  Ning Jiang,et al.  Extracting Simultaneous and Proportional Neural Control Information for Multiple-DOF Prostheses From the Surface Electromyographic Signal , 2009, IEEE Transactions on Biomedical Engineering.

[6]  Dario Farina,et al.  Improving the Robustness of Myoelectric Pattern Recognition for Upper Limb Prostheses by Covariate Shift Adaptation , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  Dario Farina,et al.  Simultaneous and Proportional Force Estimation for Multifunction Myoelectric Prostheses Using Mirrored Bilateral Training , 2011, IEEE Transactions on Biomedical Engineering.

[8]  Klaus-Robert Müller,et al.  Channel selection for simultaneous and proportional myoelectric prosthesis control of multiple degrees-of-freedom , 2014, Journal of neural engineering.

[9]  Dario Farina,et al.  Extracting Signals Robust to Electrode Number and Shift for Online Simultaneous and Proportional Myoelectric Control by Factorization Algorithms , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  Dario Farina,et al.  Bayesian Filtering of Surface EMG for Accurate Simultaneous and Proportional Prosthetic Control , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[11]  K. Müller,et al.  Finding stationary subspaces in multivariate time series. , 2009, Physical review letters.

[12]  Dario Farina,et al.  User adaptation in Myoelectric Man-Machine Interfaces , 2017, Scientific Reports.

[13]  Ernest Nlandu Kamavuako,et al.  Biomedical Signal Processing and Control , 2022 .

[14]  S. Gandevia,et al.  The effect of sustained low‐intensity contractions on supraspinal fatigue in human elbow flexor muscles , 2006, The Journal of physiology.

[15]  Erik Scheme,et al.  Motion Normalized Proportional Control for Improved Pattern Recognition-Based Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[16]  Levi J. Hargrove,et al.  Classification of Simultaneous Movements Using Surface EMG Pattern Recognition , 2013, IEEE Transactions on Biomedical Engineering.

[17]  Dario Farina,et al.  Is Accurate Mapping of EMG Signals on Kinematics Needed for Precise Online Myoelectric Control? , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  Erik J. Scheme,et al.  Support Vector Regression for Improved Real-Time, Simultaneous Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[19]  Joan Lobo-Prat,et al.  Evaluation of EMG, force and joystick as control interfaces for active arm supports , 2014, Journal of NeuroEngineering and Rehabilitation.

[20]  Guanglin Li,et al.  Toward attenuating the impact of arm positions on electromyography pattern-recognition based motion classification in transradial amputees , 2012, Journal of NeuroEngineering and Rehabilitation.

[21]  Todd A. Kuiken,et al.  The Effects of Electrode Size and Orientation on the Sensitivity of Myoelectric Pattern Recognition Systems to Electrode Shift , 2011, IEEE Transactions on Biomedical Engineering.

[22]  Todd A. Kuiken,et al.  An Analysis of Intrinsic and Extrinsic Hand Muscle EMG for Improved Pattern Recognition Control , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[23]  Ernest Nlandu Kamavuako,et al.  Real-Time, Simultaneous Myoelectric Control Using Force and Position-Based Training Paradigms , 2014, IEEE Transactions on Biomedical Engineering.

[24]  Kevin B. Englehart,et al.  A robust, real-time control scheme for multifunction myoelectric control , 2003, IEEE Transactions on Biomedical Engineering.

[25]  Jaime Valls Miró,et al.  Towards limb position invariant myoelectric pattern recognition using time-dependent spectral features , 2014, Neural Networks.

[26]  Bo Håkansson,et al.  Real-time classification of simultaneous hand and wrist motions using Artificial Neural Networks with variable threshold outputs , 2013, ICANN 2013.

[27]  T Laurell,et al.  Myoelectric control of a computer animated hand: A new concept based on the combined use of a tree-structured artificial neural network and a data glove , 2006, Journal of medical engineering & technology.

[28]  Guanglin Li,et al.  Motion recognition for simultaneous control of multifunctional transradial prostheses , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[29]  I. Stokes,et al.  Relationships of EMG to effort in the trunk under isometric conditions: force-increasing and decreasing effects and temporal delays. , 2005, Clinical biomechanics.

[30]  D. Farina,et al.  Simultaneous and Proportional Estimation of Hand Kinematics From EMG During Mirrored Movements at Multiple Degrees-of-Freedom , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[31]  Dario Farina,et al.  EMG-based simultaneous and proportional estimation of wrist/hand kinematics in uni-lateral trans-radial amputees , 2011, Journal of NeuroEngineering and Rehabilitation.

[32]  Francesco Lacquaniti,et al.  Control of Fast-Reaching Movements by Muscle Synergy Combinations , 2006, The Journal of Neuroscience.

[33]  Levi J Hargrove,et al.  A real-time comparison between direct control, sequential pattern recognition control and simultaneous pattern recognition control using a Fitts’ law style assessment procedure , 2014, Journal of NeuroEngineering and Rehabilitation.

[34]  Todd A. Kuiken,et al.  Improving Myoelectric Pattern Recognition Robustness to Electrode Shift by Changing Interelectrode Distance and Electrode Configuration , 2012, IEEE Transactions on Biomedical Engineering.

[35]  Dario Farina,et al.  Effect of arm position on the prediction of kinematics from EMG in amputees , 2012, Medical & Biological Engineering & Computing.

[36]  Adenike A. Adewuyi,et al.  Resolving the effect of wrist position on myoelectric pattern recognition control , 2017, Journal of NeuroEngineering and Rehabilitation.

[37]  Klaus-Robert Müller,et al.  Introduction to machine learning for brain imaging , 2011, NeuroImage.

[38]  D. Farina,et al.  Linear and Nonlinear Regression Techniques for Simultaneous and Proportional Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[39]  Dario Farina,et al.  Intuitive, Online, Simultaneous, and Proportional Myoelectric Control Over Two Degrees-of-Freedom in Upper Limb Amputees , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[40]  K.B. Englehart,et al.  Multiple Binary Classifications via Linear Discriminant Analysis for Improved Controllability of a Powered Prosthesis , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[41]  K. Englehart,et al.  Classification of the myoelectric signal using time-frequency based representations. , 1999, Medical engineering & physics.

[42]  Levi J. Hargrove,et al.  A training strategy to reduce classification degradation due to electrode displacements in pattern recognition based myoelectric control , 2008, Biomed. Signal Process. Control..

[43]  Erik J. Scheme,et al.  Improving myoelectric pattern recognition positional robustness using advanced training protocols , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[44]  Dario Farina,et al.  Myoelectric Control of Artificial Limbs¿Is There a Need to Change Focus? [In the Spotlight] , 2012, IEEE Signal Process. Mag..

[45]  Dario Farina,et al.  The Extraction of Neural Information from the Surface EMG for the Control of Upper-Limb Prostheses: Emerging Avenues and Challenges , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[46]  Motoaki Kawanabe,et al.  Machine Learning in Non-Stationary Environments - Introduction to Covariate Shift Adaptation , 2012, Adaptive computation and machine learning.

[47]  Dario Farina,et al.  Multichannel electrotactile feedback for simultaneous and proportional myoelectric control , 2016, Journal of neural engineering.

[48]  Todd A. Kuiken,et al.  Evaluating EMG Feature and Classifier Selection for Application to Partial-Hand Prosthesis Control , 2016, Front. Neurorobot..

[49]  P. Fitts The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[50]  Erik Scheme,et al.  Electromyogram pattern recognition for control of powered upper-limb prostheses: state of the art and challenges for clinical use. , 2011, Journal of rehabilitation research and development.

[51]  K. Englehart,et al.  Resolving the Limb Position Effect in Myoelectric Pattern Recognition , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[52]  Bo Håkansson,et al.  Evaluation of classifier topologies for the real-time classification of simultaneous limb motions , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[53]  Janne M. Hahne Machine learning based myoelectric control , 2016 .

[54]  Dario Farina,et al.  Real time simultaneous and proportional control of multiple degrees of freedom from surface EMG: Preliminary results on subjects with limb deficiency , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[55]  Lucas C. Parra,et al.  Concurrent Adaptation of Human and Machine Improves Simultaneous and Proportional Myoelectric Control , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.