A robust model-based neural-machine interface across different loading weights applied at distal forearm

Abstract Musculoskeletal models (MMs) have recently been proposed to decode electromyography (EMG) signals for movement intent recognition. Since the robustness is critical to retain the performance of neural-machine interface (NMI) during daily activities and the loading weight change is one of the critical factors that would affect the performance of NMI, this study aimed to further investigate the robustness of a generic MM-based NMI across different loading conditions. Eight able-bodied (AB) individuals and one individual with a transradial amputation were recruited and tested while performing a real-time virtual wrist/hand posture matching task under different loading weights (AB subjects: 0 kg, 0.567 kg, and 1.134 kg; amputee subject: 0 kg and 0.567 kg) applied at the distal forearm. All tasks were achieved by both AB individuals and the individual with the transradial amputation. There was no significant difference among the real-time performance (completion time, the number of overshoots, and path efficiency) of AB individuals under different loading conditions. We calculated the average muscle activations of each muscle during the initial 0.5 s and last 0.5 s respectively for each target across all subjects and trials. The analysis of muscle activations showed that additional weights caused muscle co-contractions. However, the subjects can cope with the increased muscle co-activation level, modifying muscle activation patterns, and still complete tasks successfully. We obtained similar results from the individual with the transradial amputation. These results demonstrated the robustness of MM-based NMI across different loading conditions. The outcomes indicate the potential of the multi-user NMI toward practical applications.

[1]  Kianoush Nazarpour,et al.  Model-Based Control of Individual Finger Movements for Prosthetic Hand Function , 2020, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[2]  Oluwarotimi Williams Samuel,et al.  Towards resolving the co-existing impacts of multiple dynamic factors on the performance of EMG-pattern recognition based prostheses , 2019, Comput. Methods Programs Biomed..

[3]  Dario Farina,et al.  The Extraction of Neural Information from the Surface EMG for the Control of Upper-Limb Prostheses: Emerging Avenues and Challenges , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[4]  F. P. Kendall,et al.  Muscles, testing and function , 1971 .

[5]  Dario Farina,et al.  User adaptation in Myoelectric Man-Machine Interfaces , 2017, Scientific Reports.

[6]  Todd A. Kuiken,et al.  An Analysis of Intrinsic and Extrinsic Hand Muscle EMG for Improved Pattern Recognition Control , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  Dario Farina,et al.  Intuitive, Online, Simultaneous, and Proportional Myoelectric Control Over Two Degrees-of-Freedom in Upper Limb Amputees , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  Xinjun Sheng,et al.  User adaptation in long-term, open-loop myoelectric training: implications for EMG pattern recognition in prosthesis control , 2015, Journal of neural engineering.

[9]  Todd A. Kuiken,et al.  The Effects of Electrode Size and Orientation on the Sensitivity of Myoelectric Pattern Recognition Systems to Electrode Shift , 2011, IEEE Transactions on Biomedical Engineering.

[10]  J. Winters Hill-Based Muscle Models: A Systems Engineering Perspective , 1990 .

[11]  Levi J Hargrove,et al.  Adapting myoelectric control in real-time using a virtual environment , 2019, Journal of NeuroEngineering and Rehabilitation.

[12]  Levi J. Hargrove,et al.  A training strategy to reduce classification degradation due to electrode displacements in pattern recognition based myoelectric control , 2008, Biomed. Signal Process. Control..

[13]  Dustin L Crouch,et al.  Musculoskeletal model-based control interface mimics physiologic hand dynamics during path tracing task. , 2017, Journal of neural engineering.

[14]  M. Schwartz,et al.  Electromyography Data Processing Impacts Muscle Synergies during Gait for Unimpaired Children and Children with Cerebral Palsy , 2017, Front. Comput. Neurosci..

[15]  M. Ortiz-Catalán,et al.  Treatment of phantom limb pain (PLP) based on augmented reality and gaming controlled by myoelectric pattern recognition: a case study of a chronic PLP patient , 2014, Front. Neurosci..

[16]  L. Hargrove,et al.  Understanding Limb Position and External Load Effects on Real-Time Pattern Recognition Control in Amputees , 2020, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  Erik J. Scheme,et al.  Effects of Confidence-Based Rejection on Usability and Error in Pattern Recognition-Based Myoelectric Control , 2019, IEEE Journal of Biomedical and Health Informatics.

[18]  Panagiotis K. Artemiadis,et al.  EMG-Based Control of a Robot Arm Using Low-Dimensional Embeddings , 2010, IEEE Transactions on Robotics.

[19]  Kevin B. Englehart,et al.  A robust, real-time control scheme for multifunction myoelectric control , 2003, IEEE Transactions on Biomedical Engineering.

[20]  Max Ortiz-Catalan,et al.  An osseointegrated human-machine gateway for long-term sensory feedback and motor control of artificial limbs , 2014, Science Translational Medicine.

[21]  C. Walsh,et al.  Effect of timing of hip extension assistance during loaded walking with a soft exosuit , 2016, Journal of NeuroEngineering and Rehabilitation.

[22]  Hong Liu,et al.  Dynamic training protocol improves the robustness of PR-based myoelectric control , 2017, Biomed. Signal Process. Control..

[23]  D. Farina,et al.  Simultaneous and Proportional Estimation of Hand Kinematics From EMG During Mirrored Movements at Multiple Degrees-of-Freedom , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[24]  Neil M. Bajaj,et al.  State of the art in prosthetic wrists: Commercial and research devices , 2015, 2015 IEEE International Conference on Rehabilitation Robotics (ICORR).

[25]  D. Lloyd,et al.  An EMG-driven musculoskeletal model to estimate muscle forces and knee joint moments in vivo. , 2003, Journal of biomechanics.

[26]  Todd A. Kuiken,et al.  Improving Myoelectric Pattern Recognition Robustness to Electrode Shift by Changing Interelectrode Distance and Electrode Configuration , 2012, IEEE Transactions on Biomedical Engineering.

[27]  Dario Farina,et al.  Robust simultaneous myoelectric control of multiple degrees of freedom in wrist-hand prostheses by real-time neuromusculoskeletal modeling , 2018, Journal of neural engineering.

[28]  Oluwarotimi Williams Samuel,et al.  Intelligent EMG Pattern Recognition Control Method for Upper-Limb Multifunctional Prostheses: Advances, Current Challenges, and Future Prospects , 2019, IEEE Access.

[29]  Xinjun Sheng,et al.  Cascaded Adaptation Framework for Fast Calibration of Myoelectric Control , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[30]  Ning Jiang,et al.  Extracting Simultaneous and Proportional Neural Control Information for Multiple-DOF Prostheses From the Surface Electromyographic Signal , 2009, IEEE Transactions on Biomedical Engineering.

[31]  Adel Al-Jumaily,et al.  A Framework of Temporal-Spatial Descriptors-Based Feature Extraction for Improved Myoelectric Pattern Recognition , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[32]  Oluwarotimi Williams Samuel,et al.  Improving the Robustness of Real-Time Myoelectric Pattern Recognition against Arm Position Changes in Transradial Amputees , 2017, BioMed research international.

[33]  D. Farina,et al.  Spatial Correlation of High Density EMG Signals Provides Features Robust to Electrode Number and Shift in Pattern Recognition for Myocontrol , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[34]  H. Huang,et al.  Lumped-parameter electromyogram-driven musculoskeletal hand model: A potential platform for real-time prosthesis control. , 2016, Journal of biomechanics.

[35]  S. Ahnert,et al.  Corrigendum: Residue Geometry Networks: A Rigidity-Based Approach to the Amino Acid Network and Evolutionary Rate Analysis , 2017, Scientific Reports.

[36]  D. Farina,et al.  Linear and Nonlinear Regression Techniques for Simultaneous and Proportional Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[37]  K. Englehart,et al.  Resolving the Limb Position Effect in Myoelectric Pattern Recognition , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[38]  Dario Farina,et al.  Effect of arm position on the prediction of kinematics from EMG in amputees , 2012, Medical & Biological Engineering & Computing.

[39]  Todd A. Kuiken,et al.  Evaluation of Linear Regression Simultaneous Myoelectric Control Using Intramuscular EMG , 2016, IEEE Transactions on Biomedical Engineering.

[40]  Antonio Frisoli,et al.  An EMG-Controlled Robotic Hand Exoskeleton for Bilateral Rehabilitation , 2015, IEEE Transactions on Haptics.

[41]  Patrick van der Smagt,et al.  EMG-based teleoperation and manipulation with the DLR LWR-III , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[42]  He Huang,et al.  A Reliable Multi-User EMG Interface Based on A Generic-Musculoskeletal Model against Loading Weight Changes * , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[43]  Dimitra Blana,et al.  Real-time simulation of hand motion for prosthesis control , 2017, Computer methods in biomechanics and biomedical engineering.

[44]  Zhan Li,et al.  Real-time estimation of FES-induced joint torque with evoked EMG , 2016, Journal of NeuroEngineering and Rehabilitation.

[45]  Dario Farina,et al.  Context-Dependent Upper Limb Prosthesis Control for Natural and Robust Use , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[46]  Dario Farina,et al.  Simultaneous and Proportional Force Estimation for Multifunction Myoelectric Prostheses Using Mirrored Bilateral Training , 2011, IEEE Transactions on Biomedical Engineering.

[47]  Hui Wang,et al.  Pattern recognition of electromyography signals based on novel time domain features for amputees' limb motion classification , 2017, Comput. Electr. Eng..

[48]  Andrew J. Pullan,et al.  Neuromuscular Interfacing: Establishing an EMG-Driven Model for the Human Elbow Joint , 2012, IEEE Transactions on Biomedical Engineering.

[49]  Ling Liu,et al.  Development of an EMG-ACC-Based Upper Limb Rehabilitation Training System , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[50]  H. Huang,et al.  Comparing EMG-Based Human-Machine Interfaces for Estimating Continuous, Coordinated Movements , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[51]  Winnie Jensen,et al.  Multiday Evaluation of Techniques for EMG-Based Classification of Hand Motions , 2019, IEEE Journal of Biomedical and Health Informatics.

[52]  Ning Jiang,et al.  Efficient correction of armband rotation for myoelectric-based gesture control interface , 2020, Journal of neural engineering.