Adapting myoelectric control in real-time using a virtual environment

BackgroundPattern recognition technology allows for more intuitive control of myoelectric prostheses. However, the need to collect electromyographic data to initially train the pattern recognition system, and to re-train it during prosthesis use, adds complexity that can make using such a system difficult. Although experienced clinicians may be able to guide users to ensure successful data collection methods, they may not always be available when a user needs to (re)train their device.MethodsHere we present an engaging and interactive virtual reality environment for optimal training of a myoelectric controller. Using this tool, we evaluated the importance of training a classifier actively (i.e., moving the residual limb during data collection) compared to passively (i.e., maintaining the limb in a single, neutral orientation), and whether computational adaptation through serious gaming can improve performance.ResultsWe found that actively trained classifiers performed significantly better than passively trained classifiers for non-amputees (P < 0.05). Furthermore, collecting data passively with minimal instruction, paired with computational adaptation in a virtual environment, significantly improved real-time performance of myoelectric controllers.ConclusionThese results further support previous work which suggested active movements during data collection can improve pattern recognition systems. Furthermore, adaptation within a virtual guided serious game environment can improve real-time performance of myoelectric controllers.

[1]  Levi J. Hargrove,et al.  A training strategy to reduce classification degradation due to electrode displacements in pattern recognition based myoelectric control , 2008, Biomed. Signal Process. Control..

[2]  He Huang,et al.  An Analysis of EMG Electrode Configuration for Targeted Muscle Reinnervation Based Neural Machine Interface , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  Kathryn Ziegler-Graham,et al.  Estimating the prevalence of limb loss in the United States: 2005 to 2050. , 2008, Archives of physical medicine and rehabilitation.

[4]  R Hakkert,et al.  Buenos Aires , 2011 .

[5]  Todd A. Kuiken,et al.  A Decision-Based Velocity Ramp for Minimizing the Effect of Misclassifications During Real-Time Pattern Recognition Control , 2011, IEEE Transactions on Biomedical Engineering.

[6]  E. Biddiss,et al.  Upper limb prosthesis use and abandonment: A survey of the last 25 years , 2007, Prosthetics and orthotics international.

[7]  Katya Galactionova,et al.  Modeling the Cost Effectiveness of Malaria Control Interventions in the Highlands of Western Kenya , 2014, PloS one.

[8]  T. Matsushima,et al.  Striatal and Tegmental Neurons Code Critical Signals for Temporal-Difference Learning of State Value in Domestic Chicks , 2016, Front. Neurosci..

[9]  Blair A. Lock,et al.  A Real-Time Pattern Recognition Based Myoelectric Control Usability Study Implemented in a Virtual Environment , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  E. Biddiss,et al.  Upper-Limb Prosthetics: Critical Factors in Device Abandonment , 2007, American journal of physical medicine & rehabilitation.

[11]  Max Ortiz-Catalan,et al.  Offline accuracy: A potentially misleading metric in myoelectric pattern recognition for prosthetic control , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[12]  Raoul M. Bongers,et al.  Virtual Training of the Myosignal , 2015, PloS one.

[13]  Anna T. Winslow,et al.  Evaluation of EMG pattern recognition for upper limb prosthesis control: a case study in comparison with direct myoelectric control , 2018, Journal of NeuroEngineering and Rehabilitation.

[14]  Loredana Zollo,et al.  Literature Review on Needs of Upper Limb Prosthesis Users , 2016, Front. Neurosci..

[15]  Erik Scheme,et al.  Motion Normalized Proportional Control for Improved Pattern Recognition-Based Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[16]  K. Englehart,et al.  Resolving the Limb Position Effect in Myoelectric Pattern Recognition , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  Todd A Kuiken,et al.  Target Achievement Control Test: evaluating real-time myoelectric pattern-recognition control of multifunctional upper-limb prostheses. , 2011, Journal of rehabilitation research and development.

[18]  Guanglin Li,et al.  Toward attenuating the impact of arm positions on electromyography pattern-recognition based motion classification in transradial amputees , 2012, Journal of NeuroEngineering and Rehabilitation.

[19]  Raoul M. Bongers,et al.  Effect of Feedback during Virtual Training of Grip Force Control with a Myoelectric Prosthesis , 2014, PloS one.

[20]  Blair A. Lock,et al.  Determining the Optimal Window Length for Pattern Recognition-Based Myoelectric Control: Balancing the Competing Effects of Classification Error and Controller Delay , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  Liang Chen,et al.  Comparison of electromyography and mechanomyogram in control of prosthetic system in multiple limb positions , 2012, Proceedings of 2012 IEEE-EMBS International Conference on Biomedical and Health Informatics.

[22]  Joris M. Lambrecht,et al.  Virtual Reality Environment for Simulating Tasks With a Myoelectric Prosthesis: An Assessment and Training Tool , 2011, Journal of prosthetics and orthotics : JPO.

[23]  Adrian D. C. Chan,et al.  A Gaussian mixture model based classification scheme for myoelectric control of powered upper limb prostheses , 2005, IEEE Transactions on Biomedical Engineering.

[24]  Kevin B. Englehart,et al.  A robust, real-time control scheme for multifunction myoelectric control , 2003, IEEE Transactions on Biomedical Engineering.

[25]  M. Johnson,et al.  Circulating microRNAs in Sera Correlate with Soluble Biomarkers of Immune Activation but Do Not Predict Mortality in ART Treated Individuals with HIV-1 Infection: A Case Control Study , 2015, PloS one.

[26]  H. de Kroon,et al.  More than 75 percent decline over 27 years in total flying insect biomass in protected areas , 2017, PloS one.

[27]  Lucas C. Parra,et al.  Concurrent Adaptation of Human and Machine Improves Simultaneous and Proportional Myoelectric Control , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[28]  Alex,et al.  Using Augmented Reality Techniques to Simulate Myoelectric Upper Limb Prostheses , 2013 .

[29]  Linda Resnik,et al.  Using virtual reality environment to facilitate training with advanced upper-limb prosthesis. , 2011, Journal of rehabilitation research and development.

[30]  Xinjun Sheng,et al.  User adaptation in long-term, open-loop myoelectric training: implications for EMG pattern recognition in prosthesis control , 2015, Journal of neural engineering.

[31]  R.F. Weir,et al.  The Optimal Controller Delay for Myoelectric Prostheses , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[32]  Blair A. Lock,et al.  Adaptive Pattern Recognition of Myoelectric Signals: Exploration of Conceptual Framework and Practical Algorithms , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[33]  Klaus-Robert Müller,et al.  Real-time robustness evaluation of regression based myoelectric control against arm position change and donning/doffing , 2017, PloS one.

[34]  Dario Farina,et al.  Is Accurate Mapping of EMG Signals on Kinematics Needed for Precise Online Myoelectric Control? , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[35]  Lucas C Parra,et al.  Correction to "Concurrent Adaptation of Human and Machine Improves Simultaneous and Proportional Myoelectric Control". , 2015, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[36]  A.D.C. Chan,et al.  Examining the adverse effects of limb position on pattern recognition based myoelectric control , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[37]  George N. Saridis,et al.  EMG Pattern Analysis and Classification for a Prosthetic Arm , 1982, IEEE Transactions on Biomedical Engineering.