Myoelectric control with abstract decoders

OBJECTIVE The objective of this study was to compare the use of muscles appropriate for partial-hand prostheses with those typically used for complete hand devices and to determine whether differences in their underlying neural substrates translate to different levels of myoelectric control. APPROACH We developed a novel abstract myoelectric decoder based on motor learning. Three muscle pairs, namely, an intrinsic and independent, an intrinsic and synergist and finally, an extrinsic and antagonist, were tested during abstract myoelectric control. Feedback conditions probed the roles of feed-forward and feedback mechanisms. RESULTS Both performance levels and rates of improvement were significantly higher for intrinsic hand muscles relative to muscles of the forearm. Intrinsic hand muscles showed considerable improvement generalising to decoder use without visual feedback. Results indicate that visual feedback from the decoder is used for transitioning between muscle activity levels, but not for maintaining state. Both individual and group performance were found to be strongly related to motor variability. SIGNIFICANCE Physiological differences inherent to the hand muscles can translate to improved prosthesis control. Our results support the use of motor learning based techniques for upper-limb myoelectric control and strongly argues for their utility in control of partial-hand prostheses. We provide evidence of myoelectric control skill acquisition and offer a formal definition for abstract decoding in the context of prosthetic control.

[1]  E. Fetz,et al.  Direct control of paralyzed muscles by cortical neurons , 2008, Nature.

[2]  Thomas Bertels,et al.  Objectifying the Functional Advantages of Prosthetic Wrist Flexion , 2009 .

[3]  Dario Farina,et al.  Guest editorial: Advances in control of multi-functional powered upper-limb prostheses. , 2014, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[4]  T. Hortobágyi,et al.  Teager-Kaiser Operator improves the accuracy of EMG onset detection independent of signal-to-noise ratio. , 2008, Acta of bioengineering and biomechanics.

[5]  Christian Cipriani,et al.  Dexterous Control of a Prosthetic Hand Using Fine-Wire Intramuscular Electrodes in Targeted Extrinsic Muscles , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  E. Clancy,et al.  Two degrees of freedom quasi-static EMG-force at the wrist using a minimum number of electrodes. , 2017, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[7]  T. Hortobágyi,et al.  Teager–Kaiser energy operator signal conditioning improves EMG onset detection , 2010, European Journal of Applied Physiology.

[8]  Panagiotis K. Artemiadis,et al.  Proportional Myoelectric Control of Robots: Muscle Synergy Development Drives Performance Enhancement, Retainment, and Generalization , 2015, IEEE Transactions on Robotics.

[9]  Jose M. Carmena,et al.  Learning in Closed-Loop Brain–Machine Interfaces: Modeling and Experimental Validation , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Daniel M. Wolpert,et al.  Making smooth moves , 2022 .

[11]  Xiaoyan Li,et al.  Muscle Activity Onset Time Detection Using Teager-Kaiser Energy Operator , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[12]  Panagiotis Artemiadis,et al.  Embedded Human Control of Robots Using Myoelectric Interfaces , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  Jacob L Segil,et al.  Novel postural control algorithm for control of multifunctional myoelectric prosthetic hands. , 2015, Journal of rehabilitation research and development.

[14]  Etienne Burdet,et al.  Dissociating Variability and Effort as Determinants of Coordination , 2009, PLoS Comput. Biol..

[15]  Marc H Schieber,et al.  Rapid acquisition of novel interface control by small ensembles of arbitrarily selected primary motor cortex neurons. , 2014, Journal of neurophysiology.

[16]  Sethu Vijayakumar,et al.  Evaluation of regression methods for the continuous decoding of finger movement from surface EMG and accelerometry , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[17]  Kelvin E. Jones,et al.  Sources of signal-dependent noise during isometric force production. , 2002, Journal of neurophysiology.

[18]  Byron M. Yu,et al.  Neural constraints on learning , 2014, Nature.

[19]  Daniel M Wolpert,et al.  Role of uncertainty in sensorimotor control. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[20]  Kianoush Nazarpour,et al.  Gaining NHS ethical approval from the perspective of a biomedical engineering team , 2018 .

[21]  E. Todorov.  Optimality principles in sensorimotor control , 2004, Nature Neuroscience.

[22]  Robert E Kass,et al.  Functional network reorganization during learning in a brain-computer interface paradigm , 2008, Proceedings of the National Academy of Sciences.

[23]  A. Jackson,et al.  Greater Intermanual Transfer in the Elderly Suggests Age-Related Bilateral Motor Cortex Activation Is Compensatory , 2015, Journal of motor behavior.

[24]  H. Zelaznik,et al.  Motor-output variability: a theory for the accuracy of rapid motor acts. , 1979, Psychological review.

[25]  Gregor Schöner,et al.  The uncontrolled manifold concept: identifying control variables for a functional task , 1999, Experimental Brain Research.

[26]  Kevin B. Englehart,et al.  A robust, real-time control scheme for multifunction myoelectric control , 2003, IEEE Transactions on Biomedical Engineering.

[27]  Birk Diedenhofen,et al.  cocor: A Comprehensive Solution for the Statistical Comparison of Correlations , 2015, PloS one.

[28]  Maura Casadio,et al.  Sensory motor remapping of space in human-machine interfaces. , 2011, Progress in brain research.

[29]  Panagiotis Artemiadis,et al.  A hybrid BMI-based exoskeleton for paresis: EMG control for assisting arm movements , 2017, Journal of neural engineering.

[30]  Lemon Rn,et al.  The G. L. Brown Prize Lecture. Cortical control of the primate hand , 1993 .

[31]  Aymar de Rugy,et al.  Muscle Coordination Is Habitual Rather than Optimal , 2012, The Journal of Neuroscience.

[32]  Maura Casadio,et al.  Reorganization of finger coordination patterns during adaptation to rotation and scaling of a newly learned sensorimotor transformation. , 2011, Journal of neurophysiology.

[33]  Chris Lake,et al.  Experience With Electric Prostheses for the Partial Hand Presentation: An Eight-Year Retrospective , 2009 .

[34]  Marc W Slutzky,et al.  Reducing Abnormal Muscle Coactivation After Stroke Using a Myoelectric-Computer Interface , 2014, Neurorehabilitation and neural repair.

[35]  M Controzzi,et al.  Online Myoelectric Control of a Dexterous Hand Prosthesis by Transradial Amputees , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[36]  Marc H Schieber,et al.  Human finger independence: limitations due to passive mechanical coupling versus active neuromuscular control. , 2004, Journal of neurophysiology.

[37]  D. McCloskey,et al.  The contribution of muscle afferents to kinaesthesia shown by vibration induced illusions of movement and by the effects of paralysing joint afferents. , 1972, Brain : a journal of neurology.

[38]  B Hudgins,et al.  Myoelectric signal processing for control of powered limb prostheses. , 2006, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[39]  Levi J. Hargrove,et al.  Classification of Simultaneous Movements Using Surface EMG Pattern Recognition , 2013, IEEE Transactions on Biomedical Engineering.

[40]  J. Carmena,et al.  Emergence of a Stable Cortical Map for Neuroprosthetic Control , 2009, PLoS biology.

[41]  Lauren H Smith,et al.  Use of probabilistic weights to enhance linear regression myoelectric control , 2015, Journal of neural engineering.

[42]  Kelvin E. Jones,et al.  The scaling of motor noise with muscle strength and motor unit number in humans , 2004, Experimental Brain Research.

[43]  MacJulian Lang.  Challenges And Solutions In Control Systems For Electrically Powered Articulating Digits , 2011 .

[44]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[45]  Tomohiro Shibata,et al.  Continuous and simultaneous estimation of finger kinematics using inputs from an EMG-to-muscle activation model , 2014, Journal of NeuroEngineering and Rehabilitation.

[46]  M. Swiontkowski.  Targeted Muscle Reinnervation for Real-time Myoelectric Control of Multifunction Artificial Arms , 2010 .

[47]  R.N. Scott,et al.  A new strategy for multifunction myoelectric control , 1993, IEEE Transactions on Biomedical Engineering.

[48]  Øyvind Stavdahl,et al.  A STUDY OF THE USE OF COMPENSATION MOTIONS WHEN USING PROSTHETIC WRISTS , 2008 .

[49]  Christian Cipriani,et al.  Abstract and Proportional Myoelectric Control for Multi-Fingered Hand Prostheses , 2013, Annals of Biomedical Engineering.

[50]  Ferdinando A Mussa-Ivaldi,et al.  Remapping hand movements in a novel geometrical environment. , 2005, Journal of neurophysiology.

[51]  Xiaolin Liu,et al.  Contributions of online visual feedback to the learning and generalization of novel finger coordination patterns. , 2008, Journal of neurophysiology.

[52]  Kelvin E. Jones,et al.  Neuronal variability: noise or part of the signal? , 2005, Nature Reviews Neuroscience.

[53]  Kianoush Nazarpour,et al.  Real-time estimation and biofeedback of single-neuron firing rates using local field potentials , 2014, Nature Communications.

[54]  Robert D. Lipschutz,et al.  The use of targeted muscle reinnervation for improved myoelectric prosthesis control in a bilateral shoulder disarticulation amputee , 2004, Prosthetics and orthotics international.

[55]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[56]  D. Farina,et al.  Linear and Nonlinear Regression Techniques for Simultaneous and Proportional Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[57]  Robert N. Singer,et al.  Motor learning and human performance : an application to motor skills and movement behaviors , 1980 .

[58]  R. Lemon.  Descending pathways in motor control. , 2008, Annual review of neuroscience.

[59]  Dario Farina,et al.  User adaptation in Myoelectric Man-Machine Interfaces , 2017, Scientific Reports.

[60]  Todd A Kuiken,et al.  Real-time simultaneous and proportional myoelectric control using intramuscular EMG , 2014, Journal of neural engineering.

[61]  Kathryn Ziegler-Graham,et al.  Estimating the prevalence of limb loss in the United States: 2005 to 2050. , 2008, Archives of physical medicine and rehabilitation.

[62]  Yohsuke R. Miyamoto,et al.  Temporal structure of motor variability is dynamically regulated and predicts motor learning ability , 2014, Nature Neuroscience.

[63]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[64]  A. Jackson,et al.  Flexible Cortical Control of Task-Specific Muscle Synergies , 2012, The Journal of Neuroscience.

[65]  Andrew Jackson,et al.  Learning a Novel Myoelectric-Controlled Interface Task , 2008, Journal of neurophysiology.

[66]  Kianoush Nazarpour,et al.  Artificial Proprioceptive Feedback for Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[67]  J. E. Uellendahl and E.N. Uellendahl,et al.  Experience Fitting Partial Hand Prostheses with Externally Powered Fingers , 2012 .

[68]  Peter H. Veltink,et al.  Stiffness Feedback for Myoelectric Forearm Prostheses Using Vibrotactile Stimulation , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[69]  H. Burger,et al.  Partial hand amputation and work , 2007, Disability and rehabilitation.

[70]  E. Fetz.  Operant Conditioning of Cortical Unit Activity , 1969, Science.

[71]  Kianoush Nazarpour,et al.  Data Driven Spatial Filtering Can Enhance Abstract Myoelectric Control in Amputees , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[72]  Graham Morgan,et al.  Deep learning-based artificial vision for grasp classification in myoelectric hands , 2017, Journal of neural engineering.

[73]  Todd A. Kuiken,et al.  An Analysis of Intrinsic and Extrinsic Hand Muscle EMG for Improved Pattern Recognition Control , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[74]  T. Kuiken,et al.  Myoelectric Pattern Recognition Outperforms Direct Control for Transhumeral Amputees with Targeted Muscle Reinnervation: A Randomized Clinical Trial , 2017, Scientific Reports.

[75]  F. J. Clark,et al.  Role of intramuscular receptors in the awareness of limb position. , 1985, Journal of neurophysiology.

[76]  Dario Farina,et al.  Building an internal model of a myoelectric prosthesis via closed-loop control for consistent and routine grasping , 2015, Experimental Brain Research.

[77]  E. Scheme,et al.  Audible Feedback Improves Internal Model Strength and Performance of Myoelectric Prosthesis Control , 2018, bioRxiv.

[78]  Dragan F. Dimitrov,et al.  Reversible large-scale modification of cortical networks during neuroprosthetic control , 2011, Nature Neuroscience.

[79]  J. Davidson,et al.  A comparison of upper limb amputees and patients with upper limb injuries using the Disability of the Arm, Shoulder and Hand (DASH) , 2004, Disability and rehabilitation.