Proportional Myoelectric Control of Robots: Muscle Synergy Development Drives Performance Enhancement, Retainment, and Generalization

Proportional myoelectric control has been proposed for user-friendly interaction with prostheses, orthoses, and new human-machine interfaces. Recent research has stressed intuitive controls that mimic human intentions. However, these controls have limited accuracy and functionality, resulting in user-specific decoders with upper-bound constraints on performance. Thus, myoelectric controls have yet to realize their potential as a natural interface between humans and multifunctional robotic controls. This study supports a shift in myoelectric control schemes toward proportional simultaneous controls learned through the development of unique muscle synergies. A multiple day study reveals natural emergence of a new muscle synergy space as subjects identify the system dynamics of a myoelectric interface. These synergies correlate with long-term learning, increasing performance over consecutive days. Synergies are maintained after one week, helping subjects retain efficient control and generalize performance to new tasks. The extension to robot control is also demonstrated with a robot arm performing reach-to-grasp tasks in a plane. The ability to enhance, retain, and generalize control, without needing to recalibrate or retrain the system, supports control schemes promoting synergy development, not necessarily user-specific decoders trained on a subset of existing synergies, for efficient myoelectric interfaces designed for long-term use.

[1]  Phongchai Nilas,et al.  An innovative high-level human-robot interaction for disabled persons , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[2]  Panagiotis Artemiadis,et al.  Embedded Human Control of Robots Using Myoelectric Interfaces , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  B. Hudgins,et al.  REAL-TIME MYOELECTRIC CONTROL IN A VIRTUAL ENVIRONMENT TO RELATE USABILITY VS. ACCURACY , 2005 .

[4]  Panagiotis K. Artemiadis,et al.  A Switching Regime Model for the EMG-Based Control of a Robot Arm , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[5]  Mark R. Cutkosky,et al.  Selectively compliant underactuated hand for mobile manipulation , 2012, 2012 IEEE International Conference on Robotics and Automation.

[6]  R. Ciupa,et al.  International Conference , 2023, In Vitro Cellular & Developmental Biology - Animal.

[7]  Changmok Choi,et al.  Development and evaluation of a assistive computer interface by SEMG for individuals with spinal cord injuries , 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

[8]  Guanglin Li,et al.  Principal Components Analysis Preprocessing for Improved Classification Accuracies in Pattern-Recognition-Based Myoelectric Control , 2009, IEEE Transactions on Biomedical Engineering.

[9]  Desney S. Tan,et al.  Demonstrating the feasibility of using forearm electromyography for muscle-computer interfaces , 2008, CHI.

[10]  H. H. Sears,et al.  PROPORTIONAL MYOELECTRIC HAND CONTROL: AN EVALUATION , 1991, American journal of physical medicine & rehabilitation.

[11]  Panagiotis K. Artemiadis,et al.  On the effect of human arm manipulability in 3D force tasks: Towards force-controlled exoskeletons , 2011, 2011 IEEE International Conference on Robotics and Automation.

[12]  AMERICAN JOURNAL OF PHYSICAL MEDICINE & REHABILITATION , 2009, American journal of physical medicine & rehabilitation.

[13]  Erik Scheme,et al.  Electromyogram pattern recognition for control of powered upper-limb prostheses: state of the art and challenges for clinical use. , 2011, Journal of rehabilitation research and development.

[14]  Nikolaos G. Tsagarakis,et al.  Teleimpedance control of a synergy-driven anthropomorphic hand , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Xiaolin Liu,et al.  Contributions of online visual feedback to the learning and generalization of novel finger coordination patterns. , 2008, Journal of neurophysiology.

[16]  Dario Farina,et al.  The Extraction of Neural Information from the Surface EMG for the Control of Upper-Limb Prostheses: Emerging Avenues and Challenges , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  A B Ajiboye,et al.  Muscle synergies as a predictive framework for the EMG patterns of new hand postures , 2009, Journal of neural engineering.

[18]  Patrick van der Smagt,et al.  Evidence of muscle synergies during human grasping , 2013, Biological Cybernetics.

[19]  Ferat Sahin,et al.  Camera control with EMG signals using Principal Component Analysis and support vector machines , 2011, 2011 IEEE International Systems Conference.

[20]  Dario Farina,et al.  Is Accurate Mapping of EMG Signals on Kinematics Needed for Precise Online Myoelectric Control? , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  Volkan Patoglu,et al.  Tele-impedance control of a variable stiffness prosthetic hand , 2012, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[22]  Wynne A. Lee,et al.  Neuromotor synergies as a basis for coordinated intentional action. , 1984, Journal of motor behavior.

[23]  Andrew Jackson,et al.  Learning a Novel Myoelectric-Controlled Interface Task , 2008, Journal of neurophysiology.

[24]  Aidan D. Roche,et al.  Prosthetic Myoelectric Control Strategies: A Clinical Perspective , 2014, Current Surgery Reports.

[25]  Patrick van der Smagt,et al.  EMG-based teleoperation and manipulation with the DLR LWR-III , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Ferat Sahin,et al.  Pattern recognition with surface EMG signal based wavelet transformation , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[27]  Barbara Caputo,et al.  Stable myoelectric control of a hand prosthesis using non-linear incremental learning , 2014, Front. Neurorobot..

[28]  Stefano Stramigioli,et al.  Myoelectric forearm prostheses: state of the art from a user-centered perspective. , 2011, Journal of rehabilitation research and development.

[29]  Thomas J. Burkholder,et al.  Practical limits on muscle synergy identification by non-negative matrix factorization in systems with mechanical constraints , 2012, Medical & Biological Engineering & Computing.

[30]  Francesco Lacquaniti,et al.  Control of Fast-Reaching Movements by Muscle Synergy Combinations , 2006, The Journal of Neuroscience.

[31]  Giulio Sandini,et al.  Multi-subject/daily-life activity EMG-based control of mechanical hands , 2009, Journal of NeuroEngineering and Rehabilitation.

[32]  F. Zajac Muscle and tendon: properties, models, scaling, and application to biomechanics and motor control. , 1989, Critical reviews in biomedical engineering.

[33]  Aymar de Rugy,et al.  Muscle Coordination Is Habitual Rather than Optimal , 2012, The Journal of Neuroscience.

[34]  政子 鶴岡,et al.  1998 IEEE International Conference on SMCに参加して , 1998 .

[35]  Jose M. Carmena,et al.  Learning in Closed-Loop Brain–Machine Interfaces: Modeling and Experimental Validation , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[36]  Silvestro Micera,et al.  On the development of a novel adaptive prosthetic hand with compliant joints: experimental platform and EMG control , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[37]  Panagiotis K. Artemiadis,et al.  An EMG-Based Robot Control Scheme Robust to Time-Varying EMG Signal Features , 2010, IEEE Transactions on Information Technology in Biomedicine.

[38]  Maura Casadio,et al.  Sensory motor remapping of space in human-machine interfaces. , 2011, Progress in brain research.

[39]  Panagiotis Artemiadis,et al.  A hybrid BMI-based exoskeleton for paresis: EMG control for assisting arm movements , 2017, Journal of neural engineering.

[40]  A. Jackson,et al.  Flexible Cortical Control of Task-Specific Muscle Synergies , 2012, The Journal of Neuroscience.

[41]  Huosheng Hu,et al.  Myoelectric control systems - A survey , 2007, Biomed. Signal Process. Control..

[42]  Junuk Chu,et al.  Wearable EMG-based HCI for Electric-Powered Wheelchair Users with Motor Disabilities , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[43]  Carsten O. Daub,et al.  The mutual information: Detecting and evaluating dependencies between variables , 2002, ECCB.

[44]  Maura Casadio,et al.  Reorganization of finger coordination patterns during adaptation to rotation and scaling of a newly learned sensorimotor transformation. , 2011, Journal of neurophysiology.

[45]  Ning Jiang,et al.  Extracting Simultaneous and Proportional Neural Control Information for Multiple-DOF Prostheses From the Surface Electromyographic Signal , 2009, IEEE Transactions on Biomedical Engineering.

[46]  Stephane Cotin,et al.  Constraint-Based Haptic Rendering of Multirate Compliant Mechanisms , 2011, IEEE Transactions on Haptics.

[47]  Justin Bayer,et al.  Continuous robot control using surface electromyography of atrophic muscles , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[48]  Silvestro Micera,et al.  On the Shared Control of an EMG-Controlled Prosthetic Hand: Analysis of User–Prosthesis Interaction , 2008, IEEE Transactions on Robotics.

[49]  Panagiotis K. Artemiadis,et al.  EMG-Based Position and Force Estimates in Coupled Human-Robot Systems: Towards EMG-Controlled Exoskeletons , 2008, ISER.

[50]  T. Kuiken,et al.  Improved Myoelectric Prosthesis Control Using Targeted Reinnervation Surgery: A Case Series , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[51]  Aymar de Rugy,et al.  Are muscle synergies useful for neural control? , 2013, Front. Comput. Neurosci..

[52]  Todd A. Kuiken,et al.  A Decision-Based Velocity Ramp for Minimizing the Effect of Misclassifications During Real-Time Pattern Recognition Control , 2011, IEEE Transactions on Biomedical Engineering.

[53]  Matthew C. Tresch,et al.  The number and choice of muscles impact the results of muscle synergy analyses , 2013, Front. Comput. Neurosci..

[54]  Robert E. Kass,et al.  2009 Special Issue: Bias, optimal linear estimation, and the differences between open-loop simulation and closed-loop performance of spiking-based brain-computer interface algorithms , 2009 .

[55]  A.D.C. Chan,et al.  Examining the adverse effects of limb position on pattern recognition based myoelectric control , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[56]  Stacie A. Chvatal,et al.  Decomposing Muscle Activity in Motor TasksMethods and Interpretation , 2010 .

[57]  Allison M. Okamura,et al.  Task-dependent impedance and implications for upper-limb prosthesis control , 2014, Int. J. Robotics Res..

[58]  Nikolaos G. Tsagarakis,et al.  Tele-impedance: Teleoperation with impedance regulation using a body–machine interface , 2012, Int. J. Robotics Res..

[59]  Dario Farina,et al.  Intuitive, Online, Simultaneous, and Proportional Myoelectric Control Over Two Degrees-of-Freedom in Upper Limb Amputees , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[60]  Chi Zhu,et al.  Power assistance for human elbow motion support using minimal EMG signals with admittance control , 2011, 2011 IEEE International Conference on Mechatronics and Automation.

[61]  Christian Cipriani,et al.  Abstract and Proportional Myoelectric Control for Multi-Fingered Hand Prostheses , 2013, Annals of Biomedical Engineering.

[62]  Giulio Sandini,et al.  Model adaptation with least-squares SVM for adaptive hand prosthetics , 2009, 2009 IEEE International Conference on Robotics and Automation.

[63]  Bernd Freisleben,et al.  HaWCoS: the "hands-free" wheelchair control system , 2002, ASSETS.

[64]  R.F. Kirsch,et al.  Evaluation of Head Orientation and Neck Muscle EMG Signals as Command Inputs to a Human–Computer Interface for Individuals With High Tetraplegia , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.