Model-Based Control of Individual Finger Movements for Prosthetic Hand Function

Prosthetic devices for hand difference have advanced considerably in recent years, to the point where the mechanical dexterity of a state-of-the-art prosthetic hand approaches that of the natural hand. Control options for users, however, have not kept pace, meaning that the new devices are not used to their full potential. Promising developments in control technology reported in the literature have met with limited commercial and clinical success. We have previously described a biomechanical model of the hand that could be used for prosthesis control. The goal of this study was to evaluate the feasibility of this approach in terms of kinematic fidelity of model-predicted finger movement and the computational performance of the model. We show the performance of the model in replicating recorded hand and finger kinematics and find average correlations of 0.89 between modelled and recorded motions; we show that the computational performance of the simulations is fast enough to achieve real-time control with a robotic hand in the loop; and we describe the use of the model for controlling object gripping. Despite some limitations in accessing sufficient driving signals, the model performance shows promise as a controller for prosthetic hands when driven with recorded EMG signals. User-in-the-loop testing with amputees is necessary in future work to evaluate the suitability of available driving signals, and to examine translation of offline results to online performance.

[1]  Sethu Vijayakumar,et al.  Improved prosthetic hand control with concurrent use of myoelectric and inertial measurements , 2017, Journal of NeuroEngineering and Rehabilitation.

[2]  S. Vijayakumar,et al.  The role of feed-forward and feedback processes for closed-loop prosthesis control , 2011, Journal of NeuroEngineering and Rehabilitation.

[3]  O. Stavdahl,et al.  Control of Upper Limb Prostheses: Terminology and Proportional Myoelectric Control—A Review , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[4]  Chou-Ching K. Lin,et al.  Neural and Mechanical Contributions to the Stretch Reflex: A Model Synthesis , 2004, Annals of Biomedical Engineering.

[5]  Nitish V. Thakor,et al.  Continuous decoding of finger position from surface EMG signals for the control of powered prostheses , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[6]  Lizhi Pan,et al.  Myoelectric Control Based on a Generic Musculoskeletal Model: Toward a Multi-User Neural-Machine Interface , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  Loredana Zollo,et al.  EMG and ENG-envelope pattern recognition for prosthetic hand control , 2019, Journal of Neuroscience Methods.

[8]  Antonie J van den Bogert,et al.  Implicit methods for efficient musculoskeletal simulation and optimal control. , 2011, Procedia IUTAM.

[9]  Robert D. Lipschutz,et al.  Targeted muscle reinnervation for real-time myoelectric control of multifunction artificial arms. , 2009, JAMA.

[10]  G. Loeb,et al.  Mathematical models of proprioceptors. I. Control and transduction in the muscle spindle. , 2006, Journal of neurophysiology.

[11]  Dario Farina,et al.  Predicting wrist kinematics from motor unit discharge timings for the control of active prostheses , 2019, Journal of NeuroEngineering and Rehabilitation.

[12]  Christian Cipriani,et al.  Abstract and Proportional Myoelectric Control for Multi-Fingered Hand Prostheses , 2013, Annals of Biomedical Engineering.

[13]  Theocharis Kyriacou,et al.  Feasibility of using combined EMG and kinematic signals for prosthesis control: A simulation study using a virtual reality environment , 2016, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[14]  Timothy G. Constandinou,et al.  Computationally efficient modeling of proprioceptive signals in the upper limb for prostheses: a simulation study , 2014, Front. Neurosci..

[15]  H. Huang,et al.  Lumped-parameter electromyogram-driven musculoskeletal hand model: A potential platform for real-time prosthesis control. , 2016, Journal of biomechanics.

[16]  Antonie J. van den Bogert,et al.  Real-Time Simulation of Three-Dimensional Shoulder Girdle and Arm Dynamics , 2014, IEEE Transactions on Biomedical Engineering.

[17]  Ayman Habib,et al.  OpenSim: Open-Source Software to Create and Analyze Dynamic Simulations of Movement , 2007, IEEE Transactions on Biomedical Engineering.

[18]  Tomohiro Shibata,et al.  Continuous and simultaneous estimation of finger kinematics using inputs from an EMG-to-muscle activation model , 2014, Journal of NeuroEngineering and Rehabilitation.

[19]  Manfredo Atzori,et al.  Control Capabilities of Myoelectric Robotic Prostheses by Hand Amputees: A Scientific Research and Market Overview , 2015, Front. Syst. Neurosci..

[20]  E. Biddiss,et al.  Upper-Limb Prosthetics: Critical Factors in Device Abandonment , 2007, American journal of physical medicine & rehabilitation.

[21]  Dario Farina,et al.  The Extraction of Neural Information from the Surface EMG for the Control of Upper-Limb Prostheses: Emerging Avenues and Challenges , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  Dimitra Blana,et al.  Real-time simulation of hand motion for prosthesis control , 2017, Computer methods in biomechanics and biomedical engineering.

[23]  Dario Farina,et al.  Robust simultaneous myoelectric control of multiple degrees of freedom in wrist-hand prostheses by real-time neuromusculoskeletal modeling , 2018, Journal of neural engineering.

[24]  Christian Cipriani,et al.  Dexterous Control of a Prosthetic Hand Using Fine-Wire Intramuscular Electrodes in Targeted Extrinsic Muscles , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[25]  Paul H. Chappell,et al.  Validation and Application of a Computational Model for Wrist and Hand Movements Using Surface Markers , 2008, IEEE Transactions on Biomedical Engineering.

[26]  Brian Waryck,et al.  Comparison Of Two Myoelectric Multi-Articulating Prosthetic Hands , 2011 .

[27]  Aude Billard,et al.  Decoding the grasping intention from electromyography during reaching motions , 2018, Journal of NeuroEngineering and Rehabilitation.