Preliminary results toward a naturally controlled multi-synergistic prosthetic hand

Robotic hands embedding human motor control principles in their mechanical design are getting increasing interest thanks to their simplicity and robustness, combined with good performance. Another key aspect of these hands is that humans can use them very effectively thanks to the similarity of their behavior with real hands. Nevertheless, controlling more than one degree of actuation remains a challenging task. In this paper, we take advantage of these characteristics in a multi-synergistic prosthesis. We propose an integrated setup composed of Pisa/IIT SoftHand 2 and a control strategy which simultaneously and proportionally maps the human hand movements to the robotic hand. The control technique is based on a combination of non-negative matrix factorization and linear regression algorithms. It also features a real-time continuous posture compensation of the electromyographic signals based on an IMU. The algorithm is tested on five healthy subjects through an experiment in a virtual environment. In a separate experiment, the efficacy of the posture compensation strategy is evaluated on five healthy subjects and, finally, the whole setup is successfully tested in performing realistic daily life activities.

[1]  Alin Albu-Schäffer,et al.  The DLR hand arm system , 2011, 2011 IEEE International Conference on Robotics and Automation.

[2]  Nikolaos G. Tsagarakis,et al.  A manipulation framework for compliant humanoid COMAN: Application to a valve turning task , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[3]  Jacob L. Segil,et al.  Mechanical design and performance specifications of anthropomorphic prosthetic hands: a review. , 2013, Journal of rehabilitation research and development.

[4]  Changmok Choi,et al.  Synergy matrices to estimate fluid wrist movements by surface electromyography. , 2011, Medical engineering & physics.

[5]  Nikolaos G. Tsagarakis,et al.  Synergy-based interface for bilateral tele-manipulations of a master-slave system with large asymmetries , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Oliver Brock,et al.  A novel type of compliant and underactuated robotic hand for dexterous grasping , 2016, Int. J. Robotics Res..

[7]  Cosimo Della Santina,et al.  Dexterity augmentation on a synergistic hand: The Pisa/IIT SoftHand+ , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[8]  Matteo Bianchi,et al.  A data-driven kinematic model of the human hand with soft-tissue artifact compensation mechanism for grasp synergy analysis , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Anna Kochan,et al.  Shadow delivers first hand , 2005, Ind. Robot.

[10]  D. Farina,et al.  Linear and Nonlinear Regression Techniques for Simultaneous and Proportional Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[11]  J. C. Jamison,et al.  Muscle synergies and isometric torque production: influence of supination and pronation level on elbow flexion. , 1993, Journal of neurophysiology.

[12]  Cosimo Della Santina,et al.  SoftHand Pro-D: Matching dynamic content of natural user commands with hand embodiment for enhanced prosthesis control , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Maura Casadio,et al.  Reorganization of finger coordination patterns during adaptation to rotation and scaling of a newly learned sensorimotor transformation. , 2011, Journal of neurophysiology.

[14]  Ning Jiang,et al.  Extracting Simultaneous and Proportional Neural Control Information for Multiple-DOF Prostheses From the Surface Electromyographic Signal , 2009, IEEE Transactions on Biomedical Engineering.

[15]  Nikolaos G. Tsagarakis,et al.  WALK-MAN humanoid lower body design optimization for enhanced physical performance , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Christopher Assad,et al.  Gesture-based robot control with variable autonomy from the JPL BioSleeve , 2013, 2013 IEEE International Conference on Robotics and Automation.

[17]  Manuel G. Catalano,et al.  Grasping with Soft Hands , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[18]  K. Englehart,et al.  Resolving the Limb Position Effect in Myoelectric Pattern Recognition , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[19]  J. F. Soechting,et al.  Postural Hand Synergies for Tool Use , 1998, The Journal of Neuroscience.

[20]  Huosheng Hu,et al.  Myoelectric control systems - A survey , 2007, Biomed. Signal Process. Control..

[21]  Manuel G. Catalano,et al.  Adaptive synergies for the design and control of the Pisa/IIT SoftHand , 2014, Int. J. Robotics Res..

[22]  Antonio Bicchi,et al.  Modelling natural and artificial hands with synergies , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[23]  Lucas C. Parra,et al.  Concurrent Adaptation of Human and Machine Improves Simultaneous and Proportional Myoelectric Control , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[24]  Ernest Nlandu Kamavuako,et al.  Biomedical Signal Processing and Control , 2022 .

[25]  Levi J. Hargrove,et al.  Classification of Simultaneous Movements Using Surface EMG Pattern Recognition , 2013, IEEE Transactions on Biomedical Engineering.

[26]  Z. Hasan,et al.  Relative activation of two human elbow flexors under isometric conditions: a cautionary note concerning flexor equivalence , 1986, Experimental Brain Research.

[27]  R.F. Kirsch,et al.  Evaluation of Head Orientation and Neck Muscle EMG Signals as Command Inputs to a Human–Computer Interface for Individuals With High Tetraplegia , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[28]  Kianoush Nazarpour,et al.  Combined influence of forearm orientation and muscular contraction on EMG pattern recognition , 2016, Expert Syst. Appl..

[29]  Robert D. Howe,et al.  A compliant, underactuated hand for robust manipulation , 2013, Int. J. Robotics Res..

[30]  G. Whitesides Soft Robotics. , 2018, Angewandte Chemie.

[31]  Andrea d'Avella,et al.  Differences in Adaptation Rates after Virtual Surgeries Provide Direct Evidence for Modularity , 2013, The Journal of Neuroscience.

[32]  Dario Farina,et al.  Intuitive, Online, Simultaneous, and Proportional Myoelectric Control Over Two Degrees-of-Freedom in Upper Limb Amputees , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[33]  Manuel G. Catalano,et al.  A synergy-driven approach to a myoelectric hand , 2013, 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR).

[34]  Dario Farina,et al.  Is Accurate Mapping of EMG Signals on Kinematics Needed for Precise Online Myoelectric Control? , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.