Performance of Forearm FMG for Estimating Hand Gestures and Prosthetic Hand Control

This study is aimed at exploring the prediction of the various hand gestures based on Force Myography (FMG) signals generated through piezoelectric sensors banded around the forearm. In the study, the muscles extension and contraction during specific movements were mapped, interpreted, and a control algorithm has been established to allow predefined grips and individual finger movements. Decision Tree Learning (DTL) and Support Vector Machine (SVM) have been used for classification and model recognition. Both of these estimated models generated an averaged accuracy of more than 80.0%, for predicting grasping, pinching, left flexion, and wrist rotation. As the classification showed a distinct feature in the signal, a real-time control system based on the threshold value has been implemented in a prosthetic hand. The hand motion has also been recorded through Virtual Motion Glove (VMD) to establish dynamic relationship between the FMG data and the different hand gestures. The classification of the hand gestures based on FMG signal will provide a useful foundation for future research in the interfacing and utilization of medical devices.

[1]  Carlo Menon,et al.  Exploration of Force Myography and surface Electromyography in hand gesture classification. , 2017, Medical engineering & physics.

[2]  E. D. Engeberg,et al.  Adaptive Sliding Mode Control for Prosthetic Hands to Simultaneously Prevent Slip and Minimize Deformation of Grasped Objects , 2013, IEEE/ASME Transactions on Mechatronics.

[3]  J. Ross Quinlan,et al.  Learning decision tree classifiers , 1996, CSUR.

[4]  Jun Morimoto,et al.  Bilinear Modeling of EMG Signals to Extract User-Independent Features for Multiuser Myoelectric Interface , 2013, IEEE Transactions on Biomedical Engineering.

[5]  Nurhazimah Nazmi,et al.  A Review of Classification Techniques of EMG Signals during Isotonic and Isometric Contractions , 2016, Sensors.

[6]  Xiangrong Shen,et al.  A Gas-Actuated Anthropomorphic Prosthesis for Transhumeral Amputees , 2008, IEEE Transactions on Robotics.

[7]  Carlo Menon,et al.  Force Myography to Control Robotic Upper Extremity Prostheses: A Feasibility Study , 2016, Front. Bioeng. Biotechnol..

[8]  Li-Ren Lin,et al.  Mechanism design of a new multifingered robot hand , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[9]  Madhavi Anugolu,et al.  Implementation of sEMG-based real-time embedded adaptive finger force control for a prosthetic hand , 2011, IEEE Conference on Decision and Control and European Control Conference.

[10]  Wenwei Yu,et al.  Advances in Therapeutic Engineering , 2012 .

[11]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[12]  Erik D. Engeberg.  A physiological basis for control of a prosthetic hand , 2013, Biomed. Signal Process. Control..

[13]  Yimesker Yihun,et al.  Force Myography Signal-Based Hand Gesture Classification for the Implementation of Real-Time Control System to a Prosthetic Hand , 2018 .

[14]  Sotiris B. Kotsiantis,et al.  Supervised Machine Learning: A Review of Classification Techniques , 2007, Informatica.

[15]  Carlo Menon,et al.  Performance of forearm FMG and sEMG for estimating elbow, forearm and wrist positions , 2017 .

[16]  Hamid M. Lankarani,et al.  Design and control of an active palm roll joint for the human prosthetic hand , 2016 .

[17]  Jacob L. Segil,et al.  Mechanical design and performance specifications of anthropomorphic prosthetic hands: a review. , 2013, Journal of rehabilitation research and development.

[18]  A. Schwartz,et al.  High-performance neuroprosthetic control by an individual with tetraplegia , 2013, The Lancet.

[19]  Christian Cipriani,et al.  Abstract and Proportional Myoelectric Control for Multi-Fingered Hand Prostheses , 2013, Annals of Biomedical Engineering.

[20]  Dapeng Yang,et al.  An anthropomorphic robot hand developed based on underactuated mechanism and controlled by EMG signals , 2009 .

[21]  Anthony Tzes,et al.  Design of an innovative prosthetic hand with compact shape memory alloy actuators , 2013, 21st Mediterranean Conference on Control and Automation.

[22]  Paolo Dario,et al.  Design and development of an underactuated prosthetic hand , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[23]  Constantinos Mavroidis,et al.  Shape memory alloy actuated robot prostheses: initial experiments , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[24]  Constantinos Mavroidis,et al.  Mechanical design of a shape memory alloy actuated prosthetic hand. , 2002, Technology and health care : official journal of the European Society for Engineering and Medicine.

[25]  Loredana Zollo,et al.  Literature Review on Needs of Upper Limb Prosthesis Users , 2016, Front. Neurosci..

[26]  Marco Ceccarelli.  Kinematic Design Problems for Low-Cost Easy-Operation Humanoid Robots , 2015 .

[27]  Markus Reischl,et al.  A hydraulically driven multifunctional prosthetic hand , 2005, Robotica.

[28]  Nikolaos G. Bourbakis,et al.  Neural and fuzzy robotic hand control , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[29]  Claudio Castellini,et al.  Assessment of a Wearable Force- and Electromyography Device and Comparison of the Related Signals for Myocontrol , 2016, Front. Neurorobot..

[30]  M. Goldfarb,et al.  Design of a Multifunctional Anthropomorphic Prosthetic Hand With Extrinsic Actuation , 2009, IEEE/ASME Transactions on Mechatronics.

[31]  Carlo Menon,et al.  Continuous Prediction of Finger Movements Using Force Myography , 2016 .

[32]  Christian Cipriani,et al.  Dexterous Control of a Prosthetic Hand Using Fine-Wire Intramuscular Electrodes in Targeted Extrinsic Muscles , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[33]  Nianfeng Wang,et al.  Design and Myoelectric Control of an Anthropomorphic Prosthetic Hand , 2017 .

[34]  Abdulhamit Subasi,et al.  Classification of EMG signals using PSO optimized SVM for diagnosis of neuromuscular disorders , 2013, Comput. Biol. Medicine.

[35]  S. Hossein Mousavinezhad,et al.  sEMG based real-time embedded force control strategy for a prosthetic hand prototype , 2011, 2011 IEEE INTERNATIONAL CONFERENCE ON ELECTRO/INFORMATION TECHNOLOGY.

[36]  B. Parratte,et al.  Functional Anatomy of the Muscle , 2017 .

[37]  Thomas G. Dietterich.  Multiple Classifier Systems , 2000, Lecture Notes in Computer Science.

[38]  Erik Scheme,et al.  High-density force myography: A possible alternative for upper-limb prosthetic control. , 2016, Journal of rehabilitation research and development.

[39]  Shih-Tsang Tang,et al.  A bionic hand controlled by hand gesture recognition based on surface EMG signals: A preliminary study , 2018 .

[40]  Madhavi Anugolu,et al.  Optimal tracking of a sEMG based force model for a prosthetic hand , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[41]  Silvestro Micera,et al.  Control of Multifunctional Prosthetic Hands by Processing the Electromyographic Signal. , 2017, Critical reviews in biomedical engineering.

[42]  Claudio Castellini,et al.  Optical Myography: Detecting Finger Movements by Looking at the Forearm , 2016, Front. Neurorobot..

[43]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[44]  Marco Ceccarelli.  Finger Mechanisms for Robotic Hands , 2015 .