Force myography controlled multifunctional hand prosthesis for upper-limb amputees

Abstract Existing myoelectric prostheses can provide solutions to amputees for performing activities of daily livings. However, there are several issues with these prostheses (1) performance are affected mainly by sweat, electrode shift, motion artifact, interference, etc. (2) are expensive (3) have complex control schemes. This paper presents an affordable hand prosthesis solution for transradial amputees, which uses force myography (FMG) as a control signal in place of electromyography (EMG) signal. A novel FMG sensor was designed to detect mechanical muscle contractions from the residual forearm of amputees. Two distinct control strategies were formulated for translating the FMG signals from the sensor to the control commands for driving custom-made prosthetic hands. Prosthetic hand prototype 1 with a proportional control scheme was developed and verified on five amputees. Subjects wearing the hand were able to grasp various objects using their intent of muscular contractions. Fuzzy logic based classification scheme with an offline success rate above 97 % was established for identifying six different hand gestures from only single-channel FMG data. Further, the system, along with the threshold control, was implemented for the developed hand prototype 2 to obtain six distinct grip patterns. The real-time testing of hand on thirteen subjects (five amputees and eight intact) showed a success percentage above 95 % in performing dexterous grasping operations. As compared to the presently available hands, the hand prototype 2 displayed comparable features at such a low-cost price. However, with limited functionality, hand prototype 1 is an affordable, practical, intuitive, and faster version of the prosthetic hand.

[1]  Claudio Castellini,et al.  Optical Myography: Detecting Finger Movements by Looking at the Forearm , 2016, Front. Neurorobot..

[2]  Kevin Englehart,et al.  High density electromyography data of normally limbed and transradial amputee subjects for multifunction prosthetic control. , 2012, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[3]  Huosheng Hu,et al.  Support Vector Machine-Based Classification Scheme for Myoelectric Control Applied to Upper Limb , 2008, IEEE Transactions on Biomedical Engineering.

[4]  Dapeng Yang,et al.  Combined Use of FSR Sensor Array and SVM Classifier for Finger Motion Recognition Based on Pressure Distribution Map , 2012 .

[5]  Leonel Paredes-Madrid,et al.  Self-Compensated Driving Circuit for Reducing Drift and Hysteresis in Force Sensing Resistors , 2018, Electronics.

[6]  O. Stavdahl,et al.  Control of Upper Limb Prostheses: Terminology and Proportional Myoelectric Control—A Review , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  Alok Prakash,et al.  Development of an Affordable Myoelectric Hand for Transradial Amputees , 2020 .

[8]  Nicola Vitiello,et al.  Intention-Based EMG Control for Powered Exoskeletons , 2012, IEEE Transactions on Biomedical Engineering.

[9]  Amit M. Joshi,et al.  Portable EMG Data Acquisition Module for Upper Limb Prosthesis Application , 2018, IEEE Sensors Journal.

[10]  Loredana Zollo,et al.  Literature Review on Needs of Upper Limb Prosthesis Users , 2016, Front. Neurosci..

[11]  Shiv Dutt Joshi,et al.  Force Myography Based Novel Strategy for Locomotion Classification , 2018, IEEE Transactions on Human-Machine Systems.

[12]  A E Grassino,et al.  Automatic assessment of electromyogram quality. , 1995, Journal of applied physiology.

[13]  Paolo Bifulco,et al.  A Piezoresistive Sensor to Measure Muscle Contraction and Mechanomyography , 2018, Sensors.

[14]  Nur Azah Hamzaid,et al.  Mechanomyography and muscle function assessment: a review of current state and prospects. , 2014, Clinical biomechanics.

[15]  J. Dargahi,et al.  A New Approach for Modeling Piezoresistive Force Sensors Based on Semiconductive Polymer Composites , 2012, IEEE/ASME Transactions on Mechatronics.

[16]  Rita M. Patterson,et al.  Surface EMG and intra-socket force measurement to control a prosthetic device , 2015, Commercial + Scientific Sensing and Imaging.

[17]  Shiru Sharma,et al.  A low-cost, wearable sEMG sensor for upper limb prosthetic application , 2019, Journal of medical engineering & technology.

[18]  Neeraj Sharma,et al.  Novel force myography sensor to measure muscle contractions for controlling hand prostheses , 2020, Instrumentation Science & Technology.

[19]  Levi J. Hargrove,et al.  Effects of interelectrode distance on the robustness of myoelectric pattern recognition systems , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[20]  B Hudgins,et al.  Myoelectric signal processing for control of powered limb prostheses. , 2006, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[21]  Stefano Stramigioli,et al.  Myoelectric forearm prostheses: state of the art from a user-centered perspective. , 2011, Journal of rehabilitation research and development.

[22]  Yimesker Yihun,et al.  Performance of Forearm FMG for Estimating Hand Gestures and Prosthetic Hand Control , 2019, Journal of Bionic Engineering.

[23]  Nan Li,et al.  Hand motion recognition based on pressure distribution maps and LS-SVM , 2014, 2014 International Conference on Mechatronics and Control (ICMC).

[24]  Carlo Menon,et al.  Towards the development of a wearable feedback system for monitoring the activities of the upper-extremities , 2014, Journal of NeuroEngineering and Rehabilitation.

[25]  Joan Lobo-Prat,et al.  Non-invasive control interfaces for intention detection in active movement-assistive devices , 2014, Journal of NeuroEngineering and Rehabilitation.

[26]  W. Craelius,et al.  Pressure signature of forearm as predictor of grip force. , 2008, Journal of rehabilitation research and development.

[27]  Valentina Agostini,et al.  An Algorithm for the Estimation of the Signal-To-Noise Ratio in Surface Myoelectric Signals Generated During Cyclic Movements , 2012, IEEE Transactions on Biomedical Engineering.

[28]  Sibylle B. Thies,et al.  The reality of myoelectric prostheses : understanding what makes , 2018 .

[29]  T. Kuiken,et al.  Quantifying Pattern Recognition—Based Myoelectric Control of Multifunctional Transradial Prostheses , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[30]  Ping Zhou,et al.  A Novel Myoelectric Pattern Recognition Strategy for Hand Function Restoration After Incomplete Cervical Spinal Cord Injury , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[31]  Manfredo Atzori,et al.  Control Capabilities of Myoelectric Robotic Prostheses by Hand Amputees: A Scientific Research and Market Overview , 2015, Front. Syst. Neurosci..

[32]  Socrates Dokos,et al.  Hybrid soft computing systems for electromyographic signals analysis: a review , 2014, BioMedical Engineering OnLine.

[33]  F. K. Lam,et al.  Fuzzy EMG classification for prosthesis control. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[34]  Dinesh K Kumar,et al.  Selection of suitable hand gestures for reliable myoelectric human computer interface , 2015, Biomedical engineering online.

[35]  Dario Farina,et al.  The Extraction of Neural Information from the Surface EMG for the Control of Upper-Limb Prostheses: Emerging Avenues and Challenges , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[36]  Dario Farina,et al.  Intuitive, Online, Simultaneous, and Proportional Myoelectric Control Over Two Degrees-of-Freedom in Upper Limb Amputees , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[37]  Gregory A. Clark,et al.  Intuitive neuromyoelectric control of a dexterous bionic arm using a modified Kalman filter , 2019, Journal of Neuroscience Methods.

[38]  Pornchai Phukpattaranont,et al.  Feature reduction and selection for EMG signal classification , 2012, Expert Syst. Appl..

[39]  Sam L. Phillips,et al.  Residual kinetic imaging: a versatile interface for prosthetic control , 2005, Robotica.

[40]  Yimesker Yihun,et al.  Force Myography Signal-Based Hand Gesture Classification for the Implementation of Real-Time Control System to a Prosthetic Hand , 2018 .

[41]  K. Englehart,et al.  Classification of the myoelectric signal using time-frequency based representations. , 1999, Medical engineering & physics.

[42]  Claudio Castellini,et al.  Assessment of a Wearable Force- and Electromyography Device and Comparison of the Related Signals for Myocontrol , 2016, Front. Neurorobot..

[43]  Alok Prakash,et al.  A low-cost system to control prehension force of a custom-made myoelectric hand prosthesis , 2020 .

[44]  Stefan Schulz,et al.  Two multiarticulated hydraulic hand prostheses. , 2004, Artificial organs.

[45]  Wayne Walter,et al.  Development of a Prototype Over-Actuated Biomimetic Prosthetic Hand , 2015, PloS one.

[46]  Erik Scheme,et al.  FMG Versus EMG: A Comparison of Usability for Real-Time Pattern Recognition Based Control , 2019, IEEE Transactions on Biomedical Engineering.

[47]  Carlo Menon,et al.  Force Myography to Control Robotic Upper Extremity Prostheses: A Feasibility Study , 2016, Front. Bioeng. Biotechnol..

[48]  Panagiotis K. Artemiadis,et al.  Proceedings of the first workshop on Peripheral Machine Interfaces: going beyond traditional surface electromyography , 2014, Front. Neurorobot..

[49]  Erik Scheme,et al.  High-density force myography: A possible alternative for upper-limb prosthetic control. , 2016, Journal of rehabilitation research and development.

[50]  Huosheng Hu,et al.  Myoelectric control systems - A survey , 2007, Biomed. Signal Process. Control..

[51]  Giancarlo Ferrigno,et al.  Artificial neural network EMG classifier for functional hand grasp movements prediction , 2016, The Journal of international medical research.

[52]  A. Kargov,et al.  A comparison of the grip force distribution in natural hands and in prosthetic hands , 2004, Disability and rehabilitation.

[53]  M. Abdoli-Eramaki,et al.  The effect of perspiration on the sEMG amplitude and power spectrum. , 2012, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[54]  Claudio Castellini,et al.  A Comparative Analysis of Three Non-Invasive Human-Machine Interfaces for the Disabled , 2014, Front. Neurorobot..

[55]  Tamara Grujic Supuk,et al.  Design, Development and Testing of a Low-Cost sEMG System and Its Use in Recording Muscle Activity in Human Gait , 2014, Sensors.

[56]  A.D.C. Chan,et al.  Examining the adverse effects of limb position on pattern recognition based myoelectric control , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[57]  Alok Prakash,et al.  A compact-sized surface EMG sensor for myoelectric hand prosthesis , 2019, Biomedical Engineering Letters.

[58]  R.N. Scott,et al.  A new strategy for multifunction myoelectric control , 1993, IEEE Transactions on Biomedical Engineering.

[59]  R.Fff. Weir,et al.  A heuristic fuzzy logic approach to EMG pattern recognition for multifunctional prosthesis control , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[60]  Dinesh Kant Kumar,et al.  Classification of low-level finger contraction from single channel surface EMG , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.