Toward Intuitive Prosthetic Control: Solving Common Issues Using Force Myography, Surface Electromyography, and Pattern Recognition in a Pilot Case Study

Despite the appearance of advanced multi-degrees of freedom (DoF) robotic hands during the past decade, prosthetic control lacks a powerful interface to facilitate all its functionalities in a manner that is acceptable for a majority of users [1]. In this article, we explore the feasibility of using a sensing technique called force myography (FMG) as an alternative or synergist to the traditional surface electromyography (sEMG) technique as a human-machine interface (HMI) for the control of a multi-DoF prosthetic hand, bebionic 3 by Ottobock, Austin, Texas. In this article, we present a prosthetic prototype developed for the Cybathlon 2016, a championship for racing pilots with disabilities using assistive robotic devices. The design of the prototype is discussed and the effect of two factors on its control is analyzed. These factors are 1) the impact of a multisensory approach and 2) the placement of FMG sensor strips within the prosthetic inner socket. Analysis is performed by comparing resulting pattern recognition accuracies. Results show that the use of both sensing modalities (FMG and EMG) together produced the highest pattern recognition accuracy (81.1%) for ten classes of motion (four wrist movements and six grip patterns). We demonstrated that FMG has the potential to be an HMI for control of upper-limb-powered prostheses. FMG also illustrates the potential for intuitive control through the use of pattern recognition. A multisensory approach could assist in increasing robustness of the HMI for prosthetic control.

[1]  Claudio Castellini,et al.  Assessment of a Wearable Force- and Electromyography Device and Comparison of the Related Signals for Myocontrol , 2016, Front. Neurorobot..

[2]  Francis K. H. Quek,et al.  Hand Motion Gesture Frequency Properties and Multimodal Discourse Analysis , 2006, International Journal of Computer Vision.

[3]  Stefano Stramigioli,et al.  Myoelectric forearm prostheses: state of the art from a user-centered perspective. , 2011, Journal of rehabilitation research and development.

[4]  Kathryn Ziegler-Graham,et al.  Estimating the prevalence of limb loss in the United States: 2005 to 2050. , 2008, Archives of physical medicine and rehabilitation.

[5]  Elie Bienenstock,et al.  Neural Networks and the Bias/Variance Dilemma , 1992, Neural Computation.

[6]  K. Englehart,et al.  Muscle Activation Patterns of the Forearm: High-Density Electromyography Data of Normally Limbed and Transradial Amputee Subjects , 2010 .

[7]  Hong Liu,et al.  Dynamic training protocol improves the robustness of PR-based myoelectric control , 2017, Biomed. Signal Process. Control..

[8]  E. Biddiss,et al.  Upper limb prosthesis use and abandonment: A survey of the last 25 years , 2007, Prosthetics and orthotics international.

[9]  K. Englehart,et al.  On the Suitability of Integrating Accelerometry Data with Electromyography Signals for Resolving the Effect of Changes in Limb Position during Dynamic Limb Movement , 2014 .

[10]  Claudio Castellini,et al.  A Comparative Analysis of Three Non-Invasive Human-Machine Interfaces for the Disabled , 2014, Front. Neurorobot..

[11]  Erik Scheme,et al.  High-density force myography: A possible alternative for upper-limb prosthetic control. , 2016, Journal of rehabilitation research and development.

[12]  E. Biddiss,et al.  Upper-Limb Prosthetics: Critical Factors in Device Abandonment , 2007, American journal of physical medicine & rehabilitation.

[13]  G. Naik,et al.  Transradial Amputee Gesture Classification Using an Optimal Number of sEMG Sensors: An Approach Using ICA Clustering , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[14]  Dapeng Yang,et al.  Experimental Study of an EMG-Controlled 5-DOF Anthropomorphic Prosthetic Hand for Motion Restoration , 2014, J. Intell. Robotic Syst..

[15]  Carlo Menon,et al.  Force Myography to Control Robotic Upper Extremity Prostheses: A Feasibility Study , 2016, Front. Bioeng. Biotechnol..

[16]  Panagiotis K. Artemiadis,et al.  Proceedings of the first workshop on Peripheral Machine Interfaces: going beyond traditional surface electromyography , 2014, Front. Neurorobot..

[17]  O. Stavdahl,et al.  Control of Upper Limb Prostheses: Terminology and Proportional Myoelectric Control—A Review , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  Øyvind Stavdahl,et al.  A multi-modal approach for hand motion classification using surface EMG and accelerometers , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.