Deep Learning Approaches for Phantom Movement Recognition

Phantom limb pain has a negative effect on the life of individuals as a frequent consequence of limb amputation. The movement ability on the lost extremity can still be maintained after the amputation or deafferentation, which is called the phantom movement. The detection of these movements makes sense for cybertherapy and prosthetic control for amputees. In this paper, we employed several deep learning approaches to recognize phantom movements of the three different amputation regions including above-elbow, below-knee and above-knee. We created a dataset that contains 25 healthy and 16 amputee participants' surface electromyography (sEMG) readings via a wearable device with 2-channel EMG sensors. We compared the results of three different deep learning methods, respectively, Multilayer Perceptron, Convolutional Neural Network, and Recurrent Neural Network with the accuracies of two well-known shallow methods, k Nearest Neighbor and Random Forest. Our experiments indicate, Convolutional Neural Network-based model achieved an accuracy of 74.48% in recognizing phantom movements of amputees.

[1]  K. Reilly,et al.  Persistent hand motor commands in the amputees' brain. , 2006, Brain : a journal of neurology.

[2]  Heidi Johansen-Berg,et al.  Reaffirming the link between chronic phantom limb pain and maintained missing hand representation , 2018, Cortex.

[3]  R. S. Waters,et al.  A review of current theories and treatments for phantom limb pain , 2018, The Journal of clinical investigation.

[4]  Max Ortiz-Catalan,et al.  BioPatRec: A modular research platform for the control of artificial limbs based on pattern recognition algorithms , 2013, Source Code for Biology and Medicine.

[5]  C. Nicol,et al.  Classification of Phantom Finger, Hand, Wrist, and Elbow Voluntary Gestures in Transhumeral Amputees With sEMG , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  T. Jensen,et al.  Phantom limb pain. , 2001, British journal of anaesthesia.

[7]  K. Reilly,et al.  Mapping phantom movement representations in the motor cortex of amputees. , 2006, Brain : a journal of neurology.

[8]  M. Ortiz-Catalán The Stochastic Entanglement and Phantom Motor Execution Hypotheses: A Theoretical Framework for the Origin and Treatment of Phantom Limb Pain , 2018, Front. Neurol..

[9]  Akhan Akbulut,et al.  A Wearable Device for Virtual Cyber Therapy of Phantom Limb Pain , 2018, 2018 International Conference on Artificial Intelligence and Data Processing (IDAP).

[10]  Nitish V. Thakor,et al.  User Training for Pattern Recognition-Based Myoelectric Prostheses: Improving Phantom Limb Movement Consistency and Distinguishability , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[11]  Chris Yakopcic,et al.  A State-of-the-Art Survey on Deep Learning Theory and Architectures , 2019, Electronics.

[12]  Abdulkadir Şeker,et al.  Derin Öğrenme Yöntemleri Ve Uygulamaları Hakkında Bir İnceleme , 2017 .

[13]  A. Stockselius,et al.  Phantom motor execution facilitated by machine learning and augmented reality as treatment for phantom limb pain: a single group, clinical trial in patients with chronic intractable phantom limb pain , 2016, The Lancet.

[14]  M. Ortiz-Catalán,et al.  Real-time Classification of Non-Weight Bearing Lower-Limb Movements Using EMG to Facilitate Phantom Motor Execution: Engineering and Case Study Application on Phantom Limb Pain , 2017, Front. Neurol..

[15]  C. K. van der Sluis,et al.  Phantom motor execution as a treatment for phantom limb pain: protocol of an international, double-blind, randomised controlled clinical trial , 2018, BMJ Open.

[16]  M. Ortiz-Catalán,et al.  Treatment of phantom limb pain (PLP) based on augmented reality and gaming controlled by myoelectric pattern recognition: a case study of a chronic PLP patient , 2014, Front. Neurosci..

[17]  Marc H Schieber,et al.  Selective activation of human finger muscles after stroke or amputation. , 2009, Advances in experimental medicine and biology.

[18]  Graham Morgan,et al.  Deep learning-based artificial vision for grasp classification in myoelectric hands , 2017, Journal of neural engineering.

[19]  Max Ortiz-Catalan,et al.  Offline accuracy: A potentially misleading metric in myoelectric pattern recognition for prosthetic control , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).