EMG and ENG-envelope pattern recognition for prosthetic hand control

BACKGROUND This paper proposes a new approach for neural control of hand prostheses, grounded on pattern recognition applied to the envelope of neural signals (eENG). NEW METHOD The ENG envelope was computed by taking into account the amplitude and the occurrence of the spike in the neural recording. A pattern recognition algorithm applied on muscular signals was defined as a reference and a comparative analysis with traditionally adopted Spike Sorting Algorithms (SSA) for neural signals has been carried out. Method validation was divided in two parts: firstly, neural signals recorded from one amputee subject through intraneural electrodes were offline analyzed to discriminate between the two performed gestures; secondly, algorithm performance decay with the increase of the number of classes was studied through synthetic data. RESULTS An accuracy of 98.26% with real data was reached with the pattern recognition applied to eENG. SSA reached an accuracy of 70%. Increasing the number of classes worsens the accuracy of this algorithm. Additionally, computational time for the pattern recognition applied to eENG is very low (32.6 μs for each sample in the data window analyzed). COMPARISON WITH EXISTING METHOD The eENG was proved to be more reliable in decoding the user intention than the SSA algorithm and it is computationally efficient. CONCLUSIONS It was demonstrated that it is possible to apply the well-known techniques of EMG pattern recognition to a conveniently processed neural signal and can pave the way to the application of neural gesture decoding in upper limb prosthetics.

[1]  Brian D. Ripley,et al.  Pattern Recognition and Neural Networks , 1996 .

[2]  Luca Citi,et al.  Restoring Natural Sensory Feedback in Real-Time Bidirectional Hand Prostheses , 2014, Science Translational Medicine.

[3]  R.N. Scott,et al.  A new strategy for multifunction myoelectric control , 1993, IEEE Transactions on Biomedical Engineering.

[4]  Sung June Kim,et al.  Neural spike sorting under nearly 0-dB signal-to-noise ratio using nonlinear energy operator and artificial neural-network classifier , 2000, IEEE Transactions on Biomedical Engineering.

[5]  D. Yatsenko,et al.  Simultaneous, Proportional, Multi-axis Prosthesis Control using Multichannel Surface EMG , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[6]  Loredana Zollo,et al.  Experimental analysis of the relationship between neural and muscular recordings during hand control , 2016, 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[7]  P. Rossini,et al.  Double nerve intraneural interface implant on a human amputee for robotic hand control , 2010, Clinical Neurophysiology.

[8]  Loredana Zollo,et al.  NLR, MLP, SVM, and LDA: a comparative analysis on EMG data from people with trans-radial amputation , 2017, Journal of NeuroEngineering and Rehabilitation.

[9]  M. Keith,et al.  A neural interface provides long-term stable natural touch perception , 2014, Science Translational Medicine.

[10]  Matias J. Ison,et al.  Realistic simulation of extracellular recordings , 2009, Journal of Neuroscience Methods.

[11]  Marie-Françoise Lucas,et al.  Optimization of wavelets for classification of movement-related cortical potentials generated by variation of force-related parameters , 2007, Journal of Neuroscience Methods.

[12]  K. Horch,et al.  Residual function in peripheral nerve stumps of amputees: implications for neural control of artificial limbs. , 2004, The Journal of hand surgery.

[13]  R.F. Weir,et al.  The Optimal Controller Delay for Myoelectric Prostheses , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[14]  Ali M. S. Zalzala,et al.  Myoelectric Signals Pattern Recognition for Intelligent Functional Operation of Upper-Limb Prosthesis , 1996 .

[15]  Timothy G. Constandinou,et al.  Feature extraction using first and second derivative extrema (FSDE) for real-time and hardware-efficient spike sorting , 2013, Journal of Neuroscience Methods.

[16]  Jian Zhang,et al.  Residual motor signal in long-term human severed peripheral nerves and feasibility of neural signal-controlled artificial limb. , 2007, The Journal of hand surgery.

[17]  Richard G. Shiavi,et al.  Analysis of raw microneurographic recordings based on wavelet de-noising technique and classification algorithm: wavelet analysis in microneurography , 2003, IEEE Transactions on Biomedical Engineering.

[18]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[19]  Christian Antfolk,et al.  Sensory feedback in upper limb prosthetics , 2013, Expert review of medical devices.

[20]  Loredana Zollo,et al.  Control of Prosthetic Hands via the Peripheral Nervous System , 2016, Front. Neurosci..

[21]  Loredana Zollo,et al.  Current Achievements and Future Directions of Hand Prostheses Controlled via Peripheral Nervous System , 2017, The Hand.

[22]  Andreas Demosthenous,et al.  Feature Extraction Using Extrema Sampling of Discrete Derivatives for Spike Sorting in Implantable Upper-Limb Neural Prostheses , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[23]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[24]  P. Rossini,et al.  Intraneural stimulation elicits discrimination of textural features by artificial fingertip in intact and amputee humans , 2016, eLife.

[25]  Loredana Zollo,et al.  Multilevel control of an anthropomorphic prosthetic hand for grasp and slip prevention , 2016 .

[26]  Dario Farina,et al.  The Extraction of Neural Information from the Surface EMG for the Control of Upper-Limb Prostheses: Emerging Avenues and Challenges , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[27]  David J. Warren,et al.  Restoration of motor control and proprioceptive and cutaneous sensation in humans with prior upper-limb amputation via multiple Utah Slanted Electrode Arrays (USEAs) implanted in residual peripheral arm nerves , 2017, Journal of NeuroEngineering and Rehabilitation.

[28]  Lucila Ohno-Machado,et al.  Logistic regression and artificial neural network classification models: a methodology review , 2002, J. Biomed. Informatics.

[29]  Loredana Zollo,et al.  A bio-inspired force control for cyclic manipulation of prosthetic hands , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[30]  Ueli Rutishauser,et al.  Online detection and sorting of extracellularly recorded action potentials in human medial temporal lobe recordings, in vivo , 2006, Journal of Neuroscience Methods.

[31]  C. Koch,et al.  On the origin of the extracellular action potential waveform: A modeling study. , 2006, Journal of neurophysiology.

[32]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[33]  Luca Citi,et al.  Decoding of grasping information from neural signals recorded using peripheral intrafascicular interfaces , 2011, Journal of NeuroEngineering and Rehabilitation.

[34]  Emiliano Noce,et al.  Grasp control of a prosthetic hand through peripheral neural signals , 2018 .

[35]  R. Quian Quiroga,et al.  Unsupervised Spike Detection and Sorting with Wavelets and Superparamagnetic Clustering , 2004, Neural Computation.

[36]  Dario Farina,et al.  Man/machine interface based on the discharge timings of spinal motor neurons after targeted muscle reinnervation , 2017, Nature Biomedical Engineering.

[37]  Rodrigo Quian Quiroga,et al.  Past, present and future of spike sorting techniques , 2015, Brain Research Bulletin.

[38]  Kathryn Ziegler-Graham,et al.  Estimating the prevalence of limb loss in the United States: 2005 to 2050. , 2008, Archives of physical medicine and rehabilitation.

[39]  Luca Citi,et al.  On the use of wavelet denoising and spike sorting techniques to process electroneurographic signals recorded using intraneural electrodes , 2008, Journal of Neuroscience Methods.

[40]  Dario Farina,et al.  Bionic Limbs: Clinical Reality and Academic Promises , 2014, Science Translational Medicine.