Novel Time Domain Based Upper-Limb Prosthesis Control using Incremental Learning Approach

The upper limb of the body is a vital for various kind of activities for human. The complete or partial loss of the upper limb would lead to a significant impact on daily activities of the amputees. EMG carries important information of human physique which helps to decode the various functionalities of human arm. EMG signal based bionics and prosthesis have gained huge research attention over the past decade. Conventional EMG-PR based prosthesis struggles to give accurate performance due to off-line training used and incapability to compensate for electrode position shift and change in arm position. This work proposes online training and incremental learning based system for upper limb prosthetic application. This system consists of ADS1298 as AFE (analog front end) and a 32 bit arm cortex-m4 processor for DSP (digital signal processing). The system has been tested for both intact and amputated subjects. Time derivative moment based features have been implemented and utilized for effective pattern classification. Initially, system have been trained for four classes using the on-line training process later on the number of classes have been incremented on user demand till eleven, and system performance has been evaluated. The system yielded a completion rate of 100% for healthy and amputated subjects when four motions have been considered. Further 94.33% and 92% completion rate have been showcased by the system when the number of classes increased to eleven for healthy and amputees respectively. The motion efficacy test is also evaluated for all the subjects. The highest efficacy rate of 91.23% and 88.64% are observed for intact and amputated subjects respectively.

[1]  Turan Dirlik,et al.  Application of computers in fatigue analysis , 1985 .

[2]  Ning Jiang,et al.  Wrist and Finger Gesture Recognition With Single-Element Ultrasound Signals: A Comparison With Single-Channel Surface Electromyogram , 2019, IEEE Transactions on Biomedical Engineering.

[3]  E. Priya,et al.  Correlation coefficient based featue selection for actuating myoelectric prosthetic arm , 2017, 2017 Trends in Industrial Measurement and Automation (TIMA).

[4]  Angkoon Phinyomark,et al.  EMG feature evaluation for improving myoelectric pattern recognition robustness , 2013, Expert Syst. Appl..

[5]  Ilja Kuzborskij,et al.  Characterization of a Benchmark Database for Myoelectric Movement Classification , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  A. Campeau-Lecours,et al.  Intuitive real-time control strategy for high-density myoelectric hand prosthesis using deep and transfer learning , 2021, Scientific Reports.

[7]  Guanglin Li,et al.  Development of Sensory-Motor Fusion-Based Manipulation and Grasping Control for a Robotic Hand-Eye System , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[8]  Blair A. Lock,et al.  Determining the Optimal Window Length for Pattern Recognition-Based Myoelectric Control: Balancing the Competing Effects of Classification Error and Controller Delay , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[9]  Dario Farina,et al.  The Extraction of Neural Information from the Surface EMG for the Control of Upper-Limb Prostheses: Emerging Avenues and Challenges , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  Wei Li,et al.  sEMG-Based Identification of Hand Motion Commands Using Wavelet Neural Network Combined With Discrete Wavelet Transform , 2016, IEEE Transactions on Industrial Electronics.

[11]  Yuwei Chen,et al.  Electromyography-Based Locomotion Pattern Recognition and Personal Positioning Toward Improved Context-Awareness Applications , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[12]  Nianfeng Wang,et al.  Design and Myoelectric Control of an Anthropomorphic Prosthetic Hand , 2017 .

[13]  Feng Duan,et al.  Recognizing the Gradual Changes in sEMG Characteristics Based on Incremental Learning of Wavelet Neural Network Ensemble , 2017, IEEE Transactions on Industrial Electronics.

[14]  Sidharth Pancholi,et al.  Classification of Upper Arm Movements from EEG signals using Machine Learning with ICA Analysis , 2021, ArXiv.

[15]  Anish C. Turlapaty,et al.  Feature Analysis for Classification of Physical Actions Using Surface EMG Data , 2019, IEEE Sensors Journal.

[16]  SIDHARTH PANCHOLI,et al.  INTELLIGENT UPPER-LIMB PROSTHETIC CONTROL (iULP) WITH NOVEL FEATURE EXTRACTION METHOD FOR PATTERN RECOGNITION USING EMG , 2021 .

[17]  Dario Farina,et al.  Improving the Robustness of Myoelectric Pattern Recognition for Upper Limb Prostheses by Covariate Shift Adaptation , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  Kongqiao Wang,et al.  A Framework for Hand Gesture Recognition Based on Accelerometer and EMG Sensors , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[19]  Amit M. Joshi,et al.  DepHNN: A novel hybrid neural network for electroencephalogram (EEG)-based screening of depression , 2021, Biomed. Signal Process. Control..

[20]  Abdulhamit Subasi,et al.  Classification of EMG signals using PSO optimized SVM for diagnosis of neuromuscular disorders , 2013, Comput. Biol. Medicine.

[21]  Ping Zhou,et al.  Real-Time Control of an Exoskeleton Hand Robot with Myoelectric Pattern Recognition , 2017, Int. J. Neural Syst..

[22]  Shih-Ching Yeh,et al.  Classification of multichannel surface-electromyography signals based on convolutional neural networks , 2019, J. Ind. Inf. Integr..

[23]  Ta-Te Lin,et al.  A comparison of upper-limb motion pattern recognition using EMG signals during dynamic and isometric muscle contractions , 2014, Biomed. Signal Process. Control..

[24]  Mitsuhiro Hayashibe,et al.  Muscle Fatigue Induced Hand Tremor Clustering in Dynamic Laparoscopic Manipulation , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[25]  Luca Benini,et al.  A Versatile Embedded Platform for EMG Acquisition and Gesture Recognition , 2015, IEEE Transactions on Biomedical Circuits and Systems.

[26]  Amit M. Joshi,et al.  Time Derivative Moments Based Feature Extraction Approach for Recognition of Upper Limb Motions Using EMG , 2019, IEEE Sensors Letters.

[27]  Timothy H. Lucas,et al.  The Virtual Trackpad: An Electromyography-Based, Wireless, Real-Time, Low-Power, Embedded Hand-Gesture-Recognition System Using an Event-Driven Artificial Neural Network , 2017, IEEE Transactions on Circuits and Systems II: Express Briefs.

[28]  Amit M. Joshi,et al.  Electromyography-Based Hand Gesture Recognition System for Upper Limb Amputees , 2019, IEEE Sensors Letters.

[29]  Amit M. Joshi,et al.  Portable EMG Data Acquisition Module for Upper Limb Prosthesis Application , 2018, IEEE Sensors Journal.

[30]  Hui Wang,et al.  Pattern recognition of electromyography signals based on novel time domain features for amputees' limb motion classification , 2017, Comput. Electr. Eng..

[31]  Yuan Yan Tang,et al.  New Incremental Learning Algorithm With Support Vector Machines , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[32]  Dennis C. Tkach,et al.  Study of stability of time-domain features for electromyographic pattern recognition , 2010, Journal of NeuroEngineering and Rehabilitation.

[33]  J. Rabaey,et al.  A wearable biosensing system with in-sensor adaptive machine learning for hand gesture recognition , 2020, Nature Electronics.

[34]  L. L. Grigsby,et al.  An Extension of Parseval's Theorem and Its Use in Calculating Transient Energy in the Frequency Domain , 1983, IEEE Transactions on Industrial Electronics.

[35]  Prateek Jain,et al.  A Novel Time-Domain based Feature for EMG-PR Prosthetic and Rehabilitation Application , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[36]  Xu Zhang,et al.  A Novel Postprocessing Method for Robust Myoelectric Pattern-Recognition Control Through Movement Pattern Transition Detection , 2020, IEEE Transactions on Human-Machine Systems.

[37]  Sidharth Pancholi,et al.  Advanced Energy Kernel-Based Feature Extraction Scheme for Improved EMG-PR-Based Prosthesis Control Against Force Variation , 2020, IEEE Transactions on Cybernetics.

[38]  Amit M. Joshi,et al.  Improved Classification Scheme Using Fused Wavelet Packet Transform Based Features for Intelligent Myoelectric Prostheses , 2020, IEEE Transactions on Industrial Electronics.

[39]  Agamemnon Krasoulis,et al.  Myoelectric digit action decoding with multi-output, multi-class classification: an offline analysis , 2020, Scientific Reports.

[40]  Luca Benini,et al.  Efficient Biosignal Processing Using Hyperdimensional Computing: Network Templates for Combined Learning and Classification of ExG Signals , 2019, Proceedings of the IEEE.

[41]  Pornchai Phukpattaranont,et al.  Feature reduction and selection for EMG signal classification , 2012, Expert Syst. Appl..