A Control and Posture Recognition Strategy for Upper-Limb Rehabilitation of Stroke Patients

At present, the study of upper-limb posture recognition is still in the primary stage; due to the diversity of the objective environment and the complexity of the human body posture, the upper-limb posture has no public dataset. In this paper, an upper extremity data acquisition system is designed, with a three-channel data acquisition mode, collect acceleration signal, and gyroscope signal as sample data. The datasets were preprocessed with deweighting, interpolation, and feature extraction. With the goal of recognizing human posture, experiments with KNN, logistic regression, and random gradient descent algorithms were conducted. In order to verify the superiority of each algorithm, the data window was adjusted to compare the recognition speed, computation time, and accuracy of each classifier. For the problem of improving the accuracy of human posture recognition, a neural network model based on full connectivity is developed. In addition, this paper proposes a finite state machine- (FSM-) based FES control model for controlling the upper limb to perform a range of functional tasks. In the process of constructing the network model, the effects of different hidden layers, activation functions, and optimizers on the recognition rate were experimental for the comparative analysis; the softplus activation function with better recognition performance and the adagrad optimizer are selected. Finally, by comparing the comprehensive recognition accuracy and time efficiency with other classification models, the fully connected neural network is verified in the human posture superiority in identification.

[1]  Giovanni Saggio,et al.  Modeling Wearable Bend Sensor Behavior for Human Motion Capture , 2014, IEEE Sensors Journal.

[2]  Ao Li,et al.  A novel method for user-defined human posture recognition using Kinect , 2014, 2014 7th International Congress on Image and Signal Processing.

[3]  Cristina P. Santos,et al.  An Inertial Data-Based Upper Body Posture Recognition Tool: A Machine Learning Study Approach , 2020, 2020 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC).

[4]  Saeid Nahavandi,et al.  RGB-D human posture analysis for ergonomie studies using deep convolutional neural network , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[5]  T. Andriacchi,et al.  Inertial Sensor-Based Feedback Can Reduce Key Risk Metrics for Anterior Cruciate Ligament Injury During Jump Landings , 2012, The American journal of sports medicine.

[6]  R. Akinyemi,et al.  Prevention of stroke: a global perspective , 2018, The Lancet.

[7]  Shaohua Wan,et al.  A unified two-parallel-branch deep neural network for joint gland contour and segmentation learning , 2019, Future Gener. Comput. Syst..

[8]  Yongsheng Ou,et al.  Accurate fall detection by nine-axis IMU sensor , 2017, 2017 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[9]  Nitin Sharma,et al.  Experimental demonstration of a delay compensating controller in a hybrid walking neuroprosthesis , 2017, 2017 8th International IEEE/EMBS Conference on Neural Engineering (NER).

[10]  Yuling Xi,et al.  Visual question answering model based on visual relationship detection , 2020, Signal Process. Image Commun..

[11]  Lu Huang,et al.  Posture Recognition and Heading Estimation Based on Machine Learning Using MEMS Sensors , 2019 .

[12]  J R Wolpaw,et al.  Therapeutic neural effects of electrical stimulation. , 1996, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[13]  David Lee,et al.  Principles and methods of testing finite state machines-a survey , 1996, Proc. IEEE.

[14]  Martin J.-D. Otis,et al.  Use of a 3DOF Accelerometer for Foot Tracking and Gesture Recognition in Mobile HCI , 2013, ANT/SEIT.

[15]  Mianxiong Dong,et al.  Hierarchical Posture Representation for Robust Action Recognition , 2019, IEEE Transactions on Computational Social Systems.

[16]  Qing Guo,et al.  Human Posture Recognition and fall detection Using Kinect V2 Camera , 2019, 2019 Chinese Control Conference (CCC).

[17]  Nassir Navab,et al.  Learning Gestures for Customizable Human-Computer Interaction in the Operating Room , 2011, MICCAI.

[18]  Liberson Wt,et al.  Functional electrotherapy: stimulation of the peroneal nerve synchronized with the swing phase of the gait of hemiplegic patients. , 1961, Archives of physical medicine and rehabilitation.

[19]  Dingguo Zhang,et al.  sEMG Bias-Driven Functional Electrical Stimulation System for Upper-Limb Stroke Rehabilitation , 2018, IEEE Sensors Journal.

[20]  Manjunatha Mahadevappa,et al.  Effect of functional electrical stimulation on the effort and walking speed, surface electromyography activity, and metabolic responses in stroke subjects. , 2010, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[21]  Qin Zhang,et al.  Evoked Electromyography-Based Closed-Loop Torque Control in Functional Electrical Stimulation , 2013, IEEE Transactions on Biomedical Engineering.

[22]  Yu Zhao,et al.  Knowledge-Aided Convolutional Neural Network for Small Organ Segmentation , 2019, IEEE Journal of Biomedical and Health Informatics.

[23]  R. Riener,et al.  Model-based control of FES-induced single joint movements , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[24]  Warren E. Dixon,et al.  Closed-Loop Neuromuscular Electrical Stimulation Method Provides Robustness to Unknown Time-Varying Input Delay in Muscle Dynamics , 2020, IEEE Transactions on Control Systems Technology.

[25]  Najoua Essoukri Ben Amara,et al.  Human posture recognition approach based on ConvNets and SVM classifier , 2017, 2017 International Conference on Advanced Technologies for Signal and Image Processing (ATSIP).

[26]  I-Ming Chen,et al.  Wearable wireless sensing system for capturing human arm motion , 2011 .