An IoT-Enabled Stroke Rehabilitation System Based on Smart Wearable Armband and Machine Learning

Surface electromyography signal plays an important role in hand function recovery training. In this paper, an IoT-enabled stroke rehabilitation system was introduced which was based on a smart wearable armband (SWA), machine learning (ML) algorithms, and a 3-D printed dexterous robot hand. User comfort is one of the key issues which should be addressed for wearable devices. The SWA was developed by integrating a low-power and tiny-sized IoT sensing device with textile electrodes, which can measure, pre-process, and wirelessly transmit bio-potential signals. By evenly distributing surface electrodes over user’s forearm, drawbacks of classification accuracy poor performance can be mitigated. A new method was put forward to find the optimal feature set. ML algorithms were leveraged to analyze and discriminate features of different hand movements, and their performances were appraised by classification complexity estimating algorithms and principal components analysis. According to the verification results, all nine gestures can be successfully identified with an average accuracy up to 96.20%. In addition, a 3-D printed five-finger robot hand was implemented for hand rehabilitation training purpose. Correspondingly, user’s hand movement intentions were extracted and converted into a series of commands which were used to drive motors assembled inside the dexterous robot hand. As a result, the dexterous robot hand can mimic the user’s gesture in a real-time manner, which shows the proposed system can be used as a training tool to facilitate rehabilitation process for the patients after stroke.

[1]  Lida Xu,et al.  EMG and EPP-Integrated Human–Machine Interface Between the Paralyzed and Rehabilitation Exoskeleton , 2012, IEEE Transactions on Information Technology in Biomedicine.

[2]  Richard F. Weir,et al.  A Comparison of the Effects of Electrode Implantation and Targeting on Pattern Classification Accuracy for Prosthesis Control , 2008, IEEE Transactions on Biomedical Engineering.

[3]  Ping Zhou,et al.  High-Density Myoelectric Pattern Recognition Toward Improved Stroke Rehabilitation , 2012, IEEE Transactions on Biomedical Engineering.

[4]  Panagiotis K. Artemiadis,et al.  A Learning Scheme for Reach to Grasp Movements: On EMG-Based Interfaces Using Task Specific Motion Decoding Models , 2013, IEEE Journal of Biomedical and Health Informatics.

[5]  Yong Chen,et al.  Industrial information integration - A literature review 2006-2015 , 2016, J. Ind. Inf. Integr..

[6]  Lida Xu,et al.  Feature space theory in data mining: transformations between extensions and intensions in knowledge representation , 2003, Expert Syst. J. Knowl. Eng..

[7]  Max Ortiz-Catalan,et al.  BioPatRec: A modular research platform for the control of artificial limbs based on pattern recognition algorithms , 2013, Source Code for Biology and Medicine.

[8]  Johannes Wagner,et al.  Bi-channel sensor fusion for automatic sign language recognition , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[9]  Hong Wang,et al.  Identity management based on PCA and SVM , 2016, Inf. Syst. Frontiers.

[10]  Adrian D. C. Chan,et al.  A Gaussian mixture model based classification scheme for myoelectric control of powered upper limb prostheses , 2005, IEEE Transactions on Biomedical Engineering.

[11]  Ping Zhou,et al.  Wavelet Packet Feature Assessment for High-Density Myoelectric Pattern Recognition and Channel Selection toward Stroke Rehabilitation , 2016, Front. Neurol..

[12]  Hongming Cai,et al.  Ubiquitous Data Accessing Method in IoT-Based Information System for Emergency Medical Services , 2014, IEEE Transactions on Industrial Informatics.

[13]  Feiping Nie,et al.  Learning a Mahalanobis distance metric for data clustering and classification , 2008, Pattern Recognit..

[14]  Guanglin Li,et al.  EMG feature assessment for myoelectric pattern recognition and channel selection: a study with incomplete spinal cord injury. , 2014, Medical engineering & physics.

[15]  Yong Chen,et al.  An emerging technology – wearable wireless sensor networks with applications in human health condition monitoring , 2015 .

[16]  G. Kwakkel,et al.  The impact of physical therapy on functional outcomes after stroke: what's the evidence? , 2004, Clinical rehabilitation.

[17]  Huosheng Hu,et al.  Support Vector Machine-Based Classification Scheme for Myoelectric Control Applied to Upper Limb , 2008, IEEE Transactions on Biomedical Engineering.

[18]  D. Wade,et al.  Recovery after stroke , 1983, Journal of neurology, neurosurgery, and psychiatry.

[19]  K. Englehart,et al.  Classification of the myoelectric signal using time-frequency based representations. , 1999, Medical engineering & physics.

[20]  Xinjun Sheng,et al.  Development of a Multi-Channel Compact-Size Wireless Hybrid sEMG/NIRS Sensor System for Prosthetic Manipulation , 2016, IEEE Sensors Journal.

[21]  Desney S. Tan,et al.  Demonstrating the feasibility of using forearm electromyography for muscle-computer interfaces , 2008, CHI.

[22]  L Dipietro,et al.  Changing motor synergies in chronic stroke. , 2007, Journal of neurophysiology.

[23]  T. Twitchell The restoration of motor function following hemiplegia in man. , 1951, Brain : a journal of neurology.

[24]  E. Curran,et al.  Learning to control brain activity: A review of the production and control of EEG components for driving brain–computer interface (BCI) systems , 2003, Brain and Cognition.

[25]  H.I. Krebs,et al.  Robot-Aided Neurorehabilitation: A Robot for Wrist Rehabilitation , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[26]  Xinjun Sheng,et al.  Mechanomyography Assisted Myoeletric Sensing for Upper-Extremity Prostheses: A Hybrid Approach , 2017, IEEE Sensors Journal.

[27]  Nathan E. Bunderson,et al.  Quantification of Feature Space Changes With Experience During Electromyogram Pattern Recognition Control , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[28]  Yuehong Yin,et al.  The internet of things in healthcare: An overview , 2016, J. Ind. Inf. Integr..

[29]  Lida Xu,et al.  IoT-Based Smart Rehabilitation System , 2014, IEEE Transactions on Industrial Informatics.

[30]  Qiang Chen,et al.  A Health-IoT Platform Based on the Integration of Intelligent Packaging, Unobtrusive Bio-Sensor, and Intelligent Medicine Box , 2014, IEEE Transactions on Industrial Informatics.

[31]  Elisabeth André,et al.  EMG-based hand gesture recognition for realtime biosignal interfacing , 2008, IUI '08.

[32]  M. Ortiz-Catalán,et al.  Treatment of phantom limb pain (PLP) based on augmented reality and gaming controlled by myoelectric pattern recognition: a case study of a chronic PLP patient , 2014, Front. Neurosci..

[33]  R.N. Scott,et al.  A new strategy for multifunction myoelectric control , 1993, IEEE Transactions on Biomedical Engineering.

[34]  Max Ortiz-Catalan,et al.  Multi-layer perceptron training algorithms for pattern recognition of myoelectric signals , 2013, The 6th 2013 Biomedical Engineering International Conference.

[35]  C. Burgar,et al.  Quantification of force abnormalities during passive and active-assisted upper-limb reaching movements in post-stroke hemiparesis , 1999, IEEE Transactions on Biomedical Engineering.

[36]  Sang Wook Lee,et al.  Subject-Specific Myoelectric Pattern Classification of Functional Hand Movements for Stroke Survivors , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[37]  Qiang Cheng,et al.  The Fisher-Markov Selector: Fast Selecting Maximally Separable Feature Subset for Multiclass Classification with Applications to High-Dimensional Data , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Le Li,et al.  Assistive Control System Using Continuous Myoelectric Signal in Robot-Aided Arm Training for Patients After Stroke , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[39]  Xin Zheng,et al.  Multi-Gradient Surface Electromyography (SEMG) Movement Feature Recognition Based on Wavelet Packet Analysis and Support Vector Machine (SVM) , 2011, 2011 5th International Conference on Bioinformatics and Biomedical Engineering.

[40]  Kongqiao Wang,et al.  A Framework for Hand Gesture Recognition Based on Accelerometer and EMG Sensors , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[41]  Guanglin Li,et al.  An adaptation strategy of using LDA classifier for EMG pattern recognition , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[42]  Hongming Cai,et al.  The design of an m-Health monitoring system based on a cloud computing platform , 2017, Enterp. Inf. Syst..

[43]  Max Ortiz-Catalan,et al.  Classification complexity in myoelectric pattern recognition , 2017, Journal of NeuroEngineering and Rehabilitation.

[44]  Xiaohong Guan,et al.  An SVM-based machine learning method for accurate internet traffic classification , 2010, Inf. Syst. Frontiers.

[45]  Xu Zhang,et al.  Several practical issues toward implementing myoelectric pattern recognition for stroke rehabilitation. , 2014, Medical engineering & physics.

[46]  Rong Song,et al.  A Comparison Between Electromyography-Driven Robot and Passive Motion Device on Wrist Rehabilitation for Chronic Stroke , 2009, Neurorehabilitation and neural repair.

[47]  Wu He,et al.  Internet of Things in Industries: A Survey , 2014, IEEE Transactions on Industrial Informatics.

[48]  Zhuming Bi,et al.  Support vector machine and ROC curves for modeling of aircraft fuel consumption , 2015 .

[49]  Lida Xu,et al.  Feature space theory - a mathematical foundation for data mining , 2001, Knowl. Based Syst..