Comparison of Bagging and Boosting Ensemble Machine Learning Methods for Automated EMG Signal Classification

The neuromuscular disorders are diagnosed using electromyographic (EMG) signals. Machine learning algorithms are employed as a decision support system to diagnose neuromuscular disorders. This paper compares bagging and boosting ensemble learning methods to classify EMG signals automatically. Even though ensemble classifiers' efficacy in relation to real-life issues has been presented in numerous studies, there are almost no studies which focus on the feasibility of bagging and boosting ensemble classifiers to diagnose the neuromuscular disorders. Therefore, the purpose of this paper is to assess the feasibility of bagging and boosting ensemble classifiers to diagnose neuromuscular disorders through the use of EMG signals. It should be understood that there are three steps to this method, where the step number one is to calculate the wavelet packed coefficients (WPC) for every type of EMG signal. After this, it is necessary to calculate statistical values of WPC so that the distribution of wavelet coefficients could be demonstrated. In the last step, an ensemble classifier used the extracted features as an input of the classifier to diagnose the neuromuscular disorders. Experimental results showed the ensemble classifiers achieved better performance for diagnosis of neuromuscular disorders. Results are promising and showed that the AdaBoost with random forest ensemble method achieved an accuracy of 99.08%, F-measure 0.99, AUC 1, and kappa statistic 0.99.

[1]  Constantinos S. Pattichis,et al.  Neural network models in EMG diagnosis , 1995 .

[2]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[3]  Mohamed S. Kamel,et al.  A software package for interactive motor unit potential classification using fuzzy k-NN classifier , 2008, Comput. Methods Programs Biomed..

[4]  Abdulkadir Sengür,et al.  Evaluation of ensemble methods for diagnosing of valvular heart disease , 2010, Expert Syst. Appl..

[5]  Giorgio Valentini,et al.  Feature Selection Combined with Random Subspace Ensemble for Gene Expression Based Diagnosis of Malignancies , 2004, WIRN.

[6]  Dejey,et al.  A HYBRID ELM-WAVELET TECHNIQUE FOR THE CLASSIFICATION AND DIAGNOSIS OF NEUROMUSCULAR DISORDER USING EMG SIGNAL , 2015 .

[7]  Jamileh Yousefi,et al.  Characterizing EMG data using machine-learning tools , 2014, Comput. Biol. Medicine.

[8]  A. Viera,et al.  Understanding interobserver agreement: the kappa statistic. , 2005, Family medicine.

[9]  Gavin Brown,et al.  Ensemble Learning , 2010, Encyclopedia of Machine Learning and Data Mining.

[10]  Reza Boostani,et al.  A Multi-Classifier Approach to MUAP Classification for Diagnosis of Neuromuscular Disorders , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[11]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[12]  Pornchai Phukpattaranont,et al.  Feature reduction and selection for EMG signal classification , 2012, Expert Syst. Appl..

[13]  Abdulhamit Subasi,et al.  A decision support system for diagnosis of neuromuscular disorders using DWT and evolutionary support vector machines , 2013, Signal, Image and Video Processing.

[14]  Sabri Koçer,et al.  Classification of EMG Signals Using PCA and FFT , 2005, Journal of Medical Systems.

[15]  Alan S. Willsky,et al.  A Wavelet Packet Approach to Transient Signal Classification , 1995 .

[16]  Abdulhamit Subasi,et al.  Classification of EMG signals using combined features and soft computing techniques , 2012, Appl. Soft Comput..

[17]  Zhi-Hua Zhou,et al.  Ensemble Methods: Foundations and Algorithms , 2012 .

[18]  Jerry M. Mendel,et al.  Tutorial on higher-order statistics (spectra) in signal processing and system theory: theoretical results and some applications , 1991, Proc. IEEE.

[19]  Abdulhamit Subasi,et al.  Medical decision support system for diagnosis of neuromuscular disorders using DWT and fuzzy support vector machines , 2012, Comput. Biol. Medicine.

[20]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[21]  I. Daubechies Orthonormal bases of compactly supported wavelets , 1988 .

[22]  Dheeraj Sharma,et al.  An efficient method for analysis of EMG signals using improved empirical mode decomposition , 2017 .

[23]  Mukesh Tiwari,et al.  A Multi-Classifier Approach of EMG Signal Classification for Diagnosis of Neuromuscular Disorders , 2016 .

[24]  Yoav Freund,et al.  Boosting the margin: A new explanation for the effectiveness of voting methods , 1997, ICML.

[25]  Jasmin Kevric,et al.  Biomedical Signal Processing and Control , 2016 .

[26]  Abdulhamit Subasi,et al.  Classification of EMG signals using PSO optimized SVM for diagnosis of neuromuscular disorders , 2013, Comput. Biol. Medicine.

[27]  A. Fuglsang-Frederiksen The utility of interference pattern analysis , 2000, Muscle & nerve.

[28]  Zhao Yang,et al.  Weighted kappa statistic for clustered matched-pair ordinal data , 2015, Comput. Stat. Data Anal..

[29]  Geoffrey I. Webb,et al.  MultiBoosting: A Technique for Combining Boosting and Wagging , 2000, Machine Learning.

[30]  Juan José Rodríguez Diez,et al.  Random Subspace Ensembles for fMRI Classification , 2010, IEEE Transactions on Medical Imaging.

[31]  Eric Bauer,et al.  An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants , 1999, Machine Learning.

[32]  Ingrid Daubechies,et al.  The wavelet transform, time-frequency localization and signal analysis , 1990, IEEE Trans. Inf. Theory.

[33]  Martin Vetterli,et al.  Wavelets and filter banks: theory and design , 1992, IEEE Trans. Signal Process..

[34]  Miki Nikolic,et al.  EMGTools, an Adaptive and Versatile Tool for Detailed EMG Analysis , 2011, IEEE Transactions on Biomedical Engineering.

[35]  Mustafa Yilmaz,et al.  Comparison of AR parametric methods with subspace-based methods for EMG signal classification using stand-alone and merged neural network models , 2016 .

[36]  Giorgio Valentini,et al.  Bias-Variance Analysis of Support Vector Machines for the Development of SVM-Based Ensemble Methods , 2004, J. Mach. Learn. Res..

[37]  Christos D. Katsis,et al.  A novel method for automated EMG decomposition and MUAP classification , 2006, Artif. Intell. Medicine.

[38]  Christos D. Katsis,et al.  A two-stage method for MUAP classification based on EMG decomposition , 2007, Comput. Biol. Medicine.

[39]  Ram Bilas Pachori,et al.  Computer aided detection of abnormal EMG signals based on tunable-Q wavelet transform , 2017, 2017 4th International Conference on Signal Processing and Integrated Networks (SPIN).

[40]  Mustafa Yilmaz,et al.  Classification of EMG signals using wavelet neural network , 2006, Journal of Neuroscience Methods.

[41]  Andrzej Wolczowski,et al.  Towards an EMG-Controlled Prosthetic Hand Using a 3-D Electromagnetic Positioning System , 2007, IEEE Transactions on Instrumentation and Measurement.

[42]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[43]  Zhao Yang,et al.  Kappa statistic for clustered physician-patients polytomous data , 2015, Comput. Stat. Data Anal..

[44]  Ajat Shatru Arora,et al.  Multi-class support vector machine classifier in EMG diagnosis , 2009 .

[45]  C. Lantz,et al.  Behavior and interpretation of the κ statistic: Resolution of the two paradoxes , 1996 .

[46]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[47]  Adrian D. C. Chan,et al.  Automated Biosignal Quality Analysis for Electromyography Using a One-Class Support Vector Machine , 2014, IEEE Transactions on Instrumentation and Measurement.

[48]  Marcel J. T. Reinders,et al.  Random subspace method for multivariate feature selection , 2006, Pattern Recognit. Lett..

[49]  Abdulhamit Subasi,et al.  Comparison of decision tree algorithms for EMG signal classification using DWT , 2015, Biomed. Signal Process. Control..

[50]  Varun Bajaj,et al.  Classification of amyotrophic lateral sclerosis disease based on convolutional neural network and reinforcement sample learning algorithm , 2017, Health Inf. Sci. Syst..

[51]  Lachit Dutta,et al.  An automatic feature extraction and fusion model: application to electromyogram (EMG) signal classification , 2018, International Journal of Multimedia Information Retrieval.

[52]  Abdulhamit Subasi,et al.  Automated EMG Signal Classification for Diagnosis of Neuromuscular Disorders Using DWT and Bagging , 2018 .

[53]  Abdulhamit Subasi,et al.  Effect of multiscale PCA de-noising on EMG signal classification for diagnosis of neuromuscular disorders , 2014, Journal of Medical Systems.

[54]  Robert P. W. Duin,et al.  Bagging, Boosting and the Random Subspace Method for Linear Classifiers , 2002, Pattern Analysis & Applications.

[55]  Yakup Kutlu,et al.  Feature extraction for ECG heartbeats using higher order statistics of WPD coefficients , 2012, Comput. Methods Programs Biomed..

[56]  Anil Kumar,et al.  Classification of normal, ALS, and myopathy EMG signals using ELM classifier , 2016, 2016 2nd International Conference on Advances in Electrical, Electronics, Information, Communication and Bio-Informatics (AEEICB).

[57]  Michael Unser,et al.  A review of wavelets in biomedical applications , 1996, Proc. IEEE.