Fusion of multiple classifiers for motor unit potential sorting

Abstract To achieve improved classification performance, a multiclassifier fusion approach for motor unit potential (MUP) sorting during electromyographic (EMG) signal decomposition was investigated. A classifier fusion system was developed that aggregates, at the abstract and measurement levels, the outputs of an ensemble of heterogeneous base classifiers to reach a collective decision, and then uses an adaptive feedback control system that detects and processes classification errors by using motor unit firing pattern consistency statistics. Three types of base classifiers were used: certainty, adaptive certainty, and adaptive fuzzy k-NN. Performance of the developed system was evaluated using real and synthetic simulated EMG signals with known properties and compared with the performance of the constituent base classifiers. Across the sets of EMG signal data sets studied, the classifier fusion schemes had better average classification performance, especially in terms of improving correct classification rates. Relative to the average performance of base classifiers and based on the difference between correct classification rate CC r and error rate E r , the adaptive average rule classifier fusion scheme shows on average: for the set of real signals an improvement of 9.2%; for the set of simulated signals of varying intensity an improvement of 6%; and for the set of simulated signals of varying amounts of shape and/or firing pattern variability an improvement of 7.7%.

[1]  David H. Wolpert,et al.  Stacked generalization , 1992, Neural Networks.

[2]  H. Devries MUSCLES ALIVE-THEIR FUNCTIONS REVEALED BY ELECTROMYOGRAPHY , 1976 .

[3]  D. Stashuk,et al.  Robust method for estimating motor unit firing-pattern statistics , 2007, Medical and Biological Engineering and Computing.

[4]  R. Schapire The Strength of Weak Learnability , 1990, Machine Learning.

[5]  Roberto Brunelli,et al.  Person identification using multiple cues , 1995, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  M. Sugeno FUZZY MEASURES AND FUZZY INTEGRALS—A SURVEY , 1993 .

[7]  Mohamed S. Kamel,et al.  Multi-classification techniques applied to EMG signal decomposition , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[8]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[9]  Luís A. Alexandre,et al.  On combining classifiers using sum and product rules , 2001, Pattern Recognit. Lett..

[10]  James C. Bezdek,et al.  Decision templates for multiple classifier fusion: an experimental comparison , 2001, Pattern Recognit..

[11]  Robert P. W. Duin,et al.  The combining classifier: to train or not to train? , 2002, Object recognition supported by user interaction for service robots.

[12]  Kevin W. Bowyer,et al.  Combination of multiple classifiers using local accuracy estimates , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Concettina Guerra,et al.  A Graph-Theoretic Method for Decomposing Two-Dimensional Polygonal Shapes into Meaningful Parts , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Ching Y. Suen,et al.  Multiple Classifier Combination Methodologies for Different Output Levels , 2000, Multiple Classifier Systems.

[15]  P. Gader,et al.  Advances in fuzzy integration for pattern recognition , 1994, CVPR 1994.

[16]  Mohamed Kamel,et al.  Adaptive fuzzy k-NN classifier for EMG signal decomposition. , 2006, Medical engineering & physics.

[17]  Sung-Bae Cho,et al.  Combining multiple neural networks by fuzzy integral for robust classification , 1995, IEEE Trans. Syst. Man Cybern..

[18]  Shiro Usui,et al.  Digital Low-Pass Differentiation for Biological Signal Processing , 1982, IEEE Transactions on Biomedical Engineering.

[19]  Sherif Hashem,et al.  Optimal Linear Combinations of Neural Networks , 1997, Neural Networks.

[20]  Thomas G. Dietterich Machine-Learning Research Four Current Directions , 1997 .

[21]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[22]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[23]  Michael P. Perrone Averaging/modular techniques for neural networks , 1998 .

[24]  D Stashuk,et al.  EMG signal decomposition: how can it be accomplished and used? , 2001, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[25]  Ching Y. Suen,et al.  Application of majority voting to pattern recognition: an analysis of its behavior and performance , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[26]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[27]  Sarbast M. Rasheed,et al.  A Multiclassifier Approach to Motor Unit Potential Classification for EMG Signal Decomposition , 2006 .

[28]  Mohamed S. Kamel,et al.  Feature-based architectures for decision fusion , 2003 .

[29]  Sargur N. Srihari,et al.  Decision Combination in Multiple Classifier Systems , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Sung-Bae Cho,et al.  Multiple network fusion using fuzzy logic , 1995, IEEE Trans. Neural Networks.

[32]  Daniel W. Stashuk,et al.  Physiologically based simulation of clinical EMG signals , 2005, IEEE Transactions on Biomedical Engineering.

[33]  Antanas Verikas,et al.  Soft combination of neural classifiers: A comparative study , 1999, Pattern Recognit. Lett..

[34]  Mohamed S. Kamel,et al.  Adaptive certainty-based classification for decomposition of EMG signals , 2006, Medical and Biological Engineering and Computing.

[35]  Giorgio Valentini,et al.  Ensembles of Learning Machines , 2002, WIRN.

[36]  Robert E. Schapire,et al.  The strength of weak learnability , 1990, Mach. Learn..

[37]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Dr. D. Stashuk,et al.  Robust supervised classification of motor unit action potentials , 2006, Medical and Biological Engineering and Computing.

[39]  Mohamed S. Kamel,et al.  Data Dependence in Combining Classifiers , 2003, Multiple Classifier Systems.

[40]  Ludmila I. Kuncheva,et al.  Fuzzy Classifier Design , 2000, Studies in Fuzziness and Soft Computing.

[41]  Robert P. W. Duin,et al.  Experiments with Classifier Combining Rules , 2000, Multiple Classifier Systems.