Incremental learning of ensemble classifiers on ECG data

We develop novel methods of incremental learning based on the bagging and boosting approaches to ensemble learning. Our method combines perceptron decision trees obtained with a margin maximizing algorithm into an ensemble in an incremental way. We demonstrate practical functionality of our algorithm on the task of ECG records classification. Our results are promising since comparable or superior accuracy is achieved when compared with results obtained by other existing methods of classification of ECG records, namely with the C5.0 decision tree algorithm.

[1]  Stuart J. Russell,et al.  Experimental comparisons of online and batch versions of bagging and boosting , 2001, KDD '01.

[2]  K. Bennett,et al.  A support vector machine approach to decision trees , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[3]  Yoram Singer,et al.  Improved Boosting Algorithms Using Confidence-rated Predictions , 1998, COLT' 98.

[4]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[5]  Wei-Chih Hu,et al.  ECG events detection and classification using wavelet and neural networks , 1997, Proceedings of the 19th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 'Magnificent Milestones and Emerging Opportunities in Medical Engineering' (Cat. No.97CH36136).

[6]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[7]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[8]  Y. Mansour,et al.  Generalization bounds for averaged classifiers , 2004, math/0410092.