LCSE: Learning Classifier System Ensemble for Incremental Medical Instances

This paper proposes LCSE, a learning classifier system ensemble, which is an extension to the classical learning classifier system(LCS). The classical LCS includes two major modules, a genetic algorithm module used to facilitate rule discovery, and a reinforcement learning module used to adjust the strength of the corresponding rules after the learning module receives the rewards from the environment. In LCSE we build a two-level ensemble architecture to enhance the generalization of LCS. In the first-level, new instances are first bootstrapped and sent to several LCSs for classification. Then, in the second-level, a simple plurality-vote method is used to combine the classification results of individual LCSs into a final decision. Experiments on some benchmark medical data sets from the UCI repository have shown that LCSE has better performance on incremental medical data learning and better generalization ability than the single LCS and other supervised learning methods.

[1]  Eric Bauer,et al.  An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants , 1999, Machine Learning.

[2]  Martin V. Butz,et al.  Data Mining in Learning Classifier Systems: Comparing XCS with GAssist , 2005, IWLCS.

[3]  D.E. Goldberg,et al.  Classifier Systems and Genetic Algorithms , 1989, Artif. Intell..

[4]  Yoav Freund,et al.  A Short Introduction to Boosting , 1999 .

[5]  Wei Tang,et al.  Ensembling neural networks: Many could be better than all , 2002, Artif. Intell..

[6]  Stewart W. Wilson Get Real! XCS with Continuous-Valued Inputs , 1999, Learning Classifier Systems.

[7]  Xavier Llorà,et al.  XCS and GALE: A Comparative Study of Two Learning Classifier Systems on Data Mining , 2001, IWLCS.

[8]  Nikunj C. Oza,et al.  Online Ensemble Learning , 2000, AAAI/IAAI.

[9]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[10]  Alexandre Parodi,et al.  An Efficient Classifier System and Its Experimental Comparison with Two Representative Learning Methods on Three Medical Domains , 1991, ICGA.

[11]  Stewart W. Wilson Mining Oblique Data with XCS , 2000, IWLCS.

[12]  Pier Luca Lanzi,et al.  Mining interesting knowledge from data with the XCS classifier system , 2001 .

[13]  John H. Holmes Applying a Learning Classifier System to Mining Explanatory and Predictive Models from a Large Clinical Database , 2000, IWLCS.

[14]  John H. Holmes,et al.  Learning Classifier Systems Applied to Knowledge Discovery in Clinical Research Databases , 1999, Learning Classifier Systems.