Mining the space of generality with uncertainty-concerned cooperative classifiers

Generality is a recurrent theme in automated inductive systems. Induction of general patterns/rules is of course complicated by several factors. For example, higher levels of uncertainty and error are naturally introduced by generality. Moreover, it is not clear what sort of trade-off should be sought between increasing generality and decreasing predictive power. As a result, specific criteria to guide the search for useful general rules do not abound. In this paper, I reconsider these issues in the context of the generalized, fuzzy-like classifier system first proposed by Frey and Slate (1991) and later equipped with a Bayesian learning component by Muruzabal (1998). A crucial feature of this approach is that uncertainty is probabilistically measured at each classifier in the population. A new reinforcement policy exploiting this probabilistic structure and priming cooperation among general classifiers is introduced and shown to promote the stability of niches of reasonably high predictive power. The underlying genetic algorithm contributes effectively to learning although it somehow counteracts the built-in bias towards generality.

[1]  Pier Luca Lanzi Generalization in Wilson's Classifier System , 1998, PPSN.

[2]  Ron Kohavi,et al.  Data Mining Using MLC a Machine Learning Library in C++ , 1996, Int. J. Artif. Intell. Tools.

[3]  Nicholas I. Fisher,et al.  Bump hunting in high-dimensional data , 1999, Stat. Comput..

[4]  Samir W. Mahfoud Niching methods for genetic algorithms , 1996 .

[5]  Bruce A. Whitehead,et al.  Cooperative-competitive genetic evolution of radial basis function centers and widths for time series prediction , 1996, IEEE Trans. Neural Networks.

[6]  J. Muruzabal,et al.  Fuzzy and probabilistic reasoning in simple learning classifier systems , 1995, Proceedings of 1995 IEEE International Conference on Evolutionary Computation.

[7]  Lashon B. Booker,et al.  Triggered Rule Discovery in Classifier Systems , 1989, ICGA.

[8]  Luisa Franconi,et al.  Comparison of a genetic algorithm and simulated annealing in an application to statistical image reconstruction , 1997, Stat. Comput..

[9]  Henry Tirri,et al.  Predictive Data Mining with Finite Mixtures , 1996, KDD.

[10]  Stewart W. Wilson Classifier Fitness Based on Accuracy , 1995, Evolutionary Computation.

[11]  Filippo Neri,et al.  Exploring the Power of Genetic Search in Learning Symbolic Classifiers , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Norman H. Packard,et al.  A Genetic Learning Algorithm for the Analysis of Complex Data , 1990, Complex Syst..

[13]  John H. Holmes Discovering Risk of Disease with a Learning Classifier System , 1997, ICGA.

[14]  Alberto Muñoz,et al.  Diffuse Pattern Learning with Fuzzy ARTMAP and PASS , 1994, PPSN.