Parameter Adaptation within Co-adaptive Learning Classifier Systems

The authors propose a co-adaptive approach to controlling parameters for coevolution-based learning classifier systems. By taking advantage of the on-line incremental learning capability of such systems, solutions can be produced that completely cover a target problem. The system combines the advantages of both adaptive and self-adaptive parameter-control approaches. Using a coevolution model means that two learning classifier systems can operate in parallel to simultaneously solve target and parameter-setting problems. Furthermore, the approach needs very little time to become efficient in terms of latent learning, since it only requires small amounts of information on performance metrics during early run-time stages. Our experimental results show that the proposed system outperforms comparable models regardless of a problem’s stationary/non-stationary status.

[1]  Hitoshi Iba,et al.  Genetic Programming 1998: Proceedings of the Third Annual Conference , 1999, IEEE Trans. Evol. Comput..

[2]  Xin Yao,et al.  Adapting Self-Adaptive Parameters in Evolutionary Algorithms , 2001, Applied Intelligence.

[3]  Stewart W. Wilson Classifier Fitness Based on Accuracy , 1995, Evolutionary Computation.

[4]  P. Lanzi Extending the representation of classifier conditions part I: from binary to messy coding , 1999 .

[5]  Katia Sycara,et al.  Reasons for premature convergence of self-adapting mutation rates , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[6]  M. Colombetti,et al.  An extension to the XCS classifier system for stochastic environments , 1999 .

[7]  Stewart W. Wilson,et al.  Learning classifier systems: New models, successful applications , 2002, Inf. Process. Lett..

[8]  Alan S. Morris,et al.  Performance improvement of self-adaptive evolutionary methods with a dynamic lower bound , 2002, Inf. Process. Lett..

[9]  Francisco Herrera,et al.  Adaptive genetic operators based on coevolution with fuzzy behaviors , 2001, IEEE Trans. Evol. Comput..

[10]  Larry Bull,et al.  A Self-Adaptive XCS , 2001, IWLCS.

[11]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[12]  Günter Rudolph,et al.  Self-adaptive mutations may lead to premature convergence , 2001, IEEE Trans. Evol. Comput..

[13]  Luca Lanzi Pier,et al.  Extending the Representation of Classifier Conditions Part II: From Messy Coding to S-Expressions , 1999 .

[14]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[15]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[16]  Tim Kovacs What should a classifier system learn and how should we measure it? , 2002, Soft Comput..

[17]  Stewart W. Wilson Generalization in the XCS Classifier System , 1998 .

[18]  Larry Bull,et al.  A Self-Adaptive Classifier System , 2000, IWLCS.

[19]  Tim Kovacs,et al.  Advances in Learning Classifier Systems , 2001, Lecture Notes in Computer Science.

[20]  Pier Luca Lanzi,et al.  An Analysis of Generalization in the XCS Classifier System , 1999, Evolutionary Computation.