Self-adaptive mutation in XCSF

Recent advances in XCS technology have shown that self-adaptive mutation can be highly useful to speed-up the evolutionary progress in XCS. Moreover, recent publications have shown that XCS can also be successfully applied to challenging real-valued domains including datamining, function approximation, and clustering. In this paper, we combine these two advances and investigate self-adaptive mutation in the XCS system for function approximation with hyperellipsoidal condition structures, referred to as XCSF in this paper. It has been shown that XCSF solves function approximation problems with an accuracy, noise robustness, and generalization capability comparable to other statistical machine learning techniques and that XCSF outperforms simple clustering techniques to which linear approximations are added. This paper shows that the right type of self-adaptive mutation can further improve XCSF's performance solving problems more parameter independent and more reliably. We analyze various types of self-adaptive mutation and show that XCSF with self-adaptive mutation ranges,differentiated for the separate classifier condition values, yields most robust performance results. Future work may further investigate the properties of the self-adaptive values and may integrate advanced self-adaptation techniques.

[1]  Martin V. Butz,et al.  Anticipatory Learning Classifier Systems , 2002, Genetic Algorithms and Evolutionary Computation.

[2]  Larry Bull,et al.  On lookahead and latent learning in simple LCS , 2007, GECCO '07.

[3]  Stewart W. Wilson Function approximation with a classifier system , 2001 .

[4]  Stewart W. Wilson,et al.  Advances in Learning Classifier Systems. Fourth International Workshop , 2004 .

[5]  John H. Holland,et al.  COGNITIVE SYSTEMS BASED ON ADAPTIVE ALGORITHMS1 , 1978 .

[6]  Stewart W. Wilson Classifiers that approximate functions , 2002, Natural Computing.

[7]  John H. Holland,et al.  Cognitive systems based on adaptive algorithms , 1977, SGAR.

[8]  Martin V. Butz Kernel-based, ellipsoidal conditions in the real-valued XCS classifier system , 2005, GECCO '05.

[9]  Larry Bull,et al.  Self-adaptive mutation in classifier system controllers , 2000 .

[10]  Larry Bull,et al.  A neural learning classifier system with self-adaptive constructivism , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[11]  Stefan Roth,et al.  Covariance Matrix Adaptation for Multi-objective Optimization , 2007, Evolutionary Computation.

[12]  Stewart W. Wilson Classifier Fitness Based on Accuracy , 1995, Evolutionary Computation.

[13]  Larry Bull,et al.  Self-adaptation in classifier system controllers , 2006, Artificial Life and Robotics.

[14]  Martin V. Butz,et al.  Toward a theory of generalization and learning in XCS , 2004, IEEE Transactions on Evolutionary Computation.

[15]  Martin V. Butz,et al.  Hyper-ellipsoidal conditions in XCS: rotation, linear approximation, and solution structure , 2006, GECCO '06.

[16]  Ouen Pinngern,et al.  Towards clustering with XCS , 2007, GECCO '07.

[17]  Larry Bull,et al.  A Neural Learning Classifier System with Self-Adaptive Constructivism for Mobile Robot Control , 2006, Artificial Life.

[18]  Martin V. Butz,et al.  Automated Global Structure Extraction for Effective Local Building Block Processing in XCS , 2006, Evolutionary Computation.

[19]  D.E. Goldberg,et al.  Classifier Systems and Genetic Algorithms , 1989, Artif. Intell..

[20]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[21]  Larry Bull,et al.  A Self-Adaptive XCS , 2001, IWLCS.