Special issue on the 20th anniversary of XCS

This issue is dedicated to Stewart Wilson both in recognition of his achievements and in appreciation for his guidance of the field. Not only has his research transformed the field, but his support, encouragement, and advice have been invaluable to many of us individually and to the community as a whole. Learning Classifier Systems (LCS) are rule-based machine learning algorithms introduced by Holland (see [2, 4–6]) that learn a population of IF-THEN rules that specify ‘‘IF x happens THEN do (or predict) y’’. In 1995 Stewart Wilson, already a leading LCS researcher, published a paper entitled ‘‘Classifier Fitness based on Accuracy’’ [16] that introduced the XCS algorithm. This paper proved a turning point for the field as XCS and its derivatives rapidly became the main focus of LCS research, and continue to be so today. We organised this special issue of Evolutionary Intelligence to mark the 20th anniversary of this landmark paper, and to serve as post-proceedings for IWLCS 2014: the Seventeenth International Workshop on Learning Classifier Systems. The annual IWLCS meetings are the yearly highlight of the LCS calendar and have no doubt contributed to the strong sense of community in the LCS field. For 2015 IWLCS has been rebranded as the more descriptive IWERML: the International Workshop on Evolutionary Rule-based Machine Learning. In 1994, the year before introducing XCS, Wilson introduced ZCS, the ‘‘Zeroth-order Classifier System’’ [15]. Wilson felt the growing complexity of the LCS concept was hindering progress and ZCS was an attempt to strip the LCS down to its essentials while retaining a working system. XCS built on the minimalist ZCS with two radical changes: a switch to accuracy-based fitness and, based on work by Booker [1], the addition of a niche Genetic Algorithm (GA) that strongly favours general rules. This combination was a hit: the niche GA favours general rules but accuracy-based fitness insists strictly that they make good predictions. This combination drives XCS to learn rules that are as general as possible while remaining accurate. Bull’s article in this issue provides much more on the history of LCS prior to and following XCS [2]. The famous ‘‘accuracy-based fitness’’ of XCS needs some explanation. The earlier ZCS featured ‘‘strengthbased fitness’’, in which the fitness of a rule in the GA was derived from its strength, a measure of the amount of reward the rule received. Consequently, fit rules in ZCS are those that receive a lot of reward. In contrast, XCS rules are fit if they make consistently accurate predictions about the reward they receive. This has the counterintuitive consequence that XCS rules that consistently take a bad action can be fit, since they are consistent. However, this poses no problem when it comes time for XCS to choose an action, since that can be done using the magnitude of the reward predicted by each rule. Why does XCS retain rules whose action it does not use? This ‘‘complete map’’ of the state/ & Muhammad Iqbal muhammad.iqbal@ecs.vuw.ac.nz

[1]  MSc PhD Tim Kovacs BA Strength or Accuracy: Credit Assignment in Learning Classifier Systems , 2004, Distinguished Dissertations.

[2]  Tim Kovacs,et al.  Learning Classifier Systems. 10th and 11th International Workshops (2006-2007) , 2008 .

[3]  Larry Bull,et al.  ZCS Redux , 2002, Evolutionary Computation.

[4]  Chris Watkins,et al.  Learning from delayed rewards , 1989 .

[5]  G. Cowles Studies of Mascarene Island birds: The fossil record , 1987 .

[6]  Stewart W. Wilson Function approximation with a classifier system , 2001 .

[7]  Ester Bernadó-Mansilla,et al.  Revisiting UCS: Description, Fitness Sharing, and Comparison with XCS , 2008, IWLCS.

[8]  Tim Kovacs,et al.  XCS-SL: a rule-based genetic learning system for sequence labeling , 2015, Evol. Intell..

[9]  John H. Holland,et al.  Cognitive systems based on adaptive algorithms , 1977, SGAR.

[10]  Masaya Nakata,et al.  XCS with Adaptive Action Mapping , 2012, SEAL.

[11]  Lashon B. Booker,et al.  Triggered Rule Discovery in Classifier Systems , 1989, ICGA.

[12]  Stewart W. Wilson Classifier Fitness Based on Accuracy , 1995, Evolutionary Computation.

[13]  Robert Rosen,et al.  Progress in Theoretical Biology , 2012 .

[14]  Larry Bull,et al.  A brief history of learning classifier systems: from CS-1 to XCS and its variants , 2014, Evol. Intell..

[15]  Stewart W. Wilson ZCS: A Zeroth Level Classifier System , 1994, Evolutionary Computation.

[16]  Jason H. Moore,et al.  ExSTraCS 2.0: description and evaluation of a scalable learning classifier system , 2015, Evolutionary Intelligence.

[17]  Daniele Loiacono,et al.  XCSF with tile coding in discontinuous action-value landscapes , 2015, Evol. Intell..

[18]  Masaya Nakata,et al.  Rule reduction by selection strategy in XCS with adaptive action map , 2015, Evol. Intell..