Reusing learned functionality in XCS: code fragments with constructed functionality and constructed features

This paper expands on work previously conducted on the XCS system using code fragments, which are GP-like trees that encapsulate building blocks of knowledge. The usage of code fragments in the XCS system enabled the solution of previously intractable, complex, boolean problems, e.g. the 135 bit multiplexer domain. However, it was not previously possible to replace functionality at nodes with learned relationships, which restricted scaling to larger problems and related domains. The aim of this paper is to reuse learned rule sets as functions. The functions are to be stored along with the code fragments produced as a solution for a problem. The results show for the first time that these learned functions can be reused in the inner nodes of the code fragment trees. The results are encouraging as there was no statistically significant difference in terms of classification. For the simpler problems the new system XCSCF2, required much less instances than the XCSCFC to solve the problems. However, for the more complex problems, the XCSCF2 required more instances than XCSCFC; but the additional time was not prohibitive for the continued development of this approach. The main contribution of this investigation is that functions can be learned and later reused in the inner nodes of a code fragment tree. This is anticipated to lead to a reduced search space and increased performance both in terms of instances needed to solve a problem and classification accuracy.

[1]  F. H. Adler Cybernetics, or Control and Communication in the Animal and the Machine. , 1949 .

[2]  Mengjie Zhang,et al.  Learning complex, overlapping and niche imbalance Boolean problems using XCS-based classifier systems , 2013, Evol. Intell..

[3]  Pier Luca Lanzi,et al.  XCS with stack-based genetic programming , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[4]  Mengjie Zhang,et al.  Reusing Building Blocks of Extracted Knowledge to Solve Complex, Large-Scale Boolean Problems , 2014, IEEE Transactions on Evolutionary Computation.

[5]  Mengjie Zhang,et al.  XCSR with Computed Continuous Action , 2012, Australasian Conference on Artificial Intelligence.

[6]  Stewart W. Wilson ZCS: A Zeroth Level Classifier System , 1994, Evolutionary Computation.

[7]  Pier Luca Lanzi,et al.  Learning classifier systems: then and now , 2008, Evol. Intell..

[8]  Stewart W. Wilson Classifier Fitness Based on Accuracy , 1995, Evolutionary Computation.

[9]  Larry Bull,et al.  Genetic Programming for Kernel-Based Learning with Co-evolving Subsets Selection , 2006, PPSN.

[10]  Martin V. Butz,et al.  Extracted global structure makes local building block processing effective in XCS , 2005, GECCO '05.

[11]  Luca Lanzi Pier,et al.  Extending the Representation of Classifier Conditions Part II: From Messy Coding to S-Expressions , 1999 .

[12]  Ronald Tocci,et al.  Digital Systems: Principles and Applications , 1977 .

[13]  Jason H. Moore,et al.  Learning classifier systems: a complete introduction, review, and roadmap , 2009 .

[14]  Martin V. Butz,et al.  An algorithmic description of XCS , 2000, Soft Comput..

[15]  Mengjie Zhang,et al.  Extending learning classifier system with cyclic graphs for scalability on complex, large-scale boolean problems , 2013, GECCO '13.

[16]  Mengjie Zhang,et al.  Comparison of two methods for computing action values in XCS with code-fragment actions , 2013, GECCO.

[17]  Noam Nisan,et al.  The Elements of Computing Systems - Building a Modern Computer from First Principles , 2005 .

[18]  Peter Nordin,et al.  Genetic programming - An Introduction: On the Automatic Evolution of Computer Programs and Its Applications , 1998 .

[19]  Stewart W. Wilson,et al.  Noname manuscript No. (will be inserted by the editor) Learning Classifier Systems: A Survey , 2022 .

[20]  John R. Koza,et al.  A Hierarchical Approach to Learning the Boolean Multiplexer Function , 1990, FOGA.

[21]  Will N. Browne,et al.  Learning overlapping natured and niche imbalance boolean problems using XCS classifier systems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[22]  Wolfgang Banzhaf,et al.  Genetic Programming: An Introduction , 1997 .

[23]  P. Lanzi Extending the representation of classifier conditions part I: from binary to messy coding , 1999 .

[24]  Mengjie Zhang,et al.  Evolving optimum populations with XCS classifier systems , 2012, Soft Computing.