Analysing Learning Classifier Systems in Reactive and Non-reactive Robotic Tasks

There are few contributions to robot autonomous navigation applying Learning Classifier Systems (LCS) to date. The primary objective of this work is to analyse the performance of the strength-based LCS and the accuracy-based LCS, named EXtended Learning Classifier System (XCS), when applied to two distinct robotic tasks. The first task is purely reactive, which means that the action to be performed can rely only on the current status of the sensors. The second one is non-reactive, which means that the robot might use some kind of memory to be able to deal with aliasing states. This work presents a rule evolution analysis, giving examples of evolved populations and their peculiarities for both systems. A review of LCS derivatives in robotics is provided together with a discussion of the main findings and an outline of future investigations.

[1]  Olivier Sigaud,et al.  YACS: Combining Dynamic Programming with Generalization in Classifier Systems , 2000, IWLCS.

[2]  Fernando José Von Zuben,et al.  A classifier system in real applications for robot navigation , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[3]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[4]  Stewart W. Wilson.  ZCS: A Zeroth Level Classifier System , 1994, Evolutionary Computation.

[5]  Zhanna V. Zatuchna.  AgentP : a learning classifier system with associative perception in maze environments , 2005 .

[6]  Stewart W. Wilson.  Classifier Fitness Based on Accuracy , 1995, Evolutionary Computation.

[7]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[8]  Tim Kovacs,et al.  The 2003 Learning Classifier Systems Bibliography , 2002, IWLCS.

[9]  Stewart W. Wilson.  Classifiers that approximate functions , 2002, Natural Computing.

[10]  Seiji Yamada,et al.  Interactive classifier system for real robot learning , 2000, Proceedings 9th IEEE International Workshop on Robot and Human Interactive Communication. IEEE RO-MAN 2000 (Cat. No.00TH8499).

[11]  Jeffrey L. Krichmar,et al.  Evolutionary robotics: The biology, intelligence, and technology of self-organizing machines , 2001, Complex..

[12]  Tim Kovacs,et al.  A Learning Classifier Systems Bibliography , 1999, Learning Classifier Systems.

[13]  Tim Kovacs,et al.  Advances in Learning Classifier Systems , 2001, Lecture Notes in Computer Science.

[14]  Rick L. Riolo,et al.  The Emergence of Default Hierarchies in Learning Classifier Systems , 1989, ICGA.

[15]  Martin V. Butz,et al.  An Algorithmic Description of ACS2 , 2001, International Workshop on Learning Classifier Systems.

[16]  John H. Holland,et al.  Induction: Processes of Inference, Learning, and Discovery , 1987, IEEE Expert.

[17]  Wolfgang Stolzmann.  Learning Classifier Systems using the Cognitive Mechanism of Anticipatory Behavioral Control , 1996 .

[18]  Martin V. Butz,et al.  Analysis and Improvement of Fitness Exploitation in XCS: Bounding Models, Tournament Selection, and Bilateral Accuracy , 2003, Evolutionary Computation.

[19]  Marco Colombetti,et al.  Robot Shaping: An Experiment in Behavior Engineering , 1997 .

[20]  Phil Husbands,et al.  Evolving Robot Behaviours with Diffusing Gas Networks , 1998, EvoRobot.

[21]  Larry Bull,et al.  Learning Classifier Systems , 2002, Annual Conference on Genetic and Evolutionary Computation.

[22]  Stewart W. Wilson,et al.  Learning classifier systems: New models, successful applications , 2002, Inf. Process. Lett..

[23]  Fernando J. Von Zuben,et al.  Application of Learning Classifier Systems to the On-Line Reconfiguration of Electric Power Distribution Networks , 2004 .

[24]  Dave Cliff,et al.  Adding Temporary Memory to ZCS , 1994, Adapt. Behav..

[25]  D.E. Goldberg,et al.  Classifier Systems and Genetic Algorithms , 1989, Artif. Intell..

[26]  Zhanna V. Zatuchna.  AgentP Model: Learning Classifier System with Associative Perception , 2004, PPSN.

[27]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[28]  Pier Luca Lanzi.  An Analysis of the Memory Mechanism of XCSM , 2007 .

[29]  Andrea Bonarini,et al.  An Introduction to Learning Fuzzy Classifier Systems , 1999, Learning Classifier Systems.

[30]  Peter Ross,et al.  Controlling a Simulated Khepera with an XCS Classifier System with Memory , 2003, ECAL.

[31]  Larry Bull,et al.  TCS Learning Classifier System Controller on a Real Robot , 2002, PPSN.

[32]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[33]  Stewart W. Wilson,et al.  Toward Optimal Classifier System Performance in Non-Markov Environments , 2000, Evolutionary Computation.

[34]  MSc PhD Tim Kovacs BA.  Strength or Accuracy: Credit Assignment in Learning Classifier Systems , 2004, Distinguished Dissertations.

[35]  Andrea Bonarini,et al.  FIXCS: a Fuzzy Implementation of XCS , 2007, 2007 IEEE International Fuzzy Systems Conference.

[36]  Larry Bull,et al.  Applications of Learning Classifier Systems , 2004 .

[37]  Christiano Lyra,et al.  Classifier Systems for Loss Reduction in Electric Power Distribution Networks , 2001 .

[38]  Giuliano Armano,et al.  NXCS Experts for Financial Time Series Forecasting , 2004 .

[39]  Zbigniew Michalewicz,et al.  Evolutionary Computation 2 , 2000 .

[40]  Larry Bull,et al.  A Neural Learning Classifier System with Self-Adaptive Constructivism for Mobile Robot Control , 2006, Artificial Life.

[41]  Martin V. Butz,et al.  An algorithmic description of XCS , 2000, Soft Comput..

[42]  Simon Parsons,et al.  Evolutionary Robotics: The Biology, Intelligence, and Technology of Self-Organizing Machines by Stefano Nolfi and Dario Floreano, MIT Press, 320 pp., $28.00, ISBN 0-262-14070-5 , 2004, Knowledge engineering review (Print).

[43]  Martin V. Butz,et al.  Latent Learning and Action Planning in Robots with Anticipatory Classifier Systems , 1999, Learning Classifier Systems.

[44]  Wolfgang Banzhaf,et al.  Advances in Artificial Life , 2003, Lecture Notes in Computer Science.

[45]  Nick Jakobi,et al.  Minimal simulations for evolutionary robotics , 1998 .

[46]  Rolf Pfeifer,et al.  Understanding intelligence , 2020, Inequality by Design.

[47]  Fernando José Von Zuben,et al.  An Immune Learning Classifier Network for Autonomous Navigation , 2003, ICARIS.

[48]  Larry Bull,et al.  X-TCS: accuracy-based learning classifier system robotics , 2005, 2005 IEEE Congress on Evolutionary Computation.