Q-concept-learning: generalization with concept lattice representation in reinforcement learning

One of the very interesting properties of reinforcement learning algorithms is that they allow learning without prior knowledge of the environment. However, when the agents use algorithms that enable a generalization of the learning, they are unable to explain their choices. Neural networks are good examples of this problem. After a reminder about the basis of reinforcement learning, the lattice concept will be introduced. Then, Q-concept-learning, a reinforcement learning algorithm that enables a generalization of the learning, the use of structured languages as well as an explanation of the agent's choices will be presented.

[1]  Andrew Tridgell,et al.  Learning to Play Chess Using Temporal Differences , 2000, Machine Learning.

[2]  Ben J. A. Kröse,et al.  Learning from delayed rewards , 1995, Robotics Auton. Syst..

[3]  Jean Sallantin,et al.  Structural Machine Learning with Galois Lattice and Graphs , 1998, ICML.

[4]  Bernhard Ganter,et al.  Formal Concept Analysis: Mathematical Foundations , 1998 .

[5]  Jean Sallantin,et al.  INNE: a structured learning algorithm for noisy examples , 1989, [Proceedings 1989] IEEE International Workshop on Tools for Artificial Intelligence.

[6]  Gerald Tesauro,et al.  TD-Gammon, a Self-Teaching Backgammon Program, Achieves Master-Level Play , 1994, Neural Computation.

[7]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[8]  Peter Dayan,et al.  Technical Note: Q-Learning , 2004, Machine Learning.

[9]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[10]  Rokia Missaoui,et al.  INCREMENTAL CONCEPT FORMATION ALGORITHMS BASED ON GALOIS (CONCEPT) LATTICES , 1995, Comput. Intell..

[11]  M. V. Rossum,et al.  In Neural Computation , 2022 .

[12]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[13]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.