An Anticipatory Classiier System (ACS) is a learning mechanism based on learning classiier systems and the cognitive model of \Anticipatory Behavioral Control". By comparing perceived consequences with its own expectations (anticipations), an ACS is able to learn in multi-step environments. To date, the ACS has proven its abilities in various problems of that kind. It is able to learn latently (i.e. to learn without getting any reward) and it is able to distinguish between non-Markov states. Additionally, an ACS is capable of incrementally building a cognitive map that can be used to do action-planning. Although the ACS has proven to scale up in suitable environments, it depends on certain environmental properties. It believes itself to be the only agent that can change the perceptions received from an environment. Any environmental change is considered and believed to be caused by the executed actions. The ACS learns from the changes by using xed mechanisms. This paper reveals the properties of an environment that the current ACS assumes to be given. By investigating the problems of the current ACS when violating these properties we believe that this investigation will immediately serve for a better understanding of the ACS and lead to many ideas to improve the current ACS. We will propose some ideas and discuss the important ones in more detail.
[1]
D. E. Goldberg,et al.
Simple Genetic Algorithms and the Minimal, Deceptive Problem
,
1987
.
[2]
David E. Goldberg,et al.
The Race, the Hurdle, and the Sweet Spot
,
1998
.
[3]
David E. Goldberg,et al.
Genetic Algorithms in Search Optimization and Machine Learning
,
1988
.
[4]
David H. Wolpert,et al.
No free lunch theorems for optimization
,
1997,
IEEE Trans. Evol. Comput..
[5]
J. P. Seward.
An experimental analysis of latent learning.
,
1949,
Journal of experimental psychology.
[6]
John H. Holland,et al.
Properties of the bucket brigade algorithm
,
1985
.
[7]
Martin V. Butz,et al.
Action-Planning in Anticipatory Classifier Systems
,
2007
.
[8]
Stewart W. Wilson.
ZCS: A Zeroth Level Classifier System
,
1994,
Evolutionary Computation.
[9]
M. Colombetti,et al.
An extension to the XCS classifier system for stochastic environments
,
1999
.
[10]
F. W. Irwin.
Purposive Behavior in Animals and Men
,
1932,
The Psychological Clinic.