Learning effects of robot actions using temporal associations

Agents need to know the effects of their actions. Strong associations between actions and effects can be found by counting how often they co-occur. We present an algorithm that learns temporal patterns expressed as fluents, i.e. propositions with temporal extent. The fluent-learning algorithm is hierarchical and unsupervised. It works by maintaining co-occurrence statistics on pairs of fluents. In experiments on a mobile robot, the fluent-learning algorithm found temporal associations that correspond to effects of the robot's actions.

[1]  J. McCarthy.  Situations, Actions, and Causal Laws , 1963 .

[2]  James F. Allen.  An Interval-Based Representation of Temporal Knowledge , 1981, IJCAI.

[3]  David Sankoff,et al.  Time Warps, String Edits, and Macromolecules: The Theory and Practice of Sequence Comparison , 1983 .

[4]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[5]  Eugene Charniak,et al.  Statistical language learning , 1997 .

[6]  James D. Hamilton.  Time Series Analysis , 1994 .

[7]  Paul R. Cohen,et al.  Learning Planning Operators with Conditional and Probabilistic Effects , 1996 .

[8]  John F. Roddick,et al.  Adding Temporal Semantics to Association Rules , 1999, PKDD.

[9]  Joseph B. Kruskal,et al.  Time Warps, String Edits, and Macromolecules , 1999 .

[10]  J. Pearl.  Causality: Models, Reasoning and Inference , 2000 .

[11]  Paul R. Cohen,et al.  A Method for Clustering the Experiences of a Mobile Robot that Accords with Human Judgments , 2000, AAAI/IAAI.

[12]  Paul R. Cohen,et al.  Multivariate Clustering by Dynamics , 2000, AAAI/IAAI.

[13]  Paul R. Cohen,et al.  Fluent Learning: Elucidating the Structure of Episodes , 2001, IDA.

[14]  M. Shanahan,et al.  Deriving Fluents from Sensor Data for Mobile Robots , 2001 .

[15]  Frank Höppner.  Discovery of Temporal Patterns. Learning Rules about the Qualitative Behaviour of Time Series , 2001, PKDD.

[16]  Frank Klawonn,et al.  Finding informative rules in interval sequences , 2001, Intell. Data Anal..