Multiagent reinforcement learning using OLAP-based association rules mining

In this paper, we propose a novel multiagent learning approach, which is based on online analytical processing (OLAP) data mining. First, we describe a data cube OLAP architecture which facilitates effective storage and processing of the state information reported by agents. This way, the action of the other agent, even not in the visual environment of the agent under consideration, can simply be estimated by extracting online association rules from the constructed data cube. Then, we present a new action selection model which is also based on association rules mining. Finally, we generalize states which are not experienced sufficiently by mining multiple-levels association rules from the proposed data cube. Experiments conducted on a well-known pursuit domain show the effectiveness of the proposed learning approach.

[1]  Reda Alhajj,et al.  Multiagent reinforcement learning using function approximation , 2000, IEEE Trans. Syst. Man Cybern. Part C.

[2]  Jiawei Han,et al.  Mining Multiple-Level Association Rules in Large Databases , 1999, IEEE Trans. Knowl. Data Eng..

[3]  Philip S. Yu,et al.  A New Approach to Online Generation of Association Rules , 2001, IEEE Trans. Knowl. Data Eng..

[4]  Reda Alhajj,et al.  Reinforcement learning in multiagent systems: a modular fuzzy approach with internal model capabilities , 2002, 14th IEEE International Conference on Tools with Artificial Intelligence, 2002. (ICTAI 2002). Proceedings..

[5]  Michael L. Littman,et al.  Markov Games as a Framework for Multi-Agent Reinforcement Learning , 1994, ICML.

[6]  Robert H. Crites,et al.  Multiagent reinforcement learning in the Iterated Prisoner's Dilemma. , 1996, Bio Systems.

[7]  Rakesh Agarwal,et al.  Fast Algorithms for Mining Association Rules , 1994, VLDB 1994.

[8]  Shin Ishii,et al.  Multi-agent reinforcement learning: an approach based on the other agent's internal model , 2000, Proceedings Fourth International Conference on MultiAgent Systems.

[9]  Surajit Chaudhuri,et al.  An overview of data warehousing and OLAP technology , 1997, SGMD.