Learning from experience using a decision-theoretic intelligent agent in multi-agent systems

This paper proposes a decision-theoretic intelligent agent model to solve a herding problem and studies the learning from experience capabilities of the agent model. The proposed intelligent agent model is designed by combining Bayesian networks (BN) and influence diagrams (ID). The online Bayesian network learning method is proposed to accomplish the learning from experience. Intelligent agent software, IntelliAgent, is written to realize the proposed intelligent agent model and to simulate the agents in a problem domain. The same software is then used to simulate the herding problem with one sheep and one dog. Simulation results show that the proposed intelligent agent is successful in establishing a goal (herding) and learning other agents' behaviors.

[1]  Piotr J. Gmytrasiewicz,et al.  Learning models of other agents using influence diagrams , 1999 .

[2]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[3]  Yoav Shoham,et al.  Agent-Oriented Programming , 1992, Artif. Intell..

[4]  Ferat Sahin,et al.  A biological decision-theoretic intelligent agent solution to a herding problem in the context of distributed multi-agent systems , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[5]  Craig Boutilier,et al.  Planning, Learning and Coordination in Multiagent Decision Processes , 1996, TARK.

[6]  C. Gerber Evolution-based self-adaption as an expression for the autonomy degree in multi-agent societies , 1998, Proceedings of the 1998 IEEE International Symposium on Intelligent Control (ISIC) held jointly with IEEE International Symposium on Computational Intelligence in Robotics and Automation (CIRA) Intell.

[7]  David Heckerman,et al.  Challenge: What is the Impact of Bayesian Networks on Learning? , 1997, IJCAI.