Using Recursive Agent Models Effectively

We present an algorithm that an agent can use for determining which of its nested, recursive models of other agents are important to consider when choosing an action. Pruning away less important models allows an agent to take its "best" action in a timely manner, given its knowledge, computational capabilities, and time constraints. We describe a theoretical framework, based on situations, for talking about recursive agent models and the strategies and expected strategies associated with them. This framework allows us to rigorously define the gain of continuing deliberation versus taking action. The expected gain of computational actions is used to guide the pruning of the nested model structure. We have implemented our approach on a canonical multi-agent problem, the pursuit task, to illustrate how real-time, multi-agent decision-making can be based on a principled, combinatorial model. Test results show a marked decrease in deliberation time while maintaining a good performance level.

[1]  Randall W. Hill,et al.  Representing and Using Organizational Knowledge in Distributed AI Systems , 1989, Distributed Artificial Intelligence.

[2]  Anand S. Rao,et al.  BDI Agents: From Theory to Practice , 1995, ICMAS.

[3]  Ronald Fagin,et al.  Reasoning about knowledge , 1995 .

[4]  Edmund H. Durfee,et al.  Toward a theory of honesty and trust among communicating autonomous agents , 1993 .

[5]  Edmund H. Durfee,et al.  Agent Modeling Methods Using Limited Rationality , 1994, AAAI.

[6]  H. Simon,et al.  Models of Bounded Rationality: Empirically Grounded Economic Reason , 1997 .

[7]  Edmund H. Durfee,et al.  Overeager Reciprocal Rationality and Mixed Strategy Equilibria , 1993, AAAI.

[8]  P. Gmytrasiewicz A decision-theoretic model of coordination and communication in autonomous systems , 1992 .

[9]  Stuart J. Russell,et al.  Do the right thing , 1991 .

[10]  E. Durfee The Utility of Embedded Communications : Toward the Emergence of Protocols * , 1994 .

[11]  Jeffrey S. Rosenschein,et al.  A game theoretic approach to distributed artificial intelligence and the pursuit problem (abstract) , 1992, SIGO.

[12]  Piotr J. Gmytrasiewicz,et al.  On Reasoning About Other Agents , 1995, ATAL.

[13]  Edmund H. Durfee,et al.  Using MICE to study intelligent dynamic coordination , 1990, [1990] Proceedings of the 2nd International IEEE Conference on Tools for Artificial Intelligence.

[14]  E. Durfee Adaptive Surrogate Agents , 1994 .

[15]  Les Gasser,et al.  Representing and using organizational knowledge in DAI systems , 1989 .

[16]  Edmund H. Durfee,et al.  Blissful Ignorance: Knowing Just Enough to Coordinate Well , 1995, ICMAS.

[17]  Edmund H. Durfee,et al.  A Rigorous, Operational Formalization of Recursive Modeling , 1995, ICMAS.