Improving modeling of other agents using tentative stereotypes and compactification of observations

We investigate possible improvements to modeling other agents based on observed situation-action pairs and the nearest neighbor rule. Tentative stereotype models allow for good predictions of a modeled agent's behavior even after few observations. Periodic revaluation of the chosen stereotype and the potential for switching between different stereotypes or to the observation based model aids in dealing with very similar (but not identical) stereotypes and agents that do not conform to any stereotype. Finally, compactification of observations keeps the application of the model efficient by reducing comparisons within the nearest neighbor rule. Our experiments show that stereotyping significantly improves cases where using just the original method performs badly and that revaluation and switching fortify stereotyping against the potential risk of using an incorrect stereotype. Compactification shows good potential for improving efficiency, but is sometimes at risk of losing important observations.

[1]  Boris Kerkez,et al.  Case-Based Plan Recognition with Incomplete Plan Libraries , 2002 .

[2]  Edmund H. Durfee,et al.  Reasoning about Other Agents: Philosophy, Theory, and Implementation , 1993 .

[3]  KobsaAlfred User Modeling and User-Adapted Interaction , 2005 .

[4]  Ramón F. Brena,et al.  Towards Modeling Other Agents: A Simulation-Based Study , 1998, MABS.

[5]  Stuart C. Shapiro,et al.  Belief Revision and Truth Maintenance Systems: An Overview and Proposal , 1998 .

[6]  Tony R. Martinez,et al.  Reduction Techniques for Instance-Based Learning Algorithms , 2000, Machine Learning.

[7]  Victor R. Lesser,et al.  Learning Situation-Specific Coordination in Cooperative Multi-agent Systems , 1999, Autonomous Agents and Multi-Agent Systems.

[8]  Jörg Denzinger,et al.  Evolutionary online learning of cooperative behavior with situation-action pairs , 2000, Proceedings Fourth International Conference on MultiAgent Systems.

[9]  C. Neil Macrae,et al.  Stereotypes as energy-saving devices: A peek inside the cognitive toolbox. , 1994 .

[10]  Jelle R. Kok,et al.  Mutual Modeling of Teammate Behavior , 2002 .

[11]  M. Benda,et al.  On Optimal Cooperation of Knowledge Sources , 1985 .

[12]  Barbara Dunin-Keplicz,et al.  Proceedings of the 2005 IEEE/WIC/ACM International Conference on Intelligent Agent Technology , 2005 .

[13]  David Carmel,et al.  Opponent Modeling in Multi-Agent Systems , 1995, Adaption and Learning in Multi-Agent Systems.

[14]  Piotr J. Gmytrasiewicz,et al.  Learning models of other agents using influence diagrams , 1999 .

[15]  Sandra Carberry,et al.  Techniques for Plan Recognition , 2001, User Modeling and User-Adapted Interaction.

[16]  Manuela M. Veloso,et al.  Defining and using ideal teammate and opponent agent models: a case study in robotic soccer , 2000, Proceedings Fourth International Conference on MultiAgent Systems.

[17]  Manuela M. Veloso,et al.  On Behavior Classification in Adversarial Environments , 2000, DARS.