Modeling agents based on aspiration adaptation theory

Creating agents that realistically simulate and interact with people is an important problem. In this paper we present strong empirical evidence that such agents should be based on bounded rationality, and specifically on key elements from Aspiration Adaptation Theory (AAT). First, we analyzed the strategies people described they would use to solve two relatively basic optimization problems involving one and two parameters. Second, we studied the agents a different group of people wrote to solve these same problems. We then studied two realistic negotiation problems involving five and six parameters. Again, first we studied the negotiation strategies people used when interacting with other people. Then we studied two state of the art automated negotiation agents and negotiation sessions between these agents and people. We found that in both the optimizing and negotiation problems the overwhelming majority of automated agents and people used key elements from AAT, even when optimal solutions, machine learning techniques for solving multiple parameters, or bounded techniques other than AAT could have been implemented. We discuss the implications of our findings including suggestions for designing more effective agents for game and simulation environments.

[1]  R. Selten,et al.  Aspiration Adaptation Theory. , 1998, Journal of mathematical psychology.

[2]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[3]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[4]  M. Weitzman Optimal search for the best alternative , 1978 .

[5]  Ariel Rubinstein,et al.  A Course in Game Theory , 1995 .

[6]  Moshe Tennenholtz On Stable Social Laws and Qualitative Equilibrium for Risk-Averse Agents , 1996, KR.

[7]  Sarit Kraus,et al.  Programming agents as a means of capturing self-strategy , 2008, AAMAS.

[8]  J. Neumann,et al.  Theory of Games and Economic Behavior. , 1945 .

[9]  P. T. Hopmann The negotiation process and the resolution of international conflicts , 1996 .

[10]  Yohei Murakami,et al.  Multi-agent simulation for crisis management , 2002, Proceedings. IEEE Workshop on Knowledge Media Networking.

[11]  Sarit Kraus,et al.  Can automated agents proficiently negotiate with humans? , 2010, CACM.

[12]  Claudia Keser,et al.  Strategic behavior of experienced subjects in a common pool resource game , 1999, Int. J. Game Theory.

[13]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[14]  Sarit Kraus,et al.  Investigating the benefits of automated negotiations in enhancing people's negotiation skills , 2009, AAMAS.

[15]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[16]  Sarit Kraus,et al.  Resolving crises through automated bilateral negotiations , 2008, Artif. Intell..

[17]  G Gigerenzer,et al.  Reasoning the fast and frugal way: models of bounded rationality. , 1996, Psychological review.

[18]  Sarit Kraus,et al.  Understanding how people design trading agents over time , 2008, AAMAS.

[19]  Reinhard Selten Experimental Results on the Process of Goal Formation and Aspiration Adaptation , 2008, SAGT.

[20]  Sarit Kraus,et al.  Facing the challenge of human-agent negotiations via effective general opponent modeling , 2009, AAMAS.

[21]  Stacy Marsella,et al.  Building Interactive Virtual Humans for Training Environments , 2007 .

[22]  Sebastian Thrun,et al.  Robotic mapping: a survey , 2003 .

[23]  H. Simon,et al.  Models of Man. , 1957 .

[24]  Pattie Maes,et al.  Artificial life meets entertainment: lifelike autonomous agents , 1995, CACM.

[25]  J. Wilkenfeld,et al.  Mediating International Crises , 2003 .

[26]  Reinhard Selten,et al.  How to play (3×3)-games.: A strategy method experiment , 2003, Games Econ. Behav..

[27]  Gregory E. Kersten,et al.  WWW-based negotiation support: design, implementation, and use , 1999, Decis. Support Syst..

[28]  Sarit Kraus,et al.  Negotiating with bounded rational agents in environments with incomplete information using an automated agent , 2008, Artif. Intell..

[29]  A. Copeland Review: John von Neumann and Oskar Morgenstern, Theory of games and economic behavior , 1945 .

[30]  R. Selten,et al.  Duopoly Strategies Programmed by Experienced Players , 1997 .

[31]  Milind Tambe,et al.  The Communicative Multiagent Team Decision Problem: Analyzing Teamwork Theories and Models , 2011, J. Artif. Intell. Res..

[32]  Daniel P. Loucks,et al.  Computer-Assisted Negotiations of Water Resources Conflicts , 1998 .

[33]  Toru Ishida,et al.  Modeling Human Behavior for Virtual Training Systems , 2005, AAAI.