Using Gaussian Processes to Optimise Concession in Complex Negotiations against Unknown Opponents

In multi-issue automated negotiation against unknown opponents, a key part of effective negotiation is the choice of concession strategy. In this paper, we develop a principled concession strategy, based on Gaussian processes predicting the opponent's future behaviour. We then use this to set the agent's concession rate dynamically during a single negotiation session. We analyse the performance of our strategy and show that it outperforms the state-of-the-art negotiating agents from the 2010 Automated Negotiating Agents Competition, in both a tournament setting and in self-play, across a variety of negotiation domains.

[1]  Nicholas R. Jennings,et al.  On Efficient Procedures for Multi-issue Negotiation , 2006, TADA/AMEC.

[2]  Nicholas R. Jennings,et al.  Approximate and online multi-issue negotiation , 2007, AAMAS '07.

[3]  Sarit Kraus,et al.  Negotiating with bounded rational agents in environments with incomplete information using an automated agent , 2008, Artif. Intell..

[4]  Nicholas R. Jennings,et al.  Negotiation decision functions for autonomous agents , 1998, Robotics Auton. Syst..

[5]  A. Rubinstein Modeling Bounded Rationality , 1998 .

[6]  Tuomas Sandholm,et al.  Bargaining with Deadlines , 1999, AAAI/IAAI.

[7]  Koen V. Hindriks,et al.  Opponent modelling in automated multi-issue negotiation using Bayesian learning , 2008, AAMAS.

[8]  Sarit Kraus,et al.  The First Automated Negotiating Agents Competition (ANAC 2010) , 2012, New Trends in Agent-Based Complex Automated Negotiations.

[9]  Valentin Robu,et al.  Modeling complex multi-issue negotiations using utility graphs , 2005, AAMAS '05.

[10]  Sarit Kraus,et al.  Genius: negotiation environment for heterogeneous agents , 2009, AAMAS.

[11]  A. Rubinstein Perfect Equilibrium in a Bargaining Model , 1982 .

[12]  Bo An,et al.  Searching for pure strategy equilibria in bilateral bargaining with one-sided uncertainty , 2010, AAMAS.

[13]  Ryszard Kowalczyk,et al.  Adaptive Negotiation with On-Line Prediction of Opponent Behaviour in Agent-Based Negotiations , 2006, 2006 IEEE/WIC/ACM International Conference on Intelligent Agent Technology.

[14]  Bo An,et al.  Decommitment in multi-resource negotiation , 2008, AAMAS.

[15]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[16]  Michael P. Wellman,et al.  Empirical game-theoretic analysis of the TAC Supply Chain game , 2007, AAMAS '07.

[17]  Nicholas R. Jennings,et al.  Concurrent bilateral negotiation in agent systems , 2003, 14th International Workshop on Database and Expert Systems Applications, 2003. Proceedings..

[18]  Nicholas R. Jennings,et al.  Learning on opponent's preferences to make effective multi-issue negotiation trade-offs , 2004, ICEC '04.