$$\hbox {NB}^{3}$$NB3: a multilateral negotiation algorithm for large, non-linear agreement spaces with limited time

Existing work on automated negotiations has mainly focused on bilateral negotiations with linear utility functions. It is often assumed that all possible agreements and their utility values are given beforehand. Most real-world negotiations however are much more complex. We introduce a new family of negotiation algorithms that is applicable to domains with many agents, an intractably large space of possible agreements, non-linear utility functions and limited time so an exhaustive search for the best proposals is not feasible. We assume that agents are selfish and cannot be blindly trusted, so the algorithm does not rely on any mediator. This family of algorithms is called $$\hbox {NB}^{3}$$NB3 and applies heuristic Branch & Bound search to find good proposals. Search and negotiation happen simultaneously and therefore strongly influence each other. It applies a new time-based negotiation strategy that considers two utility aspiration levels: one for the agent itself and one for its opponents. Also, we introduce a negotiation protocol that imposes almost no restrictions and is therefore better applicable to negotiations with humans. We present the Negotiating Salesmen Problem (NSP): a variant of the Traveling Salesman Problem with multiple negotiating agents, as a test case. We describe an implementation of $$\hbox {NB}^{3}$$NB3 designed for the NSP and present the results of experiments with this implementation. We conclude that the algorithm is able to decrease the costs of the agents significantly, that the heuristic search is efficient and that the algorithm scales well with increasing complexity of the problem.

[1]  Hiromitsu Hattori,et al.  A multi-issue negotiation protocol among agents with nonlinear utility functions , 2008, Multiagent Grid Syst..

[2]  Agostino Poggi,et al.  JADE - A Java Agent Development Framework , 2005, Multi-Agent Programming.

[3]  Bo An,et al.  Continuous-Time Negotiation Mechanism for Software Agents , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[4]  Magnus Boman,et al.  Multi-Agent Rationality , 1997, Lecture Notes in Computer Science.

[5]  RJ Roy Willemen,et al.  School timetable construction : algorithms and complexity , 2002 .

[6]  Nicholas R. Jennings,et al.  Coordinating multiple concurrent negotiations , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[7]  Koen V. Hindriks,et al.  Opponent modelling in automated multi-issue negotiation using Bayesian learning , 2008, AAMAS.

[8]  J. Nash THE BARGAINING PROBLEM , 1950, Classics in Game Theory.

[9]  Eric van Damme,et al.  Non-Cooperative Games , 2000 .

[10]  Makoto Yokoo,et al.  The Distributed Constraint Satisfaction Problem: Formalization and Algorithms , 1998, IEEE Trans. Knowl. Data Eng..

[11]  Ivan Marsá-Maestre,et al.  Effective bidding and deal identification for negotiations in highly nonlinear scenarios , 2009, AAMAS.

[12]  Sarit Kraus,et al.  The First Automated Negotiating Agents Competition (ANAC 2010) , 2012, New Trends in Agent-Based Complex Automated Negotiations.

[13]  A. Rubinstein Perfect Equilibrium in a Bargaining Model , 1982 .

[14]  E. L. Lawler,et al.  Branch-and-Bound Methods: A Survey , 1966, Oper. Res..

[15]  Teodor Gabriel Crainic,et al.  PARALLEL BRANCH-AND-BOUND ALGORITHMS: SURVEY AND SYNTHESIS , 1993 .

[16]  Arnaldo Vieira Moura,et al.  A GRASP strategy for a more constrained School Timetabling Problem , 2010 .

[17]  Bernard Gendron,et al.  Parallel Branch-and-Branch Algorithms: Survey and Synthesis , 1994, Oper. Res..

[18]  Ariel Rubinstein,et al.  A Course in Game Theory , 1995 .

[19]  Bo An,et al.  Bilateral bargaining with one-sided uncertain reserve prices , 2013, Autonomous Agents and Multi-Agent Systems.

[20]  Jeffrey S. Rosenschein and Gilad Zlotkin Rules of Encounter , 1994 .

[21]  Catholijn M. Jonker,et al.  The Fifth Automated Negotiating Agents Competition (ANAC 2014) , 2016, ANAC@AAMAS.

[22]  Nicholas R. Jennings,et al.  Negotiation decision functions for autonomous agents , 1998, Robotics Auton. Syst..

[23]  KleinMark,et al.  A multi-issue negotiation protocol among agents with nonlinear utility functions , 2008 .

[24]  Christophe Labreuche,et al.  A multilateral multi-issue negotiation protocol , 2007, AAMAS '07.

[25]  L. Blume,et al.  The New Palgrave Dictionary of Economics, 2nd edition , 2008 .

[26]  Katia P. Sycara,et al.  A decentralized model for automated multi-attribute negotiations with incomplete information and general utility functions , 2008, Multiagent Grid Syst..

[27]  Pablo Noriega,et al.  Engineering open environments with electronic institutions , 2005, Eng. Appl. Artif. Intell..

[28]  Nicholas R. Jennings,et al.  Using Gaussian Processes to Optimise Concession in Complex Negotiations against Unknown Opponents , 2011, IJCAI.

[29]  Evangelos Markakis,et al.  The Power of Sequential Single-Item Auctions for Agent Coordination , 2006, AAAI.

[30]  Mark Klein,et al.  Protocols for Negotiating Complex Contracts , 2003, IEEE Intell. Syst..

[31]  Salil P. Vadhan,et al.  Computational Complexity , 2005, Encyclopedia of Cryptography and Security.

[32]  Nicholas R. Jennings,et al.  An analysis of feasible solutions for multi-issue negotiation involving nonlinear utility functions , 2009, AAMAS.

[33]  T. Bektaş The multiple traveling salesman problem: an overview of formulations and solution procedures , 2006 .

[34]  Makoto Yokoo,et al.  Adopt: asynchronous distributed constraint optimization with quality guarantees , 2005, Artif. Intell..

[35]  Koen V. Hindriks,et al.  The first automated negotiating agents competition (ANAC 2010) , 2016 .

[36]  Sujeet Kumar,et al.  Java Agent Development Framework , 2014 .

[37]  Sarit Kraus,et al.  Can automated agents proficiently negotiate with humans? , 2010, CACM.

[38]  Carles Sierra,et al.  The LOGIC negotiation model , 2007, AAMAS '07.

[39]  A. Ambrus,et al.  A continuous-time model of multilateral bargaining , 2015 .

[40]  GattiNicola,et al.  Alternating-offers bargaining with one-sided uncertain deadlines , 2008 .

[41]  Carles Sierra,et al.  DipGame: A challenging negotiation testbed , 2011, Eng. Appl. Artif. Intell..

[42]  Carles Sierra,et al.  An Agent Architecture for Simultaneous Bilateral Negotiations , 2010, CCIA.

[43]  Ulrich Endriss,et al.  Monotonic concession protocols for multilateral negotiation , 2006, AAMAS '06.

[44]  Valentin Robu,et al.  Modeling complex multi-issue negotiations using utility graphs , 2005, AAMAS '05.

[45]  Nicholas R. Jennings,et al.  Using similarity criteria to make negotiation trade-offs , 2000, Proceedings Fourth International Conference on MultiAgent Systems.

[46]  Nicola Gatti,et al.  Alternating-offers bargaining with one-sided uncertain deadlines: an efficient algorithm , 2008, Artif. Intell..