A BOA-based adaptive strategy with multi-party perspective for automated multilateral negotiations

Determining an effective strategy for intelligent agents in multilateral negotiations is a more complicated problem than in bilateral negotiations. In order to achieve an optimal and beneficial agreement the agent needs to consider the behavior and desired utility of more than one opponent, determine a concession tactic based on a smaller agreement space, and use a computationally efficient mechanism for generating optimal offers. However, a mere extension of bilateral negotiation strategies cannot be effective in multilateral negotiations because the nature of most bilateral negotiation strategies is based on interaction with only one opponent and tracking a single behavior during the negotiation process. In this paper, we propose an adaptive approach based on a multi-party perspective to determine multilateral negotiation strategy. The proposed approach applies the BOA framework (Bidding, Opponent model, and Acceptance) and dynamically models the opponents’ preference profiles. In order to estimate the obtainable utility from opponents and help find a good offer, the agent uses an ensemble model made by individual frequency-based opponent models and a different level of attention to each party’s behavior. The proposed approach also implements a bidding strategy which applies the opponents’ desirable utility to adapt the agent’s concession tactic and produce appropriate offers. The results of experimental evaluations on various negotiation scenarios against the state of the art multilateral negotiation strategies show that our proposed strategy can provide superior performance in both individual utility and social welfare and lead to more optimal and fairer agreements.

[1]  Tim Baarslag Exploring the Strategy Space of Negotiating Agents: A Framework for Bidding, Learning and Accepting in Automated Negotiation , 2016 .

[2]  Koen V. Hindriks,et al.  Effective acceptance conditions in real-time automated negotiation , 2014, Decis. Support Syst..

[3]  Liviu Dan Serban,et al.  AgentFSEGA: Time Constrained Reasoning Model for Bilateral Multi-Issue Negotiations , 2012, New Trends in Agent-Based Complex Automated Negotiations.

[4]  Chunyan Miao,et al.  Negotiation Agents' Decision Making Using Markov Chains , 2008 .

[5]  Takayuki Ito,et al.  Atlas3: A Negotiating Agent Based on Expecting Lower Limit of Concession Function , 2017 .

[6]  Miltiades E. Anagnostou,et al.  Multi-modal Opponent Behaviour Prognosis in E-Negotiations , 2011, IWANN.

[7]  J. B. Peperkamp,et al.  Pokerface: The Pokerface Strategy for Multiparty Negotiation , 2017 .

[8]  Takayuki Ito,et al.  WhaleAgent: Hardheaded Strategy and Conceder Strategy Based on the Heuristics , 2014, ANAC@AAMAS.

[9]  Enrique Herrera-Viedma,et al.  Group Decision Making with Heterogeneous Preference Structures: An Automatic Mechanism to Support Consensus Reaching , 2019, Group Decision and Negotiation.

[10]  Farhad Zafari,et al.  BraveCat: Iterative Deepening Distance-Based Opponent Modeling and Hybrid Bidding in Nonlinear Ultra Large Bilateral Multi Issue Negotiation Domains , 2014, ANAC@AAMAS.

[11]  Enrique Herrera-Viedma,et al.  On dynamic consensus processes in group decision making problems , 2018, Inf. Sci..

[12]  Takayuki Ito,et al.  Complex Automated Negotiations: Theories, Models, and Software Competitions , 2013, Complex Automated Negotiations.

[13]  Takayuki Ito,et al.  AgentK: Compromising Strategy based on Estimated Maximum Utility for Automated Negotiating Agents , 2012, New Trends in Agent-Based Complex Automated Negotiations.

[14]  Carles Sierra,et al.  GANGSTER: An Automated Negotiator Applying Genetic Algorithms , 2014, ANAC@AAMAS.

[15]  Bruce Bueno de Mesquita,et al.  An Introduction to Game Theory , 2014 .

[16]  Koen V. Hindriks,et al.  The Benefits of Opponent Models in Negotiation , 2009, 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology.

[17]  Takayuki Ito,et al.  New Trends in Agent-Based Complex Automated Negotiations , 2011, Studies in Computational Intelligence.

[18]  Ameet Talwalkar,et al.  Foundations of Machine Learning , 2012, Adaptive computation and machine learning.

[19]  Ho-fung Leung,et al.  CUHKAgent2015: An Adaptive Negotiation Strategy in Multilateral Scenario , 2017 .

[20]  Gerhard Weiss,et al.  An approach to complex agent-based negotiations via effectively modeling unknown opponents , 2015, Expert Syst. Appl..

[21]  Enrique Herrera-Viedma,et al.  A comparative study on consensus measures in group decision making , 2018, Int. J. Intell. Syst..

[22]  Charles J. Thomas An Alternating-Offers Model of Multilateral Negotiations , 2012 .

[23]  Kwang Mong Sim,et al.  Concurrent Negotiation and Coordination for Grid Resource Coallocation , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[24]  Bo An,et al.  Agent Buyog: A Negotiation Strategy for Tri-Party Multi Issue Negotiation , 2017 .

[25]  Dominik Peters,et al.  Pareto-Optimal Allocation of Indivisible Goods with Connectivity Constraints , 2018, AAAI.

[27]  Koen V. Hindriks,et al.  Decoupling Negotiating Agents to Explore the Space of Negotiation Strategies , 2012, Novel Insights in Agent-based Complex Automated Negotiation.

[28]  Koen V. Hindriks,et al.  Alternating Offers Protocols for Multilateral Negotiation , 2017 .

[29]  Gerhard Weiss,et al.  Negotiating with Unknown Opponents Toward Multi-lateral Agreement in Real-Time Domains , 2017 .

[30]  Nicholas R. Jennings,et al.  Negotiation decision functions for autonomous agents , 1998, Robotics Auton. Syst..

[31]  Nicholas R. Jennings,et al.  Optimal Negotiation Strategies for Agents with Incomplete Information , 2001, ATAL.

[32]  Sarit Kraus,et al.  The First Automated Negotiating Agents Competition (ANAC 2010) , 2012, New Trends in Agent-Based Complex Automated Negotiations.

[33]  Sarit Kraus,et al.  GENIUS: AN INTEGRATED ENVIRONMENT FOR SUPPORTING THE DESIGN OF GENERIC AUTOMATED NEGOTIATORS , 2012, Comput. Intell..

[34]  Katsuhide Fujita,et al.  RandomDance: Compromising Strategy Considering Interdependencies of Issues with Randomness , 2017 .

[35]  Koen V. Hindriks,et al.  Learning about the opponent in automated bilateral negotiation: a comprehensive survey of opponent modeling techniques , 2016, Autonomous Agents and Multi-Agent Systems.

[36]  Niels van Galen Last Agent Smith: Opponent Model Estimation in Bilateral Multi-issue Negotiation , 2012, New Trends in Agent-Based Complex Automated Negotiations.

[37]  Koen V. Hindriks,et al.  The Automated Negotiating Agents Competition, 2010-2015 , 2015, AI Mag..

[38]  Pinar Yolum,et al.  The Effect of Preference Representation on Learning Preferences in Negotiation , 2012, New Trends in Agent-Based Complex Automated Negotiations.

[39]  L. Thompson,et al.  The Mind and Heart of the Negotiator , 1997 .

[40]  Nicholas R. Jennings,et al.  Learning on opponent's preferences to make effective multi-issue negotiation trade-offs , 2004, ICEC '04.

[41]  Vincent Conitzer,et al.  Group Fairness for Indivisible Goods Allocation , 2019 .

[42]  N. R. Jennings,et al.  To appear in: Int Journal of Group Decision and Negotiation GDN2000 Keynote Paper Automated Negotiation: Prospects, Methods and Challenges , 2022 .

[43]  Kurosh Madani,et al.  An adaptive approach for decision making tactics in automated negotiation , 2013, Applied Intelligence.

[44]  Nur Izura Udzir,et al.  The Learning of an Opponent's Approximate Preferences in Bilateral Automated Negotiation , 2011, J. Theor. Appl. Electron. Commer. Res..

[45]  Nicholas R. Jennings,et al.  IAMhaggler: A Negotiation Agent for Complex Environments , 2012, New Trends in Agent-Based Complex Automated Negotiations.

[46]  Kaushal Chari,et al.  Learning Negotiation Support Systems in Competitive Negotiations: A Study of Negotiation Behaviors and System Impacts , 2009 .

[47]  Koen V. Hindriks,et al.  The first automated negotiating agents competition (ANAC 2010) , 2016 .

[48]  S. Sen,et al.  Jonny Black: A Mediating Approach to Multilateral Negotiations , 2017 .

[49]  Catholijn M. Jonker,et al.  From problems to protocols: Towards a negotiation handbook , 2013, Decis. Support Syst..

[50]  K. Robert Lai,et al.  Learning opponent’s beliefs via fuzzy constraint-directed approach to make effective agent negotiation , 2010, Applied Intelligence.

[51]  Farhad Zafari,et al.  POPPONENT: Highly accurate, individually and socially efficient opponent preference model in bilateral multi issue negotiations , 2016, Artif. Intell..

[52]  Guo Wei,et al.  Consistency and consensus modeling of linear uncertain preference relations , 2020, Eur. J. Oper. Res..

[53]  Takayuki Ito,et al.  Modern Approaches to Agent-based Complex Automated Negotiation , 2017 .

[54]  Sarit Kraus,et al.  Evaluating practical negotiating agents: Results and analysis of the 2011 international competition , 2013, Artif. Intell..

[55]  Manish Agrawal,et al.  Negotiation Behaviors in Agent-Based Negotiation Support Systems , 2009, Int. J. Intell. Inf. Technol..

[56]  Francisco Herrera,et al.  A Consensus Model for Group Decision Making With Incomplete Fuzzy Preference Relations , 2007, IEEE Transactions on Fuzzy Systems.

[57]  Sarit Kraus,et al.  Can automated agents proficiently negotiate with humans? , 2010, CACM.