The Learning of an Opponent's Approximate Preferences in Bilateral Automated Negotiation

Autonomous agents can negotiate on behalf of buyers and sellers to make a contract in the e-marketplace. In bilateral negotiation, they need to find a joint agreement by satisfying each other. That is, an agent should learn its opponent's preferences. However, the agent has limited time to find an agreement while trying to protect its payoffs by keeping its preferences private. In doing so, generating offers with incomplete information about the opponent's preferences is a complex process and, therefore, learning these preferences in a short time can assist the agent to generate proper offers. In this paper, we have developed an incremental on-line learning approach by using a hybrid soft-computing technique to learn the opponent's preferences. In our learning approach, first, the size of possible preferences is reduced by encoding the uncertain preferences into a series of fuzzy membership functions. Then, a simplified genetic algorithm is used to search the best fuzzy preferences that articulate the opponent's intention. Experimental results showed that our learning approach can estimate the opponent's preferences effectively. Moreover, results indicate that agents which use the proposed learning approach not only have more chances to reach agreements but also will be able to find agreements with greater joint utility.

[1]  Nicholas R. Jennings,et al.  Learning on opponent's preferences to make effective multi-issue negotiation trade-offs , 2004, ICEC '04.

[2]  Katia P. Sycara,et al.  Benefits of Learning in Negotiation , 1997, AAAI/IAAI.

[3]  Frank Dignum,et al.  Agent-Mediated Electronic Commerce III: Current Issues in Agent-Based Electronic Commerce Systems , 2001 .

[4]  Pattie Maes,et al.  Agents that buy and sell , 1999, CACM.

[5]  N. R. Jennings,et al.  To appear in: Int Journal of Group Decision and Negotiation GDN2000 Keynote Paper Automated Negotiation: Prospects, Methods and Challenges , 2022 .

[6]  Chi-Bin Cheng,et al.  Intelligent agents for e-marketplace: Negotiation with issue trade-offs by fuzzy inference systems , 2006, Decis. Support Syst..

[7]  Carles Sierra,et al.  A Negotiation Meta Strategy Combining Trade-off and Concession Moves , 2006, Autonomous Agents and Multi-Agent Systems.

[8]  Gregory E. Kersten,et al.  Negotiation Support and E-negotiation Systems: An Overview , 2007 .

[9]  Katia P. Sycara,et al.  Bayesian learning in negotiation , 1998, Int. J. Hum. Comput. Stud..

[10]  Sarit Kraus,et al.  Negotiating with bounded rational agents in environments with incomplete information using an automated agent , 2008, Artif. Intell..

[11]  Gregory E. Kersten,et al.  Predicting opponent's moves in electronic negotiations using neural networks , 2008, Expert Syst. Appl..

[12]  Nicholas R. Jennings,et al.  A fuzzy constraint based model for bilateral, multi-issue negotiations in semi-competitive environments , 2003, Artif. Intell..

[13]  Jacques L. Koko,et al.  The Art and Science of Negotiation , 2009 .

[14]  Bruce Spencer,et al.  A Bayesian classifier for learning opponents' preferences in multi-object automated negotiation , 2007, Electron. Commer. Res. Appl..

[15]  Gregory E. Kersten,et al.  Aspire: an integrated negotiation support system and software agents for e-business negotiation , 2003, Int. J. Internet Enterp. Manag..

[16]  Matthias Klusch,et al.  Multistage Fuzzy Decision Making in Bilateral Negotiation with Finite Termination Times , 2009, Australasian Conference on Artificial Intelligence.

[17]  Barbara Messing,et al.  An Introduction to MultiAgent Systems , 2002, Künstliche Intell..

[18]  Huaiqing Wang,et al.  On-demand e-supply chain integration: A multi-agent constraint-based approach , 2008, Expert Syst. Appl..

[19]  Makoto Yokoo,et al.  Algorithms for Distributed Constraint Satisfaction: A Review , 2000, Autonomous Agents and Multi-Agent Systems.

[20]  Catholijn M. Jonker,et al.  An agent architecture for multi-attribute negotiation using incomplete preference information , 2007, Autonomous Agents and Multi-Agent Systems.

[21]  Arie Segev,et al.  Automated Negotiations: A Survey of the State of the Art , 1997, Wirtschaftsinf..

[22]  Claudio Arbib,et al.  Optimal resource assignment through negotiation in a multi-agent manufacturing system , 2000 .

[23]  Nicholas R. Jennings,et al.  Using similarity criteria to make issue trade-offs in automated negotiations , 2002, Artif. Intell..

[24]  Ken Binmore,et al.  Applying game theory to automated negotiation , 1999 .

[25]  Ryszard Kowalczyk,et al.  On Constraint-Based Reasoning in e-Negotiation Agents , 2000, AMEC.

[26]  Nicholas R. Jennings,et al.  Determining successful negotiation strategies: an evolutionary approach , 1998, Proceedings International Conference on Multi Agent Systems (Cat. No.98EX160).

[27]  A. Rubinstein Perfect Equilibrium in a Bargaining Model , 1982 .

[28]  Tuomas Sandholm,et al.  Algorithm for optimal winner determination in combinatorial auctions , 2002, Artif. Intell..

[29]  Nicholas R. Jennings,et al.  Negotiation decision functions for autonomous agents , 1998, Robotics Auton. Syst..

[30]  Frank Teuteberg,et al.  Experimental Evaluation of a Model for Multilateral Negotiation with Fuzzy Preferences on an Agent-based Marketplace , 2003, Electron. Mark..

[31]  Mareike Schoop,et al.  Negoisst: a negotiation support system for electronic business-to-business negotiations in e-commerce , 2003, Data Knowl. Eng..

[32]  Wen-Yau Liang,et al.  The agent-based negotiation process for B2C e-commerce , 2010, Expert Syst. Appl..

[33]  Koen V. Hindriks,et al.  Opponent modelling in automated multi-issue negotiation using Bayesian learning , 2008, AAMAS.