Evolving Best-Response Strategies for Market-Driven Agents Using Aggregative Fitness GA

There are very few existing works that adopt genetic algorithms (GAs) for evolving the most successful strategies for different negotiation situations. Furthermore, these works did not explicitly model the influence of market dynamics. The contribution of this work is developing bargaining agents that can both: 1) react to different market situations by adjusting their amounts of concessions and 2) evolve their best-response strategies for different market situations and constraints using an aggregative fitness GA (AFGA). While many existing negotiation agents only optimize utilities, the AFGA in this work is used to evolve best-response strategies of negotiation agents that optimize their utilities, success rates, and negotiation speed in different market situations. Given different constraints and preferences of agents in optimizing utilities, success rates, and negotiation speed, different best-response strategies can be evolved using the AFGA. A testbed consisting of both: 1) market-driven agents (MDAs)-negotiation agents that make adjustable amounts of concessions taking into account market rivalry, outside options, and time preferences and 2) GA-MDAs-MDAs augmented with an AFGA, was implemented. Empirical results show that GA-MDAs achieved higher utilities, higher success rates, and faster negotiation speed than MDAs in a wide variety of market situations.

[1]  A. Rubinstein.  Perfect Equilibrium in a Bargaining Model , 1982 .

[2]  Stan Matwin,et al.  Genetic algorithms approach to a negotiation support system , 1991, IEEE Trans. Syst. Man Cybern..

[3]  A. Rubinstein,et al.  Bargaining and Markets. , 1991 .

[4]  Heinz Mühlenbein,et al.  How Genetic Algorithms Really Work: Mutation and Hillclimbing , 1992, PPSN.

[5]  Gavin Kennedy,et al.  Field Guide to Negotiation: A Glossary of Essential Tools and Concepts for Today's Manager , 1994 .

[6]  George J. Klir,et al.  Fuzzy sets and fuzzy logic - theory and applications , 1995 .

[7]  Eduardo Alonso Fernández,et al.  Rules of encounter: designing conventions for automated negotiation among computers , 1995 .

[8]  Thomas Bäck,et al.  Intelligent Mutation Rate Control in Canonical Genetic Algorithms , 1996, ISMIS.

[9]  Pattie Maes,et al.  A Real-Life Experiment in Creating an Agent Marketplace , 1997, Software Agents and Soft Computing.

[10]  Pattie Maes,et al.  Kasbah: An Agent Marketplace for Buying and Selling Goods , 1996, PAAM.

[11]  Richard K. Belew,et al.  New Methods for Competitive Coevolution , 1997, Evolutionary Computation.

[12]  Nicholas R. Jennings,et al.  Determining successful negotiation strategies: an evolutionary approach , 1998, Proceedings International Conference on Multi Agent Systems (Cat. No.98EX160).

[13]  Nicholas R. Jennings,et al.  Negotiation decision functions for autonomous agents , 1998, Robotics Auton. Syst..

[14]  Arthur C. Graesser,et al.  Agent behaviors in virtual negotiation environments , 1999, IEEE Trans. Syst. Man Cybern. Part C.

[15]  D. Dubois,et al.  Qualitative possibility theory and its applications to constraint satisfaction and decision under uncertainty , 1999 .

[16]  N. R. Jennings,et al.  To appear in: Int Journal of Group Decision and Negotiation GDN2000 Keynote Paper Automated Negotiation: Prospects, Methods and Challenges , 2022 .

[17]  Carlos A. Coello Coello,et al.  An updated survey of GA-based multiobjective optimization techniques , 2000, CSUR.

[18]  Aravind Seshadri,et al.  A FAST ELITIST MULTIOBJECTIVE GENETIC ALGORITHM: NSGA-II , 2000 .

[19]  Kwang Mong Sim,et al.  Toward market-driven agents for electronic auction , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[20]  Sarit Kraus,et al.  Automated Negotiation and Decision Making in Multiagent Environments , 2001, EASSS.

[21]  Michael Wooldridge,et al.  A Classification Scheme for Negotiation in Electronic Commerce , 2001 .

[22]  Kwang Mong Sim,et al.  A Market–Driven Model for Designing Negotiation Agents , 2002, Comput. Intell..

[23]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[24]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[25]  Ross A. Malaga,et al.  A weighted sum genetic algorithm to support multiple-party multiple-objective negotiations , 2002, IEEE Trans. Evol. Comput..

[26]  Chang Wook Ahn,et al.  Elitism-based compact genetic algorithms , 2003, IEEE Trans. Evol. Comput..

[27]  Jon B. Weissman.  Guest editorial: special issue on grid computing , 2003, PERV.

[28]  Kwang Mong Sim,et al.  Agents that react to changing market situations , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[29]  Kwang Mong Sim.  Equilibrium analyses of market-driven agents , 2003, SECO.

[30]  Francisco Herrera,et al.  A taxonomy for the crossover operator for real‐coded genetic algorithms: An experimental study , 2003, Int. J. Intell. Syst..

[31]  Nicholas R. Jennings,et al.  A Comparative Study of Game Theoretic and Evolutionary Models of Bargaining for Software Agents , 2005, Artificial Intelligence Review.

[32]  Kwang Mong Sim,et al.  From market-driven agents to market-oriented grids (position paper) , 2004, SECO.

[33]  Kwang Mong Sim,et al.  Flexible negotiation agent with relaxed decision rules , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[34]  Kwang Mong Sim,et al.  Negotiation Agents that Make Prudent Compromises and are Slightly Flexible in Reaching Consensus , 2004, Comput. Intell..

[35]  Francisco Herrera,et al.  Tackling Real-Coded Genetic Algorithms: Operators and Tools for Behavioural Analysis , 1998, Artificial Intelligence Review.

[36]  Nanlin Jin,et al.  Co-evolutionary Strategies for an Alternating-Offer Bargaining Problem , 2005, CIG.

[37]  Raymond Y. K. Lau.  Towards Genetically Optimised Multi-Agent Multi-Issue Negotiations , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[38]  Kwang Mong Sim,et al.  Equilibria, prudent Compromises,and the "Waiting" game , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[39]  Raymond Y. K. Lau,et al.  An evolutionary learning approach for adaptive negotiation agents , 2006, Int. J. Intell. Syst..

[40]  Raymond Y. K. Lau,et al.  An evolutionary learning approach for adaptive negotiation agents: Research Articles , 2006 .

[41]  Kwang Mong Sim,et al.  A survey of bargaining models for grid resource allocation , 2006, SECO.

[42]  Kwang Mong Sim,et al.  Grid Commerce, Market-Driven G-Negotiation, and Grid Resource Management , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[43]  Nanlin Jin,et al.  Co-adaptive Strategies for Sequential Bargaining Problems with Discount Factors and Outside Options , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[44]  Kwang Mong Sim.  Guest Editorial: Agent-based Grid computing , 2006, Applied Intelligence.

[45]  Feng Yu-qiang,et al.  A Fuzzy Reasoning Based Bidding Strategy for Continuous Double Auctions , 2007, 2007 IEEE International Conference on Control and Automation.

[46]  R. K. Ursem.  Multi-objective Optimization using Evolutionary Algorithms , 2009 .