Human-computer negotiation in a three player market setting

This paper proposes a novel agent-design for a three-player game involving human players and computer agents. The game is analogous to settings in which participants repeatedly negotiate over contracts, such as cell-phones and credit card plans. The game comprises three players, two service providers who compete to sign contracts with a single customer player. The service providers compete to make repeated contract offers to the customer consisting of resource exchanges in the game. Customers can join and leave contracts at will. We computed sub-game perfect equilibrium strategies for all players that were based on making contracts involving commitments between the customer player and one of the service provider players. We conducted extensive empirical studies (spanning over 500 participants) comparing the performance of computer agents using different types of equilibrium strategies with that of people in three different countries, the U.S., Israel and China, that are characterized by cultural differences in how people make contracts in the game. Two human participants played a single computer agent in various role configurations in the game. For the customer role, agents using equilibrium strategies were able to obtain a higher score than people playing the same role in three countries. For the service provider role, agents using equilibrium strategies that reasoned about possibly irrational behavior were able to obtain higher scores than people (as well as agents that did not reason about irrational behavior). This work shows that for particular market settings involving competition between service providers, equilibrium strategies can be a successful design paradigm for computer agents without relying on data driven approaches.

[1]  V. Lesser,et al.  Automated negotiation for complex multi-agent resource allocation , 2010 .

[2]  Mark Klein,et al.  Scalable Complex Contract Negotiation with Structured Search and Agenda Management , 2014, AAAI.

[3]  Rajarshi Das,et al.  Agent-Human Interactions in the Continuous Double Auction , 2001, IJCAI.

[4]  Anastassios Kalandrakis,et al.  A three-player dynamic majoritarian bargaining game , 2004, J. Econ. Theory.

[5]  Amos Azaria,et al.  Automated agents for reward determination for human work in crowdsourcing applications , 2014, Autonomous Agents and Multi-Agent Systems.

[6]  Ya'akov Gal,et al.  An Adaptive Agent for Negotiating with People in Different Cultures , 2011, TIST.

[7]  Ya'akov Gal,et al.  A study of computational and human strategies in revelation games , 2014, Autonomous Agents and Multi-Agent Systems.

[8]  Arlette van Wissen,et al.  Human-agent teamwork in dynamic environments , 2012, Comput. Hum. Behav..

[9]  Ana Paiva,et al.  Social Importance Dynamics: A Model for Culturally-Adaptive Agents , 2013, IVA.

[10]  Nicola Gatti,et al.  Alternating-offers bargaining with one-sided uncertain deadlines: an efficient algorithm , 2008, Artif. Intell..

[11]  Grady E. Means,et al.  MetaCapitalism: The e-Business Revolution and the Design of 21st-Century Companies and Markets , 2000 .

[12]  Avi Pfeffer,et al.  Modeling how humans reason about others with partial information , 2008, AAMAS.

[13]  Stuart M. Shieber,et al.  Agent decision-making in open mixed networks , 2010, Artif. Intell..

[14]  A. Rubinstein Perfect Equilibrium in a Bargaining Model , 1982 .

[15]  Elnaz Nouri,et al.  Cross Cultural Report of Values and Decisions in the Multi Round Ultimatum Game and the Centipede Game , 2015 .

[16]  Tuomas Sandholm,et al.  Surplus equivalence of leveled commitment contracts , 2002, Artif. Intell..

[17]  Ana Paiva,et al.  Modeling culture in intelligent virtual agents , 2015, Autonomous Agents and Multi-Agent Systems.

[18]  Nicholas R. Jennings,et al.  A heuristic model for concurrent bi-lateral negotiations in incomplete information settings , 2003, IJCAI.

[19]  S. Zamir,et al.  Bargaining and Market Behavior in Jerusalem, Ljubljana, Pittsburgh, and Tokyo: An Experimental Study , 1991 .

[20]  Katia P. Sycara,et al.  Bilateral negotiation decisions with uncertain dynamic outside options , 2004, Proceedings. First IEEE International Workshop on Electronic Contracting, 2004..

[21]  Ya'akov Gal,et al.  A cultural sensitive agent for human-computer negotiation , 2012, AAMAS.

[22]  Sarit Kraus,et al.  Resolving crises through automated bilateral negotiations , 2008, Artif. Intell..

[23]  Tuomas Sandholm,et al.  Bargaining with Deadlines , 1999, AAAI/IAAI.

[24]  Koen V. Hindriks,et al.  Opponent modelling in automated multi-issue negotiation using Bayesian learning , 2008, AAMAS.

[25]  David R. Traum,et al.  Cultural Differences in Playing Repeated Ultimatum Game Online with Virtual Humans , 2014, 2014 47th Hawaii International Conference on System Sciences.

[26]  Tuomas Sandholm,et al.  Surplus equivalence of levelled commitment contracts , 2000, Proceedings Fourth International Conference on MultiAgent Systems.

[27]  Sarit Kraus,et al.  DESIGNING AND BUILDING A NEGOTIATING AUTOMATED AGENT , 1995, Comput. Intell..

[28]  Avi Pfeffer,et al.  Simultaneously modeling humans' preferences and their beliefs about others' preferences , 2008, AAMAS.

[29]  Yannis Bakos,et al.  The emerging role of electronic marketplaces on the Internet , 1998, CACM.

[30]  Bo An,et al.  Decommitment in multi-resource negotiation , 2008, AAMAS.

[31]  Avi Rosenfeld,et al.  NegoChat-A: a chat-based negotiation agent with bounded rationality , 2015, Autonomous Agents and Multi-Agent Systems.

[32]  Ya'akov Gal,et al.  Modeling Reciprocal Behavior in Human Bilateral Negotiation , 2007, AAAI.

[33]  Sarit Kraus,et al.  Negotiating with bounded rational agents in environments with incomplete information using an automated agent , 2008, Artif. Intell..

[34]  Michael N. Huhns,et al.  An Extended Protocol for Multiple-Issue Concurrent Negotiation , 2005, AAAI.

[35]  Avi Rosenfeld,et al.  Saying YES! The cross-cultural complexities of favors and trust in human-agent negotiation , 2015, 2015 International Conference on Affective Computing and Intelligent Interaction (ACII).