An Agent Design for Repeated Negotiation and Information Revelation with People

Many negotiations in the real world are characterized by incomplete information, and participants' success depends on their ability to reveal information in a way that facilitates agreement without compromising the individual gains of agents. This paper presents a novel agent design for repeated negotiation in incomplete information settings that learns to reveal information strategically during the negotiation process. The agent used classical machine learning techniques to predict how people make and respond to offers during the negotiation, how they reveal information and their response to potential revelation actions by the agent. The agent was evaluated empirically in an extensive empirical study spanning hundreds of human subjects. Results show that the agent was able (1) to make offers that were beneficial to people while not compromising its own benefit; (2) to incrementally reveal information to people in a way that increased its expected performance. The agent also had a positive effect on people's strategy, in that people playing the agent performed significantly higher than people playing other people. This work demonstrates the efficacy of combining machine learning with opponent modeling techniques towards the design of computer agents for negotiating with people in settings of incomplete information.

[1]  Acknowledgments , 2006, Molecular and Cellular Endocrinology.

[2]  Koen V. Hindriks,et al.  Opponent modelling in automated multi-issue negotiation using Bayesian learning , 2008, AAMAS.

[3]  Catholijn M. Jonker,et al.  An agent architecture for multi-attribute negotiation using incomplete preference information , 2007, Autonomous Agents and Multi-Agent Systems.

[4]  Ya'akov Gal,et al.  The Effects of Goal Revelation on Computer-Mediated Negotiation , 2009 .

[5]  David Sarne,et al.  Estimating information value in collaborative multi-agent planning systems , 2007, AAMAS '07.

[6]  Frank Dignum,et al.  An empirical study of interest-based negotiation , 2007, Autonomous Agents and Multi-Agent Systems.

[7]  Nicholas R. Jennings,et al.  Learning on opponent's preferences to make effective multi-issue negotiation trade-offs , 2004, ICEC '04.

[8]  Ya'akov Gal,et al.  A cultural sensitive agent for human-computer negotiation , 2012, AAMAS.

[9]  Sarit Kraus,et al.  The Search for Coalition Formation in Costly Environments , 2003, CIA.

[10]  Sarit Kraus,et al.  Facing the challenge of human-agent negotiations via effective general opponent modeling , 2009, AAMAS.

[11]  Ya'akov Gal,et al.  A study of computational and human strategies in revelation games , 2014, Autonomous Agents and Multi-Agent Systems.

[12]  M. Rehm,et al.  Proceedings of AAMAS , 2005 .

[13]  Stuart M. Shieber,et al.  Agent decision-making in open mixed networks , 2010, Artif. Intell..

[14]  Ya'akov Gal,et al.  An Adaptive Agent for Negotiating with People in Different Cultures , 2011, TIST.

[16]  Avi Pfeffer,et al.  Simultaneously modeling humans' preferences and their beliefs about others' preferences , 2008, AAMAS.

[17]  Trevor J. M. Bench-Capon,et al.  Altruism and agents: an argumentation based approach to designing agent decision mechanisms , 2009, AAMAS.

[18]  Aniket Kittur,et al.  Crowdsourcing user studies with Mechanical Turk , 2008, CHI.