NegoChat-A: a chat-based negotiation agent with bounded rationality

To date, a variety of automated negotiation agents have been created. While each of these agents has been shown to be effective in negotiating with people in specific environments, they typically lack the natural language processing support required to enable real-world types of interactions. To address this limitation, we present NegoChat-A, an agent that incorporates several significant research contributions. First, we found that simply modifying existing agents to include an natural language processing module is insufficient to create these agents. Instead, agents that support natural language must have strategies that allow for partial agreements and issue-by-issue interactions. Second, we present NegoChat-A’s negotiation algorithm. This algorithm is based on bounded rationality, and specifically anchoring and aspiration adaptation theory. The agent begins each negotiation interaction by proposing a full offer, which serves as its anchor. Assuming this offer is not accepted, the agent then proceeds to negotiate via partial agreements, proposing the next issue for negotiation based on people’s typical urgency, or order of importance. We present a rigorous evaluation of NegoChat-A, showing its effectiveness in two different negotiation roles.

[1]  Michael H. Coen,et al.  Design Principles for Intelligent Environments , 1998, AAAI/IAAI.

[2]  T. Gärling,et al.  The Effects of Anchor Points and Reference Points on Negotiation Process and Outcome , 1997 .

[3]  Sarvapali D. Ramchurn,et al.  Argumentation-based negotiation , 2003, The Knowledge Engineering Review.

[4]  Sarit Kraus,et al.  Can automated agents proficiently negotiate with humans? , 2010, CACM.

[5]  Koby Crammer,et al.  Online Passive-Aggressive Algorithms , 2003, J. Mach. Learn. Res..

[6]  P. T. Hopmann.  The negotiation process and the resolution of international conflicts , 1996 .

[7]  Pinar Yolum,et al.  Learning opponent’s preferences for effective negotiation: an approach based on concept learning , 2010, Autonomous Agents and Multi-Agent Systems.

[8]  Sarit Kraus,et al.  GENIE: A decision support system for crisis negotiations , 1995, Decis. Support Syst..

[9]  Sarit Kraus,et al.  Negotiating with bounded rational agents in environments with incomplete information using an automated agent , 2008, Artif. Intell..

[10]  Hermann Ney,et al.  Comparing Stochastic Approaches to Spoken Language Understanding in Multiple Languages , 2011, IEEE Transactions on Audio, Speech, and Language Processing.

[11]  M. Keith Chen,et al.  Agendas in Multi-Issue Bargaining : When to Sweat the Small Stu ff ∗ , 2002 .

[12]  Koen V. Hindriks,et al.  Effective acceptance conditions in real-time automated negotiation , 2014, Decis. Support Syst..

[13]  Sarit Kraus,et al.  AutoMed: an automated mediator for multi-issue bilateral negotiations , 2012, Autonomous Agents and Multi-Agent Systems.

[14]  R. Selten,et al.  Aspiration Adaptation Theory. , 1998, Journal of mathematical psychology.

[15]  Barbara Plank,et al.  Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies , 2011 .

[16]  Stacy Marsella,et al.  Building Interactive Virtual Humans for Training Environments , 2007 .

[17]  Sarit Kraus,et al.  GENIUS: AN INTEGRATED ENVIRONMENT FOR SUPPORTING THE DESIGN OF GENERIC AUTOMATED NEGOTIATORS , 2012, Comput. Intell..

[18]  Sarit Kraus,et al.  Towards Automated Negotiation Agents that use Chat Interface , 2013 .

[19]  Saso Dzeroski,et al.  An extensive experimental comparison of methods for multi-label learning , 2012, Pattern Recognit..

[20]  Saso Dzeroski,et al.  Tree ensembles for predicting structured outputs , 2013, Pattern Recognit..

[21]  Graeme Hirst,et al.  Recognizing Textual Entailment , 2012 .

[22]  Lei Tang,et al.  Large scale multi-label classification via metalabeler , 2009, WWW '09.

[23]  Anton Leuski,et al.  A Statistical Approach for Text Processing in Virtual Humans , 2008 .

[24]  Grigorios Tsoumakas,et al.  Effective and Efficient Multilabel Classification in Domains with Large Number of Labels , 2008 .

[25]  Fabrizio Morbini,et al.  Joint Identification and Segmentation of Domain-Specific Dialogue Acts for Conversational Dialogue Systems , 2011, ACL.

[26]  Sarit Kraus,et al.  Facing the challenge of human-agent negotiations via effective general opponent modeling , 2009, AAMAS.

[27]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[28]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction (4th Edition) , 2004 .

[29]  Amos Azaria,et al.  Strategic advice provision in repeated human-agent interactions , 2012, Autonomous Agents and Multi-Agent Systems.

[30]  Wietske Visser,et al.  A Framework for Qualitative Multi-criteria Preferences , 2012, ICAART.

[31]  Avi Rosenfeld,et al.  NegoChat: a chat-based negotiation agent , 2014, AAMAS.

[32]  Ariel Rubinstein,et al.  A Course in Game Theory , 1995 .

[33]  Claudio Bartolini,et al.  AutONA: a system for automated multiple 1-1 negotiation , 2003, EC '03.

[34]  Catholijn M. Jonker,et al.  An agent architecture for multi-attribute negotiation using incomplete preference information , 2007, Autonomous Agents and Multi-Agent Systems.

[35]  Philip R. Cohen.  The role of natural language in a multimodal interface , 1992, UIST '92.

[36]  Sarit Kraus,et al.  Bridging the Gap: Face-to-Face Negotiations with an Automated Mediator , 2011, IEEE Intelligent Systems.

[37]  William W. Cohen,et al.  Single-pass online learning: performance, voting schemes and online feature selection , 2006, KDD '06.

[38]  Mehmet Bac,et al.  Negotiations : The Role of Information and Time Preference , 1996 .

[39]  Ya'akov Gal,et al.  A study of computational and human strategies in revelation games , 2014, Autonomous Agents and Multi-Agent Systems.

[40]  Sarit Kraus,et al.  Providing Arguments in Discussions Based on the Prediction of Human Argumentative Behavior , 2015, AAAI.

[41]  David R. Traum,et al.  Multi-party, Multi-issue, Multi-strategy Negotiation for Multi-modal Virtual Agents , 2008, IVA.

[42]  Ido Dagan,et al.  Recognizing Textual Entailment: Models and Applications , 2013, Recognizing Textual Entailment: Models and Applications.

[43]  P. Kline.  Models of man , 1986, Nature.

[44]  H. Simon,et al.  Models of Man. , 1957 .

[45]  Sarit Kraus,et al.  Modeling agents based on aspiration adaptation theory , 2012, Autonomous Agents and Multi-Agent Systems.

[46]  D. Kahneman.  Reference points, anchors, norms, and mixed feelings. , 1992 .

[47]  Sarit Kraus,et al.  Evaluating practical negotiating agents: Results and analysis of the 2011 international competition , 2013, Artif. Intell..

[48]  Catholijn M. Jonker,et al.  Social acceptance of negotiation support systems: scenario-based exploration with focus groups and online survey , 2012, Cognition, Technology & Work.

[49]  David Sarne,et al.  Negotiation in exploration-based environment , 2012, Autonomous Agents and Multi-Agent Systems.

[50]  James H. Martin,et al.  Speech and language processing: an introduction to natural language processing, computational linguistics, and speech recognition, 2nd Edition , 2000, Prentice Hall series in artificial intelligence.

[51]  Lutz-Alexander Busch,et al.  A Comment on Issue-by-Issue Negotiations , 1997 .