PredictRV: A Prediction Based Strategy for Negotiations with Dynamically Changing Reservation Value

Negotiation is an important component of the interaction process among humans. With increasing automation, autonomous agents are expected to take over a lot of this interaction process. Much of automated negotiation literature focuses on agents having a static and known reservation value. In situations involving dynamic environments e.g., an agent negotiating on behalf of a human regarding a meeting, agents can have a reservation value (RV) that is a function of time. This leads to a different set of challenges that may need additional reasoning about the concession behavior. In this paper, we build upon Negotiation algorithms such as ONAC (Optimal Non-Adaptive Concession) and Time-Dependent Techniques such as Boulware which work on settings where the reservation value of the agent is fixed and known. Although these algorithms can encode dynamic RV, their concession behavior and hence the properties they were expected to display would be different from when the RV is static, even though the underlying negotiation algorithm remains the same. We, therefore, propose to use one of Counter, Bayesian Learning with Regression Analysis or LSTM model on top of each algorithm to develop the PredictRV strategy and show that PredictRV indeed performs better on two different metrics tested on two different domains on a variety of parameter settings.

[1]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[2]  Victor R. Lesser,et al.  Issues in Automated Negotiation and Electronic Commerce: Extending the Contract Net Framework , 1997, ICMAS.

[3]  Nicholas R. Jennings,et al.  Learning on opponent's preferences to make effective multi-issue negotiation trade-offs , 2004, ICEC '04.

[4]  Sascha Ossowski,et al.  Automated negotiation in open and distributed environments , 2013, Expert Syst. Appl..

[5]  N. R. Jennings,et al.  To appear in: Int Journal of Group Decision and Negotiation GDN2000 Keynote Paper Automated Negotiation: Prospects, Methods and Challenges , 2022 .

[6]  Nicholas R. Jennings,et al.  Negotiation decision functions for autonomous agents , 1998, Robotics Auton. Syst..

[7]  Jean Oh,et al.  Electric Elves: Agent Technology for Supporting Human Organizations , 2002, AI Mag..

[8]  Sarit Kraus,et al.  Strategic Negotiation in Multiagent Environments , 2001, Intelligent robots and autonomous agents.

[9]  Milind Tambe,et al.  Towards Adjustable Autonomy for the Real World , 2002, J. Artif. Intell. Res..

[10]  Nicholas R. Jennings,et al.  An agenda-based framework for multi-issue negotiation , 2004, Artif. Intell..

[11]  ArielRosenfeld,et al.  Predicting Human Decision-Making: From Prediction to Action , 2018 .

[12]  Sarit Kraus,et al.  Predicting Human Decision-Making: From Prediction to Action , 2018, Predicting Human Decision-Making.

[13]  Jacques L. Koko,et al.  The Art and Science of Negotiation , 2009 .

[14]  Koen V. Hindriks,et al.  Effective acceptance conditions in real-time automated negotiation , 2014, Decis. Support Syst..

[15]  Minjie Zhang,et al.  An Adaptive Bilateral Negotiation Model Based on Bayesian Learning , 2013, Complex Automated Negotiations.

[16]  Larry Crump,et al.  Precedents in Negotiated Decisions: Korea–Australia Free Trade Agreement Negotiations , 2017 .

[17]  Nicholas R. Jennings,et al.  Optimal negotiation of multiple issues in incomplete information settings , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[18]  Sarit Kraus,et al.  GENIUS: AN INTEGRATED ENVIRONMENT FOR SUPPORTING THE DESIGN OF GENERIC AUTOMATED NEGOTIATORS , 2012, Comput. Intell..

[19]  Jeffrey S. Rosenschein,et al.  Rules of Encounter - Designing Conventions for Automated Negotiation among Computers , 1994 .

[20]  Koen V. Hindriks,et al.  Opponent modelling in automated multi-issue negotiation using Bayesian learning , 2008, AAMAS.

[21]  Jiming Liu,et al.  A genetic agent-based negotiation system , 2001, Comput. Networks.

[22]  Richard L. Scheaffer,et al.  Introduction to Probability and Its Applications. , 1991 .

[23]  Koen V. Hindriks,et al.  Optimal Non-adaptive Concession Strategies with Incomplete Information , 2014, ANAC@AAMAS.

[24]  Sarit Kraus,et al.  Principles of Automated Negotiation , 2014 .

[25]  Katia P. Sycara,et al.  Bayesian learning in negotiation , 1998, Int. J. Hum. Comput. Stud..

[26]  A. Rubinstein Perfect Equilibrium in a Bargaining Model , 1982 .

[27]  J. Gates Introduction to Probability and its Applications , 1992 .