Learning to Select Negotiation Strategies in Multi-agent Meeting Scheduling

In this paper, we look at the Multi-Agent Meeting Scheduling problem where distributed agents negotiate meeting times on behalf of their users. While many negotiation approaches have been proposed for scheduling meetings, it is not well understood how agents can negotiate strategically in order to maximize their users’ utility. To negotiate strategically, agents need to learn to pick good strategies for negotiating with other agents. We show how the playbook approach, introduced by [1] for team plan selection in small-size robot soccer, can be used to select strategies. Selecting strategies in this way gives some theoretical guarantees about regret. We also show experimental results demonstrating the effectiveness of the approach.

[1]  Mar. Gonzalez,et al.  A NEGOTIATION PROTOCOL FOR MEETING SCHEDULING BASED ON A MULTIAGENT SYSTEM , 2007 .

[2]  Nicholas R. Jennings,et al.  Agent-based meeting scheduling: a design and implementation , 1995 .

[3]  Yoram Singer,et al.  Using and combining predictors that specialize , 1997, STOC '97.

[4]  Jeffrey S. Rosenschein,et al.  A Non-manipulable Meeting Scheduling System , 1994 .

[5]  Edmund H. Durfee,et al.  A Formal Study of Distributed Meeting Scheduling , 1998 .

[6]  Brett Browning,et al.  Plays as Effective Multiagent Plans Enabling Opponent-Adaptive Play Selection , 2004, ICAPS.

[7]  Manuela Veloso,et al.  Opportunities for Learning in Multi-Agent Meeting Scheduling , 2004, AAAI Technical Report.

[8]  Manuela M. Veloso,et al.  Bumping strategies for the multiagent agreement problem , 2005, AAMAS '05.

[9]  Sandip Sen,et al.  Satisfying user preferences while negotiating meetings , 1997, Int. J. Hum. Comput. Stud..

[10]  Nicolò Cesa-Bianchi,et al.  Gambling in a rigged casino: The adversarial multi-armed bandit problem , 1995, Proceedings of IEEE 36th Annual Foundations of Computer Science.

[11]  Toramatsu Shintani,et al.  Multiple negotiations among agents for a distributed meeting scheduler , 2000, Proceedings Fourth International Conference on MultiAgent Systems.

[12]  Katia Sycara,et al.  Multi-Agent Meeting Scheduling: Preliminary Experimental Results , 1996 .

[13]  Manuela M. Veloso,et al.  Bumping Strategies for the Private Incremental Multiagent Agreement Problem , 2005, AAAI Spring Symposium: Persistent Assistants: Living and Working with AI.

[14]  Manfred K. Warmuth,et al.  The weighted majority algorithm , 1989, 30th Annual Symposium on Foundations of Computer Science.