Training with automated agents improves people's behavior in negotiation and coordination tasks

There is inconclusive evidence whether practicing tasks with computer agents improves people's performance on these tasks. This paper studies this question empirically using extensive experiments involving bilateral negotiation and three-player coordination tasks played by hundreds of human subjects. We used different training methods for subjects, including practice interactions with other human participants, interacting with agents from the literature, and asking participants to design an automated agent to serve as their proxy in the task. Following training, we compared the performance of subjects when playing state-of-the-art agents from the literature. The results revealed that in the negotiation settings, in most cases, training with computer agents increased people's performance as compared to interacting with people. In the three player coordination game, training with computer agents increased people's performance when matched with the state-of-the-art agent. These results demonstrate the efficacy of using computer agents as tools for improving people's skills when interacting in strategic settings, saving considerable effort and providing better performance than when interacting with human counterparts.

[1]  Desmond A. Butler Air Gondwana : Using ICT to create an authentic learning environment to teach basic negotiation skills , 2009 .

[2]  Arlette van Wissen,et al.  Human-agent teamwork in dynamic environments , 2012, Comput. Hum. Behav..

[3]  Ron Lennon,et al.  International Negotiation Simulations: An Examination of Learning Processes and Outcomes. , 2011 .

[4]  Sarit Kraus,et al.  Can automated agents proficiently negotiate with humans? , 2010, CACM.

[5]  Gert Jan Hofstede,et al.  Why Simulation Games Work-In Search of the Active Substance: A Synthesis , 2010 .

[6]  Pushmeet Kohli,et al.  Rip-off: playing the cooperative negotiation game , 2011, AAMAS.

[7]  Sarit Kraus,et al.  Investigating the benefits of automated negotiations in enhancing people's negotiation skills , 2009, AAMAS.

[8]  Catholijn M. Jonker,et al.  An agent architecture for multi-attribute negotiation using incomplete preference information , 2007, Autonomous Agents and Multi-Agent Systems.

[9]  Sarit Kraus,et al.  Resolving crises through automated bilateral negotiations , 2008, Artif. Intell..

[10]  William H. Ross,et al.  Interactive Video Negotiator Training: A Preliminary Evaluation of the McGill Negotiation Simulator , 2001 .

[11]  Gregory E. Kersten,et al.  WWW-based negotiation support: design, implementation, and use , 1999, Decis. Support Syst..

[12]  Stacy Marsella,et al.  Building Interactive Virtual Humans for Training Environments , 2007 .

[13]  David R. Traum,et al.  Multi-party, Multi-issue, Multi-strategy Negotiation for Multi-modal Virtual Agents , 2008, IVA.

[14]  Daniel M. Reeves Contingency exigency , 2011, SECO.

[15]  Ariel Rubinstein,et al.  A Course in Game Theory , 1995 .

[16]  Claudio Bartolini,et al.  AutONA: a system for automated multiple 1-1 negotiation , 2003, EC '03.

[17]  Daniel P. Loucks,et al.  Computer-Assisted Negotiations of Water Resources Conflicts , 1998 .

[18]  John Lai Huat Lim Multi-stage negotiation support: a conceptual framework , 1999, Inf. Softw. Technol..

[19]  Michael H. Bowling,et al.  The lemonade stand game competition: solving unsolvable games , 2011, SECO.

[20]  Ya'akov Gal,et al.  Modeling User Perception of Interaction Opportunities for Effective Teamwork , 2009, 2009 International Conference on Computational Science and Engineering.

[21]  Sarit Kraus,et al.  Facing the challenge of human-agent negotiations via effective general opponent modeling , 2009, AAMAS.

[22]  Sarit Kraus,et al.  Negotiating with bounded rational agents in environments with incomplete information using an automated agent , 2008, Artif. Intell..

[23]  Sarit Kraus,et al.  GENIUS: AN INTEGRATED ENVIRONMENT FOR SUPPORTING THE DESIGN OF GENERIC AUTOMATED NEGOTIATORS , 2012, Comput. Intell..

[24]  Elizabeth L. Blake,et al.  Simulation in International Relations Education , 2001 .

[25]  Daniel Druckman,et al.  Onstage or behind the scenes? Relative learning benefits of simulation role-play and design , 2008 .