An Improvisational Approach to Acquire Social Interactions

To build agents that can engage users in more open-ended social contexts, research has increasingly been focused on data-driven approaches to reduce the requirement of extensive, hand-authored behavioral content creation. However, one fundamental challenge of data-driven approaches is acquiring the interaction data with sufficient variety that reflects the characteristics of open-ended social interactions. Previous work attempts to acquire social interaction data either from face-to-face interactions or human-agent interactions using a simulated environment. In this work, Active Analysis (AA), a theater rehearsal technique, was applied to collect diverse social strategies and interactions. In particular, this work integrated AA into a web-based crowdsourcing task that requires two crowd workers to conduct a bilateral multi-level multi-issue negotiation. Findings from a between-subject experiment with 200 crowd workers recruited from Amazon Mechanical Turk demonstrated that AA could facilitate the creativity of crowd workers and thus lead to social interaction data with greater variety. In addition, AA provides a means to control the diversity so that the coverage of the collected data is consistent with the goals of the application. The results presented in the paper lay a good foundation for future work on data-driven approaches to build socially interactive agents.

[1]  LNAI Founding,et al.  Agent and Multi-Agent Systems. Technologies and Applications , 2012, Lecture Notes in Computer Science.

[2]  P. V. Balakrishnan,et al.  The impact of expectation of future negotiation interaction on bargaining processes and outcomes , 2010 .

[3]  Magy Seif El-Nasr,et al.  Exploring Improvisational Approaches to Social Knowledge Acquisition , 2019, AAMAS.

[4]  Stuart Diamond Getting More : How You Can Negotiate to Succeed in Work and Life , 2010 .

[5]  Nicole C. Krämer,et al.  Negative Feedback In Your Face: Examining the Effects of Proxemics and Gender on Learning , 2017, IVA.

[6]  David R. Traum,et al.  Multi-party, Multi-issue, Multi-strategy Negotiation for Multi-modal Virtual Agents , 2008, IVA.

[7]  Jonathan Gratch,et al.  BERT in Negotiations: Early Prediction of Buyer-Seller Negotiation Outcomes , 2020, ArXiv.

[8]  Sarit Kraus,et al.  Negotiating with bounded rational agents in environments with incomplete information using an automated agent , 2008, Artif. Intell..

[9]  Yuyu Xu,et al.  Towards modeling agent negotiators by analyzing human negotiation behavior , 2017, 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII).

[10]  Yann Dauphin,et al.  Deal or No Deal? End-to-End Learning of Negotiation Dialogues , 2017, EMNLP.

[11]  Hugo Liu,et al.  Makebelieve: using commonsense knowledge to generate stories , 2002, AAAI/IAAI.

[12]  Nicole C. Krämer,et al.  "Is It Just Me?": Evaluating Attribution of Negative Feedback as a Function of Virtual Instructor's Gender and Proxemics , 2017, AAMAS.

[13]  Yuandong Tian,et al.  Hierarchical Decision Making by Generating and Following Natural Language Instructions , 2019, NeurIPS.

[14]  Sarit Kraus,et al.  Can automated agents proficiently negotiate with humans? , 2010, CACM.

[15]  Sharon Marie Carnicke,et al.  Stanislavsky in Focus: An Acting Master for the Twenty-First Century , 1998 .

[16]  Sarit Kraus,et al.  Principles of Automated Negotiation , 2014 .

[17]  Jeanne M. Brett,et al.  The handbook of negotiation and culture , 2004 .

[18]  Manuel Blum,et al.  Verbosity: a game for collecting common-sense facts , 2006, CHI.

[19]  Roger B. Dannenberg,et al.  TagATune: A Game for Music and Sound Annotation , 2007, ISMIR.

[20]  M. Bazerman,et al.  Cognition and Rationality in Negotiation , 1991 .

[21]  A. Marty Getting to YES. Negotiating Agreement Without Giving In , 1983 .

[22]  Mark O. Riedl,et al.  Crowdsourcing Narrative Intelligence , 2012 .

[23]  Nicholas R. Jennings,et al.  An agenda-based framework for multi-issue negotiation , 2004, Artif. Intell..

[24]  Jonathan Gratch,et al.  Pinocchio : Answering Human-Agent Negotiation Questions through Realistic Agent Design , 2017 .

[25]  Jeff Orkin,et al.  Collective artificial intelligence: simulated role-playing from crowdsourced data , 2013 .

[26]  Sarit Kraus,et al.  Generating Content for Scenario-Based Serious-Games Using CrowdSourcing , 2014, AAAI.

[27]  Avi Rosenfeld,et al.  NegoChat: a chat-based negotiation agent , 2014, AAMAS.

[28]  Catholijn M. Jonker,et al.  An agent architecture for multi-attribute negotiation using incomplete preference information , 2007, Autonomous Agents and Multi-Agent Systems.

[29]  Zoran Popovic,et al.  Nanocrafter: Design and Evaluation of a DNA Nanotechnology Game , 2015, FDG.

[30]  Laura A. Dabbish,et al.  Labeling images with a computer game , 2004, AAAI Spring Symposium: Knowledge Collection from Volunteer Contributors.

[31]  Jonathan Gratch,et al.  An Expert-Model & Machine Learning Hybrid Approach to Predicting Human-Agent Negotiation Outcomes , 2019, IVA.

[32]  Erik T. Mueller,et al.  Open Mind Common Sense: Knowledge Acquisition from the General Public , 2002, OTM.

[33]  Jane Yung-jen Hsu,et al.  KissKissBan: a competitive human computation game for image annotation , 2010, HCOMP '09.

[34]  Jonathan Gratch,et al.  IAGO: Interactive Arbitration Guide Online , 2016, AAMAS 2016.

[35]  Magy Seif El-Nasr,et al.  Learning Generative Models of Social Interactions with Humans-in-the-Loop , 2018, 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA).

[36]  Norbert Reithinger,et al.  Modeling Negotiation Dialogs , 2000 .

[37]  Sarit Kraus,et al.  Facing the challenge of human-agent negotiations via effective general opponent modeling , 2009, AAMAS.

[38]  Jeffrey V. Nickerson,et al.  Cooks or cobblers?: crowd creativity through combination , 2011, CHI.