Learning Culture-Specific Dialogue Models from Non Culture-Specific Data

We build culture-specific dialogue policies of virtual humans for negotiation and in particular for argumentation and persuasion. In order to do that we use a corpus of non-culture specific dialogues and we build simulated users (SUs), i.e. models that simulate the behavior of real users. Then using these SUs and Reinforcement Learning (RL) we learn negotiation dialogue policies. Furthermore, we use research findings about specific cultures in order to tweak both the SUs and the reward functions used in RL towards a particular culture. We evaluate the learned policies in a simulation setting. Our results are consistent with our SU manipulations and RL reward functions.

[1]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[2]  Gary Geunbae Lee,et al.  Hybrid Approach to User Intention Modeling for Dialog Simulation , 2009, ACL/IJCNLP.

[3]  Ramón López-Cózar,et al.  Testing the performance of spoken dialogue systems by means of an artificially simulated user , 2006, Artificial Intelligence Review.

[4]  Steven D. Seilheimer,et al.  Looking and Competing: Accountability and Visual Access in Integrative Bargaining , 1981 .

[5]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[6]  R. S. Zaharna Understanding cultural preferences of Arab communication patterns , 1995 .

[7]  Kallirroi Georgila,et al.  User simulation for spoken dialogue systems: learning and evaluation , 2006, INTERSPEECH.

[8]  Peter A. Heeman,et al.  Representing the Reinforcement Learning state in a negotiation dialogue , 2009, 2009 IEEE Workshop on Automatic Speech Recognition & Understanding.

[9]  David R. Traum,et al.  Models of Culture for Virtual Human Conversation , 2009, HCI.

[10]  S. Young,et al.  Scaling POMDPs for Spoken Dialog Management , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[11]  Candace L. Sidner,et al.  An Artificial Discourse Language for Collaborative Negotiation , 1994, AAAI.

[12]  Jeanne M. Brett,et al.  A Cultural Analysis of the Underlying Assumptions of Negotiation Theory , 2005 .

[13]  Michael English,et al.  Learning Mixed Initiative Dialog Strategies By Using Reinforcement Learning On Both Conversants , 2005, HLT.

[14]  D. G. Pruitt,et al.  Development of integrative solutions in bilateral negotiation. , 1975 .

[15]  Kallirroi Georgila,et al.  Learning Dialogue Strategies from Older and Younger Simulated Users , 2010, SIGDIAL Conference.