Managing Casual Spoken Dialogue Using Flexible Schemas , Pattern Transduction Trees , and Gist Clauses

We describe an approach to managing casual spoken dialogues in a virtual human dialogue partner, designed to enable the user to practice basic dialogue skills. We use script-like schemas to loosely guide the dialogue, where the steps of a schema are specified in a declarative language that allows for both explicit and abstract description of speech acts. The steps become particularized and can be added to or omitted as the dialogue proceeds. Internally, the dialogue manager casts its own contributions and those of the user as gist clauses – simple, explicit, context-independent versions of what was actually said. Both gist clause computation, and generation of responses, is enabled by hierarchical pattern transduction. These methods show promise in the implementations we have so far developed.

[1]  R. Schank,et al.  Scripts, plans, and knowledge , 1975, IJCAI 1975.

[2]  James F. Allen,et al.  TRIPS: An Integrated Intelligent Problem-Solving Assistant , 1998, AAAI/IAAI.

[3]  Justine Cassell,et al.  Playing with virtual peers: bootstrapping contingent discourse in children with autism , 2008, ICLS.

[4]  Patrick Kenny,et al.  SimCoach: an intelligent virtual human system for providing healthcare information and support , 2011 .

[5]  Marc Cavazza,et al.  How Was Your Day? , 2010 .

[6]  Marc Cavazza,et al.  How was your day?: a companion ECA , 2010, AAMAS.

[7]  Julia Hirschberg,et al.  Turn-taking cues in task-oriented dialogue , 2011, Comput. Speech Lang..

[8]  Maxine Eskénazi,et al.  Optimizing the turn-taking behavior of task-oriented spoken dialog systems , 2012, TSLP.

[9]  David DeVault,et al.  FLoReS: A Forward Looking, Reward Seeking, Dialogue Manager , 2012, Natural Interaction with Robots, Knowbots and Smartphones, Putting Spoken Dialog Systems into Practice.

[10]  Bilge Mutlu,et al.  MACH: my automated conversation coach , 2013, UbiComp.

[11]  Stefan Kopp,et al.  Virtual Agents as Daily Assistants for Elderly or Cognitively Impaired People - Studies on Acceptance and Interaction Feasibility , 2013, IVA.

[12]  Catherine Pelachaud,et al.  The TARDIS Framework: Intelligent Virtual Agents for Social Coaching in Job Interviews , 2013, Advances in Computer Entertainment.

[13]  Sara Bernardini,et al.  ECHOES: An intelligent serious game for fostering social communication in children with autism , 2014, Inf. Sci..

[14]  Kallirroi Georgila,et al.  SimSensei kiosk: a virtual human interviewer for healthcare decision support , 2014, AAMAS.

[15]  Gabriel Skantze,et al.  Data-driven models for timing feedback responses in a Map Task dialogue system , 2014, Comput. Speech Lang..

[16]  Tomoki Toda,et al.  Automated Social Skills Trainer , 2015, IUI.

[17]  Li Jin,et al.  LISSA — Live Interactive Social Skill Assistance , 2015, 2015 International Conference on Affective Computing and Intelligent Interaction (ACII).

[18]  Sungjin Lee,et al.  Task Lineages: Dialog State Tracking for Flexible Interaction , 2016, SIGDIAL Conference.

[19]  Ran Zhao,et al.  Socially-Aware Animated Intelligent Personal Assistant Agent , 2016, SIGDIAL Conference.

[20]  Lenhart K. Schubert,et al.  The LISSA Virtual Human and ASD Teens: An Overview of Initial Experiments , 2016, IVA.

[21]  Maxine Eskénazi,et al.  Towards End-to-End Learning for Dialog State Tracking and Management using Deep Reinforcement Learning , 2016, SIGDIAL Conference.