User-initiated Sub-dialogues in State-of-the-art Dialogue Systems

We test state of the art dialogue systems for their behaviour in response to user-initiated sub-dialogues, i.e. interactions where a system question is responded to with a question or request from the user, who thus initiates a sub-dialogue. We look at sub-dialogues both within a single app (where the sub-dialogue concerns another topic in the original domain) and across apps (where the sub-dialogue concerns a different domain). The overall conclusion of the tests is that none of the systems can be said to deal appropriately with user-initiated sub-dialogues.

[1]  Jonathan Ginzburg,et al.  A corpus-based taxonomy of question responses , 2013, IWCS.

[2]  Christian A. Müller,et al.  Development of Speech-Based In-Car HMI Concepts for Information Exchange Internet Apps , 2012, Natural Interaction with Robots, Knowbots and Smartphones, Putting Spoken Dialog Systems into Practice.

[3]  Marilyn A. Walker,et al.  PARADISE: A Framework for Evaluating Spoken Dialogue Agents , 1997, ACL.