InproTK in Action: Open-Source Software for Building German-Speaking Incremental Spoken Dialogue Systems

We present InproTK, a toolkit for building incremental spoken dialogue systems. Incremental spoken dialogue systems (systems that may react while the users utterance is ongoing) are a fairly recent research topic and allow for exciting new features. Even though toolkits exist that help in building conventional dialogue systems, InproTK offers both a tested architecture for building incremental SDSs as well as many of the building blocks necessary when building such systems. With InproTK a researcher can avoid many of the technical difficulties, which hopefully further fosters research in this area.

[1]  David Schlangen,et al.  Modelling Sub-Utterance Phenomena in Spoken Dialogue Systems , 2010 .

[2]  Marilyn A. Walker,et al.  The AT&t-DARPA communicator mixed-initiative spoken dialog system , 2000, INTERSPEECH.

[3]  James F. Allen,et al.  Incremental Dialogue System Faster than and Preferred to its Nonincremental Counterpart , 2007 .

[4]  Maxine Eskénazi,et al.  A Finite-State Turn-Taking Model for Spoken Dialog Systems , 2009, NAACL.

[5]  Alexander I. Rudnicky,et al.  Creating natural dialogs in the carnegie mellon communicator system , 1999, EUROSPEECH.

[6]  Marc Schröder,et al.  The German Text-to-Speech Synthesis System MARY: A Tool for Research, Development and Teaching , 2003, Int. J. Speech Technol..

[7]  Maxine Eskénazi,et al.  LET's GO: improving spoken dialog systems for the elderly and non-natives , 2003, INTERSPEECH.

[8]  Oliver Lemon,et al.  DIPPER: Description and Formalisation of an Information-State Update Dialogue System Architecture , 2003, SIGDIAL Workshop.

[9]  David Schlangen,et al.  Assessing and Improving the Performance of Speech Recognition for Incremental Systems , 2009, NAACL.

[10]  Paul Lamere,et al.  Sphinx-4: a flexible open source framework for speech recognition , 2004 .

[11]  David Schlangen.  Incremental Dialogue Processing , 2011 .

[12]  David Schlangen,et al.  Collaborating on Utterances with a Spoken Dialogue System Using an ISU-based Approach to Incremental Dialogue Management , 2010, SIGDIAL Conference.

[14]  Alexander I. Rudnicky,et al.  The RavenClaw dialog management framework: Architecture and systems , 2009, Comput. Speech Lang..

[15]  Staffan Larsson,et al.  Information state and dialogue management in the TRINDI dialogue move engine toolkit , 2000, Natural Language Engineering.

[16]  David Schlangen,et al.  TELIDA: A Package for Manipulation and Visualization of Timed Linguistic Data , 2009, SIGDIAL Conference.

[17]  D. B. Davis,et al.  Sun Microsystems Inc. , 1993 .

[18]  J. Ginzburg.  Interrogatives: questions, facts and dialogue , 1996 .