Discourse Structure and Performance Analysis: Beyond the Correlation

This paper is part of our broader investigation into the utility of discourse structure for performance analysis. In our previous work, we showed that several interaction parameters that use discourse structure predict our performance metric. Here, we take a step forward and show that these correlations are not only a surface relationship. We show that redesigning the system in light of an interpretation of a correlation has a positive impact.

[1]  Marilyn A. Walker,et al.  Quantitative and Qualitative Evaluation of Darpa Communicator Spoken Dialogue Systems , 2001, ACL.

[2]  Carolyn Penstein Rosé,et al.  Spoken Versus Typed Human and Computer Dialogue Tutoring , 2006, Int. J. Artif. Intell. Educ..

[3]  Hui Ye,et al.  The Hidden Information State Approach to Dialog Management , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[4]  Sebastian Möller,et al.  Parameters for Quantifying the Interaction with Spoken Dialogue Telephone Services , 2005, SIGDIAL.

[5]  Eric Horvitz,et al.  Optimizing Automated Call Routing by Integrating Spoken Dialog Models with Queuing Models , 2004, NAACL.

[6]  Kristen N. Moreno,et al.  AutoTutor Improves Deep Learning of Computer Literacy : Is it the Dialog or the Talking Head ? , 2004 .

[7]  Sebastian Möller,et al.  A Framework for Model-based Evaluation of Spoken Dialog Systems , 2008, SIGDIAL Workshop.

[8]  Roberto Pieraccini,et al.  A stochastic model of human-machine interaction for learning dialog strategies , 2000, IEEE Trans. Speech Audio Process..

[9]  Diane J. Litman,et al.  Exploiting Discourse Structure for Spoken Dialogue Performance Analysis , 2006, EMNLP.

[10]  Barbara J. Grosz,et al.  THE STRUCTURE OF DISCOURSE , 2007 .

[11]  Marilyn A. Walker,et al.  Towards developing general models of usability with PARADISE , 2000, Natural Language Engineering.

[12]  S. Singh,et al.  Optimizing Dialogue Management with Reinforcement Learning: Experiments with the NJFun System , 2011, J. Artif. Intell. Res..

[13]  Alexander I. Rudnicky,et al.  Error awareness and recovery in conversational spoken language interfaces , 2007 .

[14]  Shimei Pan,et al.  Designing and Evaluating an Adaptive Spoken Dialogue System , 2002, User Modeling and User-Adapted Interaction.

[15]  Roberto Pieraccini,et al.  VALUE-BASED OPTIMAL DECISION FOR DIALOG SYSTEMS , 2006, 2006 IEEE Spoken Language Technology Workshop.

[16]  Diane J. Litman,et al.  Applications of discourse structure for spoken dialogue systems , 2008 .

[17]  L SidnerCandace,et al.  Attention, intentions, and the structure of discourse , 1986 .

[18]  Sandra Katz,et al.  Going Beyond the Problem Given: How Human Tutors Use Post-Solution Discussions to Support Transfer , 2003, Int. J. Artif. Intell. Educ..

[19]  Maxine Eskénazi,et al.  Optimizing Endpointing Thresholds using Dialogue Features in a Spoken Dialogue System , 2008, SIGDIAL Workshop.

[20]  Diane J. Litman,et al.  The Utility of a Graphical Representation of Discourse Structure in Spoken Dialogue Systems , 2007, ACL.

[21]  Arthur C. Graesser,et al.  When Are Tutorial Dialogues More Effective Than Reading? , 2007, Cogn. Sci..