Spoken Dialogue Interfaces: Integrating Usability

Usability is a fundamental requirement for natural language interfaces. Usability evaluation reflects the impact of the interface and the acceptance from the users. This work examines the potential of usability evaluation in terms of issues and methodologies for spoken dialogue interfaces along with the appropriate designer-needs analysis. It unfolds the perspective to the usability integration in the spoken language interface design lifecycle and provides a framework description for creating and testing usable content and applications for conversational interfaces. Main concerns include the problem identification of design issues for usability design and evaluation, the use of customer experience for the design of voice interfaces and dialogue, and the problems that arise from real-life deployment. Moreover it presents a real-life paradigm of a hands-on approach for applying usability methodologies in a spoken dialogue application environment to compare against a DTMF approach. Finally, the scope and interpretation of results from both the designer and the user standpoint of usability evaluation are discussed.

[1]  Niels Ole Bernsen,et al.  Designing Interactive Speech Systems , 1998, Springer London.

[2]  Marilyn A. Walker,et al.  From novice to expert: the effect of tutorials on user expertise with spoken dialogue systems , 1998, ICSLP.

[3]  Melita Hajdinjak,et al.  The PARADISE Evaluation Framework: Issues and Findings , 2006, Computational Linguistics.

[4]  Fred Stentiford,et al.  Identifying usability attributes of automated telephone services , 1993, EUROSPEECH.

[5]  Fred Stentiford,et al.  Identifying salient usability attributes for automated telephone services , 1994, ICSLP.

[6]  Marilyn A. Walker,et al.  Evaluating spoken dialogue agents with PARADISE: Two case studies , 1998, Comput. Speech Lang..

[7]  Laila Dybkjær,et al.  Usability Evaluation in Spoken Language Dialogue Systems , 2001, ACL 2001.

[8]  Austin Henderson,et al.  Interaction design: beyond human-computer interaction , 2002, UBIQ.

[9]  Niels Ole Bernsen,et al.  Usability Issues in Spoken Language Dialogue Systems , 2001 .

[10]  Niels Ole Bernsen,et al.  Building usable spoken dialogue systems : Some approaches , 2004 .

[11]  Dana Chisnell,et al.  Handbook of Usability Testing , 2009 .

[12]  Niels Ole Bernsen,et al.  Evaluation and usability of multimodal spoken language dialogue systems , 2004, Speech Commun..

[13]  Niels Ole Bernsen,et al.  Usability issues in spoken dialogue systems , 2000, Natural Language Engineering.

[14]  Randy Allen Harris.  Book excerpt: voice interaction design , 2005, UBIQ.

[15]  Niels Ole Bernsen,et al.  Designing interactive speech systems - from first ideas to user testing , 1998 .

[16]  Debora Shaw,et al.  Handbook of usability testing: How to plan, design, and conduct effective tests , 1996 .

[17]  Diamantino Freitas,et al.  Speech technologies for blind and low vision persons , 2008 .

[18]  D. Litman,et al.  Evaluating Spoken Language Systems , 2007 .

[19]  Niels Ole Bernsen,et al.  A Methodology for Evaluating Spoken Language Dialogue Systems and Their Components , 2000, LREC.

[20]  Luís Carriço,et al.  Audio Interfaces for Improved Accessibility , 2008 .

[21]  Niels Ole Bernsen,et al.  Usability Evaluation of Multimodal and Domain-Oriented Spoken Language Dialogue Systems , 2004, LREC.

[22]  J. V. Kuppevelt,et al.  Advances in natural multimodal dialogue systems , 2005 .

[23]  Markku Turunen,et al.  Evaluation of a spoken dialogue system with usability tests and long-term pilot studies: similarities and differences , 2006, INTERSPEECH.

[24]  Lars Bo Larsen,et al.  Issues in the evaluation of spoken dialogue systems using objective and subjective measures , 2003, 2003 IEEE Workshop on Automatic Speech Recognition and Understanding (IEEE Cat. No.03EX721).

[25]  Shimei Pan,et al.  Designing and Evaluating an Adaptive Spoken Dialogue System , 2002, User Modeling and User-Adapted Interaction.

[26]  Michael F. McTear,et al.  Book Review , 2005, Computational Linguistics.

[27]  Klaus Fellbaum,et al.  Principles of electronic speech processing with applications for people with disabilities , 2008 .

[28]  Jennifer Balogh,et al.  Voice User Interface Design , 2004 .

[29]  Sebastian Möller,et al.  Memo: towards automatic usability evaluation of spoken dialogue services by user error simulations , 2006, INTERSPEECH.

[30]  Y. Rogers,et al.  Interaction Design , 2002 .

[31]  Markku Turunen,et al.  Subjective evaluation of spoken dialogue systems using SER VQUAL method , 2004, INTERSPEECH.

[32]  Marilyn A. Walker,et al.  Towards developing general models of usability with PARADISE , 2000, Natural Language Engineering.

[33]  Randy Allen Harris,et al.  Voice Interaction Design: Crafting the New Conversational Speech Systems , 2004 .