Web Engineered Applications for Evolving Organizations : Emerging Knowledge

This chapter presents the state-of-the-art in usability issues and methodologies for VoiceWeb interfaces. It undertakes a theoretical perspective to the usability methodology and provides a framework description for creating and testing usable content and applications for conversational interfaces. The methodologies and their uses are discussed as well as certain technical issues that are of specific importance for each type of system. Moreover, it discusses the hands-on approaches for applying usability methodologies in a spoken dialogue web application environment, including methodological and design issues, resource management, implementation using existing technologies for usability evaluation in several stages of the design and deployment. Finally, the challenging usability issues and parameters of the emerging advanced speech-enabled web interfaces are presented. DOI: 10.4018/978-1-60960-523-0.ch019

[1]  Marilyn A. Walker,et al.  From novice to expert: the effect of tutorials on user expertise with spoken dialogue systems , 1998, ICSLP.

[2]  Klaus Fellbaum,et al.  Principles of electronic speech processing with applications for people with disabilities , 2008 .

[3]  Kwan Min Lee,et al.  Speech Versus Touch: A Comparative Study of the Use of Speech and DTMF Keypad for Navigation , 2005, Int. J. Hum. Comput. Interact..

[4]  Shimei Pan,et al.  Integrating Language Generation with Speech Synthesis in a Concept to Speech System , 1997 .

[5]  Lars Bo Larsen,et al.  On the Usability of Spoken Dialogue Systems , 2003 .

[6]  Sebastian Möller,et al.  Memo: towards automatic usability evaluation of spoken dialogue services by user error simulations , 2006, INTERSPEECH.

[7]  Matthias Peissner,et al.  Voice User Interface Design , 2004, UP.

[8]  Constantine Stephanidis,et al.  User Interfaces for All: Concepts, Methods, and Tools , 2009 .

[9]  Niels Ole Bernsen,et al.  Usability Issues in Spoken Language Dialogue Systems , 2001 .

[10]  Niels Ole Bernsen,et al.  Building usable spoken dialogue systems : Some approaches , 2004 .

[11]  Georgios Kouroupetroglou,et al.  Spoken Dialogue Interfaces: Integrating Usability , 2009, USAB.

[12]  Cristina Delogu,et al.  Usability evaluation of IVR systems with DTMF and ASR , 1998, ICSLP.

[13]  Georgios Kouroupetroglou,et al.  Integrating Usability Engineering for Designing the Web Experience: Methodologies and Principles , 2010 .

[14]  Daniel B. Horn,et al.  Patterns of entry and correction in large vocabulary continuous speech recognition systems , 1999, CHI '99.

[15]  Simon King,et al.  IEEE Workshop on automatic speech recognition and understanding , 2009 .

[16]  Constantine Stephanidis,et al.  The Universal Access Handbook , 2009 .

[17]  Niels Ole Bernsen,et al.  Designing interactive speech systems - from first ideas to user testing , 1998 .

[18]  Gina-Anne Levow,et al.  Designing SpeechActs: issues in speech user interfaces , 1995, CHI '95.

[19]  Markku Turunen,et al.  Subjective evaluation of spoken dialogue systems using SER VQUAL method , 2004, INTERSPEECH.

[20]  Shimei Pan,et al.  Designing and Evaluating an Adaptive Spoken Dialogue System , 2002, User Modeling and User-Adapted Interaction.

[21]  Georgios Kouroupetroglou,et al.  Usability Methodologies for Real-Life Voice User Interfaces , 2009, Int. J. Inf. Technol. Web Eng..

[22]  Susan Weinschenk,et al.  Designing effective speech interfaces , 2000 .

[23]  Randy Allen Harris,et al.  Voice Interaction Design: Crafting the New Conversational Speech Systems , 2004 .

[24]  Wolfgang Wahlster,et al.  SmartKom: Foundations of Multimodal Dialogue Systems , 2006, SmartKom.

[25]  Nigel Ward,et al.  A study in responsiveness in spoken dialog , 2003, Int. J. Hum. Comput. Stud..

[26]  Jeffrey Rubin,et al.  Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests , 1994 .

[27]  Markku Turunen,et al.  Evaluation of a spoken dialogue system with usability tests and long-term pilot studies: similarities and differences , 2006, INTERSPEECH.

[28]  Laila Dybkjær,et al.  Recent trends in discourse and dialogue , 2008 .

[29]  Sebastian Möller,et al.  Predicting the quality and usability of spoken dialogue services , 2008, Speech Commun..

[30]  Niels Ole Bernsen,et al.  Evaluation and usability of multimodal spoken language dialogue systems , 2004, Speech Commun..

[31]  Laila Dybkjær,et al.  Usability Evaluation in Spoken Language Dialogue Systems , 2001, ACL 2001.

[32]  Marilyn A. Walker,et al.  Towards developing general models of usability with PARADISE , 2000, Natural Language Engineering.

[33]  D. Litman,et al.  Evaluating Spoken Language Systems , 2007 .

[34]  Elsevier Sdol,et al.  Computer Speech & Language , 2009 .

[35]  Wilbert O. Galitz,et al.  The Essential Guide to User Interface Design , 2002 .

[36]  Diamantino Freitas,et al.  Speech technologies for blind and low vision persons , 2008 .

[37]  Georgios Kouroupetroglou,et al.  An Open Platform for Conducting Psycho-Acoustic Experiments in the Auditory Representation of Web Documents , 2004 .

[38]  Lars Bo Larsen,et al.  Issues in the evaluation of spoken dialogue systems using objective and subjective measures , 2003, 2003 IEEE Workshop on Automatic Speech Recognition and Understanding (IEEE Cat. No.03EX721).

[39]  Marilyn A. Walker,et al.  THE UTILITY OF ELAPSED TIME AS A USABILITY METRIC FOR SPOKEN DIALOGUE SYSTEMS , 2007 .

[40]  Georgios Kouroupetroglou,et al.  Usability Methodologies for Spoken Dialogue Web Interfaces , 2010 .

[41]  Georgios Kouroupetroglou,et al.  Acoustic Rendering of Data Tables Using Earcons and Prosody for Document Accessibility , 2009, HCI.

[42]  Marilyn A. Walker,et al.  Evaluating spoken dialogue agents with PARADISE: Two case studies , 1998, Comput. Speech Lang..

[43]  Hua Ai,et al.  Comparing Spoken Dialog Corpora Collected with Recruited Subjects versus Real Users , 2007, SIGDIAL.

[44]  Luís Carriço,et al.  Audio Interfaces for Improved Accessibility , 2008 .

[45]  Alex Acero,et al.  Spoken Language Processing: A Guide to Theory, Algorithm and System Development , 2001 .

[46]  David T. Barnard Evaluation of Text and Speech Systems , 2013 .

[47]  Mark Tatham,et al.  Developments in Speech Synthesis , 2004 .

[48]  Georgios Kouroupetroglou,et al.  Auditory universal accessibility of data tables using naturally derived prosody specification , 2010, Universal Access in the Information Society.

[49]  Marilyn A. Walker,et al.  Evaluating Response Strategies in a Web-Based Spoken Dialogue Agent , 1998, ACL.

[50]  Melita Hajdinjak,et al.  The PARADISE Evaluation Framework: Issues and Findings , 2006, Computational Linguistics.

[51]  Austin Henderson,et al.  Interaction design: beyond human-computer interaction , 2002, UBIQ.

[52]  Niels Ole Bernsen,et al.  A Methodology for Evaluating Spoken Language Dialogue Systems and Their Components , 2000, LREC.