WebWOZ: a wizard of oz prototyping framework

Language Technology (LT) based applications become more popular as technology improves. Prototyping early in the design process is critical for the development of high quality applications. It is difficult, however, to do low-fidelity prototyping (e.g. paper prototyping) of applications based on LT. One technique that has been used for this kind of prototyping is Wizard of Oz (WOZ). However, this generally involves the development of one-off user and wizard interfaces. A tool that facilitates the flexible integration of LT components into WOZ experiments is desirable. In this paper we explore the requirements for such a tool, drawing from the literature and a first WOZ experiment in which different wizards were observed and their behaviour was analysed.

[1]  Jean-Luc Gauvain,et al.  The LIMSI ARISE system for train travel information , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[2]  James H. Martin,et al.  Speech and language processing: an introduction to natural language processing, computational linguistics, and speech recognition, 2nd Edition , 2000, Prentice Hall series in artificial intelligence.

[3]  K. Balci,et al.  A Multimodal 3D Healthcare Communication System , 2007, 2007 3DTV Conference.

[4]  Petra Geutner,et al.  Design of the VICO Spoken Dialogue System: Evaluation of User Expectations by Wizard-of-Oz Experiments , 2002, LREC.

[5]  Sebastian Stüker,et al.  The ISL 2007 English speech transcription system for european parliament speeches , 2007, INTERSPEECH.

[6]  Wolfgang Wahlster,et al.  Verbmobil: Foundations of Speech-to-Speech Translation , 2000, Artificial Intelligence.

[7]  Maxine Eskénazi,et al.  Doing research on a deployed spoken dialogue system: one year of let's go! experience , 2006, INTERSPEECH.

[8]  Markku. Turunen,et al.  Spoken and Multimodal Bus Timetable Systems: Design, Development and Evaluation , 2005 .

[9]  Arthur C. Graesser,et al.  Intelligent Tutoring Systems with Conversational Dialogue , 2001, AI Mag..

[10]  A S Neal,et al.  Laboratory vs. Field Experimentation in Human Factors—An Evaluation of an Experimental Self-Service Airline Ticket Vendor , 1971, Human factors.

[11]  Oli Mival,et al.  Wizard of Oz experiments for companions , 2009, BCS HCI.

[12]  Alexander I. Rudnicky,et al.  Olympus: an open-source framework for conversational spoken language interface research , 2007, HLT-NAACL 2007.

[13]  Sebastian Stüker,et al.  Open Domain Speech Recognition & Translation:Lectures and Speeches , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[14]  Shimei Pan,et al.  Predicting and Adapting to Poor Speech Recognition in a Spoken Dialogue System , 2000, AAAI/IAAI.

[15]  Yonghong Yan,et al.  Universal speech tools: the CSLU toolkit , 1998, ICSLP.

[16]  Sheelagh Carpendale,et al.  Sketching user experiences , 2012 .

[17]  Andrey Ronzhin,et al.  A Semi-automatic Wizard of Oz Technique for Let'sFly Spoken Dialogue System , 2008, TSD.

[18]  T. V. Raman,et al.  AxsJAX: a talking translation bot using google IM: bringing web-2.0 applications to life , 2008, W4A '08.

[19]  Markku Turunen,et al.  Jaspis - a framework for multilingual adaptive speech applications , 2000, INTERSPEECH.

[20]  Gregory A. Sanders,et al.  DARPA communicator: cross-system results for the 2001 evaluation , 2002, INTERSPEECH.

[21]  Joëlle Coutaz,et al.  A Wizard of Oz platform for the study of multimodal systems , 1993, INTERCHI Adjunct Proceedings.

[22]  Jaakko Hakulinen,et al.  Conducting a Wizard of Oz Experiment on a Ubiquitous Computing System Doorman , 2001 .

[23]  Harold L. Somers,et al.  Language Engineering and the Pathway to Healthcare: A User-Oriented View , 2006 .

[24]  Clayton Lewis,et al.  Designing for usability—key principles and what designers think , 1983, CHI '83.

[25]  Anoop K. Sinha,et al.  Suede: a Wizard of Oz prototyping tool for speech user interfaces , 2000, UIST '00.

[26]  Martin Rajman,et al.  Extending the Wizard of Oz Methodology for Language-enabled Multimodal Systems , 2006 .

[27]  Michael Paul,et al.  Overview of the IWSLT 2009 evaluation campaign , 2009, IWSLT.

[28]  David Coyle,et al.  Computers in talk-based mental health interventions , 2007, Interact. Comput..

[29]  Arne Jönsson,et al.  Wizard of Oz studies: why and how , 1993, IUI '93.

[30]  Pascale Fung,et al.  Multi-accent Chinese speech recognition , 2006, INTERSPEECH.