Generating speech user interfaces from interaction acts

We have applied interaction acts, an abstract user-service interaction specification, to speech user interfaces to investigate how well it lends itself to a new type of user interface. We used interaction acts to generate VoiceXML-based speech user interface, and identified two main issues connected to the differences between graphical user interfaces and speech user interfaces. The first issue concerns the structure of the user interface. Generating speech user interfaces and GUIs from the same underlying structure easily results in a too hierarchical and difficult to use speech user interface. The second issue is user input. Interpreting spoken user input is fundamentally different from user input in GUIs. We have shown that it is possible to generate speech user interfaces based on. A small user study supports the results.

[1]  Alexander I. Rudnicky,et al.  Universal speech interfaces , 2001, INTR.

[2]  Jeffrey Nichols,et al.  Generating remote control interfaces for complex appliances , 2002, UIST '02.

[3]  Dan R. Olsen,et al.  MIKE: The Menu Interaction Kontrol Environment , 1986, ACM Trans. Graph..

[4]  Stina Nylander,et al.  The Ubiquitous Interactor - Device Independent Access to Mobile Services , 2004, CADUI.

[5]  Brad A. Myers,et al.  Past, Present and Future of User Interface Software Tools , 2000, TCHI.

[6]  Gaetano Borriello,et al.  Next century challenges: data-centric networking for invisible computing: the Portolano project at the University of Washington , 1999, MobiCom.

[7]  Dan R. Olsen,et al.  Cross-modal interaction using XWeb , 2000, UIST '00.

[8]  James Clark,et al.  XSL Transformations (XSLT) Version 1.0 , 1999 .

[9]  Charles Wiecha,et al.  ITS: a tool for rapidly developing interactive applications , 1990, TOIS.

[10]  James Beck,et al.  Challenges: an application model for pervasive computing , 2000, MobiCom '00.

[11]  Annika Waern,et al.  Personal service environments--openness and user control in user-service interaction , 2001 .

[12]  Nicole Yankelovich,et al.  Designing speech user interfaces , 1999, CHI Extended Abstracts.

[13]  Stina Nylander,et al.  Ubiquitous service access through adapted user interfaces on multiple devices , 2004, Personal and Ubiquitous Computing.

[14]  Krzysztof Z. Gajos,et al.  SUPPLE: automatically generating user interfaces , 2004, IUI '04.

[15]  Stina Nylander,et al.  Mobile access to real-time information—the case of autonomous stock brokering , 2003, Personal and Ubiquitous Computing.

[16]  Bernhard Suhm,et al.  Towards best practices for speech user interface design , 2003, INTERSPEECH.