Providing integrated toolkit-level support for ambiguity in recognition-based interfaces

Recognition technologies are being used extensively in both the commercial and research worlds. But recognizers are still error-prone, and this results in performance problems and brittle dialogues. These problems are a barrier to acceptance and usefulness of recognition systems. Better interfaces to recognition systems, which can help to reduce the burden of recognition errors, are difficult to build because of lack of knowledge about the ambiguity inherent in recognition. We have extended a user interface toolkit in order to model and to provide structured support for ambiguity at the input event level [7]. This makes it possible to build re-usable interface components for resolving ambiguity and dealing with recognition errors. These interfaces can help to reduce the negative effects of recognition errors. By providing these components at a toolkit level, we make it easier for application writers to provide good support for error handling. And we can explore new types of interfaces for resolving a more varied range of ambiguity.

[1]  James A. Landay,et al.  Implications for a gesture design tool , 1999, CHI '99.

[2]  Alexander H. Waibel,et al.  Model-based and empirical evaluation of multimodal interactive error correction , 1999, CHI '99.

[3]  Takeo Igarashi,et al.  A negotiation architecture for fluid documents , 1998, UIST '98.

[4]  Scott E. Hudson,et al.  Supporting dynamic downloadable appearances in an extensible user interface toolkit , 1997, UIST '97.

[5]  James A. Landay,et al.  Extending an existing user interface toolkit to support gesture recognition , 1993, INTERCHI Adjunct Proceedings.

[6]  Scott E. Hudson,et al.  Probabilistic state machines: dialog management for inputs with uncertainty , 1992, UIST '92.

[7]  Gregory D. Abowd,et al.  Interacting with Multiple Alternatives Generated by Recognition Technologies , 1999 .

[8]  Mary Zajicek,et al.  An investigation into the use of error recovery dialogues in a user interface management system for speech recognition , 1990, INTERACT.

[9]  Gregory D. Abowd,et al.  Providing integrated toolkit-level support for ambiguity in recognition-based interfaces , 2000, CHI.

[10]  Sharon L. Oviatt,et al.  Confirmation in Multimodal Systems , 1998, ACL.

[11]  David Goldberg,et al.  Stylus user interfaces for manipulating text , 1991, UIST '91.

[12]  James A. Landay,et al.  Interactive sketching for the early stages of user interface design , 1995, CHI '95.

[13]  Alan F. Newell,et al.  Prediction and conversational momentum in an augmentative communication system , 1992, CACM.

[14]  Brad A. Myers,et al.  Reusable hierarchical command objects , 1996, CHI.

[15]  Gregory D. Abowd,et al.  The context toolkit: aiding the development of context-enabled applications , 1999, CHI '99.

[16]  Eric Horvitz,et al.  Principles of mixed-initiative user interfaces , 1999, CHI '99.

[17]  Joëlle Coutaz,et al.  A generic platform for addressing the multimodal challenge , 1995, CHI '95.

[18]  Satoshi Matsuoka,et al.  Interactive beautification: a technique for rapid geometric design , 2006, SIGGRAPH Courses.

[19]  Gregory D. Abowd,et al.  Error Correction Techniques for Handwriting, Speech, and Other Ambiguous or Error Prone Systems , 1999 .

[20]  William A. Ainsworth,et al.  Feedback Strategies for Error Correction in Speech Recognition Systems , 1992, Int. J. Man Mach. Stud..

[21]  Chris Schmandt,et al.  Putting people first: specifying proper names in speech interfaces , 1994, UIST '94.

[22]  Mark Green,et al.  A survey of three dialogue models , 1986, TOGS.