论文信息 - Enabling Vocal Interaction in a Web Portal Environment

Enabling Vocal Interaction in a Web Portal Environment

The growing request of innovative, multimodal interfaces for mobile users and the need of different navigation paradigms for impaired Internet users are promoting and driving nowadays research on multimodal interactions. In this paper we present our experiences in the integration of vocal components in a portal engine, namely Apache Jetspeed. First, we discuss the reasons why the integration of a full-featured portal brings significant advantages to the development of a vocal platform. Then, we describe two complementary approaches for enhancing portals with vocal capabilities, and we compare them under various standpoints. The first approach that we investigate is based on a server-side speech synthesizer, while the second relies on client-side technologies, X+V and the SALT markup languages. For each of these approaches we present some examples and we discuss advantages and drawbacks.

[1] Niels Ole Bernsen,et al. Evaluation and usability of multimodal spoken language dialogue systems , 2004, Speech Commun..

[2] Vladimir Pavlovic,et al. Toward multimodal human-computer interface , 1998, Proc. IEEE.

[3] Yacine Bellik,et al. Multimodal text editor interface including speech for the blind , 1997, Speech Commun..

[4] Agostino Poggi,et al. A Transcoding Based Approach for Multi-Device Portal Contents Adaptation , 2004, ICWI.

[5] Cynthia LeRouge,et al. Developing multimodal intelligent affective interfaces for tele-home health care , 2003, Int. J. Hum. Comput. Stud..

[6] Wolfgang Wahlster,et al. SmartKom: Towards Multimodal Dialogues with Anthropomorphic Interface Agents , 2001 .

[7] Marilyn A. Walker,et al. Generation and evaluation of user tailored responses in multimodal dialogue , 2004 .

[8] Philip R. Cohen. The role of natural language in a multimodal interface , 1992, UIST '92.

[9] Sangkyu Park,et al. Multimodal user interfaces in the Open Agent Architecture , 1997, IUI '97.

[10] Chris Baber,et al. Using critical path analysis to model multimodal human-computer interaction , 2001, Int. J. Hum. Comput. Stud..