Multimodal user interfaces for context-aware mobile applications

This paper introduces a generic architecture that enables the development and execution of mobile multimodal applications proposed within the EU IST-511607 project MobiLife. Mobi Life aims at exploiting the synergetic use of multimodal user interface technology and contextual information processing, with the ultimate goal that the two together can provide a beyond-the-state-of-the-art user experience. And this led to an integrated concept, components of the underlying architecture are described in detail and the interfaces towards the application back-end as well as towards context aware resources are discussed. The paper also positions the current work against existing standardisation efforts and it pinpoints technologies required to support the implementation of a device and modality function within the MobiLife architecture

[1]  Stephan Steglich,et al.  A Markup Language for Generic User Interaction , 2004, International Conference on Internet Computing.

[2]  Sharon L. Oviatt,et al.  When do we interact multimodally?: cognitive load and multimodal communication patterns , 2004, ICMI '04.

[3]  Olaf Drögehorn,et al.  Contextual Personalization of a Mobile Multimodal Application , 2005, International Conference on Internet Computing.

[4]  Stephan Steglich,et al.  Basic building blocks for mobile service provisioning , 2005, Proceedings Autonomous Decentralized Systems, 2005. ISADS 2005..

[5]  Radha Jagadeesan,et al.  Sisl: Several Interfaces, Single Logic , 2000, Int. J. Speech Technol..