Generation of Multi-Device Adaptive MultiModal Web Applications

This paper presents a set of tools to support multimodal adaptive Web applications. The contributions include a novel solution for generating multimodal interactive applications, which can be executed in any browser-enabled device; and run-time support for obtaining multimodal adaptations at various granularity levels, which can be specified through a language for adaptation rules. The architecture is able to exploit model-based user interface descriptions and adaptation rules in order to achieve adaptive behaviour that can be triggered by dynamic changes in the context of use. We also report on an example application and a user test concerning adaptation rules changing dynamically its multimodality.

[1]  Fabio Paternò,et al.  Adaptive User Interfaces for Smart Environments with the Support of Model-Based Languages , 2012, AmI.

[2]  Moira C. Norrie,et al.  W3touch: metrics-based web page adaptation for touch , 2013, CHI.

[3]  Fabio Paternò,et al.  MARIA: A universal, declarative, multiple abstraction-level language for service-oriented applications in ubiquitous environments , 2009, TCHI.

[4]  Benjamin Michotte,et al.  A transformational approach for multimodal web user interfaces based on UsiXML , 2005, ICMI '05.

[5]  Philippe Lalanda,et al.  Autonomic management of multimodal interaction: DynaMo in action , 2012, EICS '12.

[6]  Fabio Paternò,et al.  Supporting Multimodality in Service-Oriented Model-Based Development Environments , 2010, HCSE.

[7]  Philippe A. Palanque,et al.  Human-Computer Interaction – INTERACT 2007 , 2007, Lecture Notes in Computer Science.

[8]  Jean-Sébastien Sottet,et al.  Model-Driven Adaptation for Plastic User Interfaces , 2007, INTERACT.

[9]  Matthias Peissner,et al.  MyUI: generating accessible user interfaces from multimodal design patterns , 2012, EICS '12.

[10]  Dominik Ertl.  Semi-automatic multimodal user interface generation , 2009, EICS '09.

[11]  Ann Blandford,et al.  Four easy pieces for assessing the usability of multimodal interaction: the CARE properties , 1995, INTERACT.

[12]  Ombretta Gaggi,et al.  Context-aware design of adaptable multimodal documents , 2004, IEEE Sixth International Symposium on Multimedia Software Engineering.

[13]  Karin Coninx,et al.  Facilitating Adaptation in Virtual Environments Using a Context-Aware Model-Based Design Process , 2009, TAMODIA.

[14]  Luís Carriço,et al.  A conceptual framework for developing adaptive multimodal applications , 2006, IUI '06.