Adapting Multimodal Fission to User's Abilities

New ways of communication are now possible thanks to adaptive multimodal systems, enabling the improvement in accessibility of ICT applications to all users. We are developing a project which combines TV with a multimodal system in order to overcome accessibility and usability problems by impaired users. This paper is focused on the fission of outputs, and how the presentations of applications running on GUIDE's environment are adapted to the user's capabilities.

[1]  Guy Lapalme,et al.  Intentions in the Coordinated Generation of Graphics and Text from Tabular Data , 2000, Knowledge and Information Systems.

[2]  Denis Lalanne,et al.  Human Machine Interaction, Research Results of the MMI Program , 2009, Human Machine Interaction.

[3]  Thomas Rist,et al.  Employing AI Methods to Control the Behavior of Animated Interface Agents , 1999, Appl. Artif. Intell..

[4]  Sharon L. Oviatt,et al.  Perceptual user interfaces: multimodal interfaces that process what comes naturally , 2000, CACM.

[5]  James C. Lester,et al.  Animated Pedagogical Agents: Face-to-Face Interaction in Interactive Learning Environments , 2000 .

[6]  Philip R. Cohen,et al.  MULTIMODAL INTERFACES THAT PROCESS WHAT COMES NATURALLY , 2000 .

[7]  Alexander H. Waibel,et al.  Multimodal interfaces , 1996, Artificial Intelligence Review.

[8]  Ann Blandford,et al.  Four easy pieces for assessing the usability of multimodal interaction: the CARE properties , 1995, INTERACT.

[9]  Yacine Bellik,et al.  Multimodal output specification / simulation platform , 2005, ICMI '05.

[10]  Ingrid Zukerman,et al.  A mechanism for Multimodal Presentation Planning Based on Agent Cooperation and Negotiation , 1997, Hum. Comput. Interact..

[11]  Ingrid Zukerman,et al.  A mechanism for multimodal presentation planning based on agent cooperation and negotiation , 1997 .

[12]  Wolfgang Wahlster,et al.  Plan-Based Integration of Natural Language and Graphics Generation , 1993, Artif. Intell..

[13]  John A. Bateman,et al.  Towards Constructive Text, Diagram, and Layout Generation for Information Presentation , 2001, Computational Linguistics.

[14]  Steven K. Feiner,et al.  Automating the generation of coordinated multimedia explanations , 1991, Computer.

[15]  Multimodal interaction , communication and navigation guidelines , 2022 .

[16]  Thomas Rist,et al.  Combining Alternatives in the Multimedia presentation of Decision Support Information for Real-Time Control , 1998, Designing Effective and Usable Multimedia Systems.

[17]  Sharon Oviatt,et al.  Multimodal Interfaces , 2008, Encyclopedia of Multimedia.

[18]  Yacine Bellik,et al.  WWHT: un modèle conceptuel pour la présentation multimodale d'information , 2005, IHM '05.

[19]  Sharon L. Oviatt,et al.  Multimodal Interfaces: A Survey of Principles, Models and Frameworks , 2009, Human Machine Interaction.

[20]  Stephen M. Casner,et al.  Task-analytic approach to the automated design of graphic presentations , 1991, TOGS.

[21]  J. Jacko,et al.  The human-computer interaction handbook: fundamentals, evolving technologies and emerging applications , 2002 .