Two Frameworks for the Adaptive Multimodal Presentation of Information

Our work aims at developing models and software tools that can exploit intelligently all modalities available to the system at a given moment, in order to communicate information to the user. In this chapter, we present the outcome of two research projects addressing this problem in two different areas: the first one is relative to the contextual presentation of information in a “classical” interaction situation, while the second one deals with the opportunistic presentation of information in an ambient environment. The first research work described in this chapter proposes a conceptual model for intelligent multimodal presentation of information. This model called WWHT is based on four concepts: “What,” “Which,” “How,” and “Then.” The first three concepts are about the initial presentation design while the last concept is relative to the presentation evolution. On the basis of this model, we present the ELOQUENCE software platform for the specification, the simulation and the execution of output multimodal systems. The second research work deals with the design of multimodal information systems in the framework of ambient intelligence. We propose an ubiquitous information system that is capable of providing personalized information to mobile users. Furthermore, we focus on multimodal information presentation. The proposed system architecture is based on KUP, an alternative to traditional software architecture models for human-computer interaction. The KUP model takes three logical entities into DOI: 10.4018/978-1-60566-978-6.ch007

[1]  David Taniar Mobile Computing: Concepts, Methodologies, Tools, and Applications , 2008 .

[2]  Dan Steinberg,et al.  Mobile Phone Customer Type Discrimination via Stochastic Gradient Boosting , 2007, Int. J. Data Warehous. Min..

[3]  Niels Ole Bernsen,et al.  Foundations of Multimodal Representations: A Taxonomy of Representational Modalities , 1994, Interact. Comput..

[4]  Alexander Pretschner,et al.  A Trustworthy Usage Control Enforcement Framework , 2011, 2011 Sixth International Conference on Availability, Reliability and Security.

[5]  Mark Weiser,et al.  Some computer science issues in ubiquitous computing , 1993, CACM.

[6]  Albrecht Schmidt,et al.  Physical Prototyping with Smart-its Embedded Ubiquitous Computing Systems , 2022 .

[7]  David Taniar Encyclopedia of Mobile Computing and Commerce , 2007 .

[8]  Eduard H. Hovy,et al.  The design of a model-based multimedia interaction manager , 1995, Artificial Intelligence Review.

[9]  David Taniar,et al.  International Journal of Mobile Computing and Multimedia Communications , 2010 .

[10]  Stephen Travis Pope,et al.  A cookbook for using the model-view controller user interface paradigm in Smalltalk-80 , 1988 .

[11]  Richard A. Bolt,et al.  “Put-that-there”: Voice and gesture at the graphics interface , 1980, SIGGRAPH '80.

[12]  Thomas Rist,et al.  A standard reference model for intelligent multimedia presentation systems , 1997, Comput. Stand. Interfaces.

[13]  Constantine Stephanidis,et al.  Universal Access in the Information Society: Methods, Tools, and Interaction Technologies , 2001, Universal Access in the Information Society.

[14]  Michael Johnston,et al.  Finite-state multimodal integration and understanding , 2005, Natural Language Engineering.

[15]  S. S. Leong,et al.  A neural network PI controller tuner , 1995, Artif. Intell. Eng..