Coping with Temporal Constraints in Multimedia Presentation Planning

Computer-based presentation systems enable the realization of effective and dynamic presentation styles that incorporate multiple media. Obvious examples are animated user interface agents which verbally comment on multimedia objects displayed on the screen while performing cross-media and cross-window pointing gestures. The design of such presentations must account for the temporal coordination of media output and the agent's behavior. In this paper we describe a new presentation system which not only creates the multimedia objects to be presented, but also generates a script for presenting the material to the user. In our system, this script is forwarded to an animated presentation agent running the presentation. The paper details the kernel of the system which is a component for planning temporally coordinated multimedia.

[1]  Pattie Maes,et al.  Collaborative Interface Agents , 1994, AAAI.

[2]  Thomas Rist,et al.  The PPP persona: a multipurpose animated presentation agent , 1996, AVI '96.

[3]  John R. Searle,et al.  Speech Acts: An Essay in the Philosophy of Language , 1970 .

[4]  Akikazu Takeuchi,et al.  Communicative facial displays as a new conversational modality , 1993, INTERCHI.

[5]  Daniel T. Ling,et al.  Planning-based control of interface animation , 1995, CHI '95.

[6]  William C. Mann,et al.  RHETORICAL STRUCTURE THEORY: A THEORY OF TEXT ORGANIZATION , 1987 .

[7]  Thomas Rist,et al.  Incorporating Graphics Design and Realization into the Multimodal Presentation System WIP , 1992, Advanced Visual Interfaces.

[8]  Winfried Graf,et al.  Constraint-based layout in visual program design , 1995, Proceedings of Symposium on Visual Languages.

[9]  Anne Kilger.  USING UTAGS FOR INCREMENTAL AND PARALLEL GENERATION , 1994, Comput. Intell..

[10]  Ahmed Karmouch,et al.  A Temporal Model for Interactive Multimedia Scenarios , 1995, IEEE Multim..

[11]  Steven K. Feiner,et al.  Towards Coordinated Temporal Multimedia Presentations , 1993, AAAI Workshop on Intelligent Multimedia Interfaces.

[12]  Dick C. A. Bulterman,et al.  The Amsterdam hypermedia model: adding time and context to the Dexter model , 1994, CACM.

[13]  James F. Allen.  Maintaining knowledge about temporal intervals , 1983, CACM.

[14]  Mark T. Maybury,et al.  Planning Multimedia Explanations Using Communicative Acts , 1991, AAAI Workshop on Intelligent Multimedia Interfaces.

[15]  Mark T. Maybury,et al.  Intelligent multimedia interfaces , 1994, CHI Conference Companion.

[16]  Norman I. Badler,et al.  Simulating humans: computer graphics animation and control , 1993 .

[17]  Henry A. Kautz,et al.  Integrating Metric and Qualitative Temporal Reasoning , 1991, AAAI.