Mexitl: Multimedia in Executable Interval Temporal Logic

This paper explores a formalism for describing a wide class of multimedia document constraints, based on an interval temporal logic. We describe the requirements that arise from the multimedia documents application area, and we illustrate these requirements using several examples. Then we present the temporal logic formalism that we use. This logic extends existing interval temporal logic with a number of new features: actions, framing of actions, past operators, a projection-like operator called filter and a new handling of interval length. The notation is applied to the specification of the examples, and in particular a set of logical manipulations, providing feedback to an author, is presented. A model theory, logic and satisfaction relation are defined for the notation.

[1]  Howard Bowman,et al.  A Decision Procedure and Complete Axiomatization of Finite Interval Temporal Logic with Projection , 2003, J. Log. Comput..

[2]  Jean-Pierre Courtiat,et al.  Multimedia Modeling: Towards the Information Superhighway , 1996 .

[3]  Gérard Berry,et al.  The Esterel Synchronous Programming Language: Design, Semantics, Implementation , 1992, Sci. Comput. Program..

[4]  Polle Zellweger,et al.  Automatic temporal layout mechanisms , 1993, MULTIMEDIA '93.

[5]  Simon J. Thompson,et al.  Modeling Reactive Multimedia: Events and Behaviors , 2004, Multimedia Tools and Applications.

[6]  Dov M. Gabbay,et al.  Advances in Temporal Logic , 2000 .

[7]  Lloyd Rutledge,et al.  Do you have the time? Composition and linking in time-based hypermedia , 1999, Hypertext.

[8]  Zhenhua Duan,et al.  An extended interval temporal logic and a framing technique for temporal logic programming , 1996 .

[9]  B. Prabhakaran,et al.  Synchronization models for multimedia presentation with user participation , 2005, Multimedia Systems.

[10]  Howard Bowman,et al.  Specification and Prototyping of Structured Multimedia Documents using Interval Temporal Logic , 2000 .

[11]  Carl K. Chang,et al.  Temporal Relations and Synchronization Agents , 1996, IEEE Multim..

[12]  Dick C. A. Bulterman,et al.  Multimedia Authoring Tools: State of the Art and Research Challenges , 1995, Computer Science Today.

[13]  Chung-Ming Huang,et al.  MING-I: a distributed interactive multimedia document development mechanism , 1998, Multimedia Systems.

[14]  P. David Stotts,et al.  Hyperdocuments as automata: trace-based browsing property verification , 1992, ECHT '92.

[15]  Ben C. Moszkowski,et al.  A complete axiomatization of interval temporal logic with infinite time , 2000, Proceedings Fifteenth Annual IEEE Symposium on Logic in Computer Science (Cat. No.99CB36332).

[16]  Ron Koymans,et al.  Specifying real-time properties with metric temporal logic , 1990, Real-Time Systems.

[17]  Robert Erfle.  Specification of Temporal Constraints in Multimedia Documents using HyTime , 1993, Electron. Publ..

[18]  P. David Stotts,et al.  Hyperdocuments as automata: verification of trace-based browsing properties by model checking , 1998, TOIS.

[19]  Roger Hale,et al.  Using Temporal Logic for Prototyping: The Design of a Lift Controller , 1987, Temporal Logic in Specification.

[20]  Simon Thompson,et al.  Constructive Interval Temporal Logic in Alf , 2000 .

[21]  P. R. KING.  Modelling multimedia documents , .

[22]  Dov M. Gabbay,et al.  The Declarative Past and Imperative Future: Executable Temporal Logic for Interactive Systems , 1987, Temporal Logic in Specification.

[23]  Dick C. A. Bulterman,et al.  Structured multimedia authoring , 1993, MULTIMEDIA '93.

[24]  Dov M. Gabbay,et al.  METATEM: A Framework for Programming in Temporal Logic , 1989, REX Workshop.

[25]  Andrzej Duda,et al.  Interval expressions-a functional model for interactive dynamic multimedia presentations , 1996, Proceedings of the Third IEEE International Conference on Multimedia Computing and Systems.

[26]  Louise E. Moser,et al.  A graphical environment for the design of concurrent real-time systems , 1997, TSEM.

[27]  Ben C. Moszkowski,et al.  An Automata-Theoretic Completeness Proof for Interval Temporal Logic , 2000, ICALP.

[28]  Peter R. King.  A Logic Based Formalism for Temporal Constraints in Multimedia Documents , 1996, PODP.

[29]  James F. Allen.  Maintaining knowledge about temporal intervals , 1983, CACM.

[30]  Shinji Kono,et al.  A Combination of Clausal and Non Clausal Temporal Logic Programs , 1993, Executable Modal and Temporal Logics.

[31]  Senro Saito,et al.  Using Timed CSP for Specification Verification and Simulation of Multimedia Synchronization , 1996, IEEE J. Sel. Areas Commun..

[32]  Ben C. Moszkowski,et al.  Executing temporal logic programs , 1986, Seminar on Concurrency.

[33]  Howard Bowman,et al.  A Tableau Method for Interval Temporal Logic with Projection , 1998, TABLEAUX.

[34]  Patrick Sénac,et al.  Modeling Logical and Temporal Synchronization in Hypermedia Systems , 1996, IEEE J. Sel. Areas Commun..

[35]  Zohar Manna,et al.  The Temporal Logic of Reactive and Concurrent Systems , 1991, Springer New York.

[36]  Timothy K. Shih,et al.  Formal Model of Temporal Properties Underlying Multimedia Presentation , 1996, MMM.

[37]  Kurt Rothermel,et al.  Representing time in multimedia systems , 1994, 1994 Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[38]  Ben C. Moszkowski.  Some Very Compositional Temporal Properties , 1994, PROCOMET.

[39]  Wanjiun Liao,et al.  Synchronization of distributed multimedia systems with user interactions , 1998, Multimedia Systems.