Eventor: an authoring system for interactive multimedia applications

Programming, testing, and maintaining interactive multimedia applications (IMAs) are still difficult and expensive, while substantial progress has been made to reduce the burden on authors. As IMAs get larger and more complex the difficulties will increase. To overcome the complexity of such IMAs, we argue that authoring systems should provide such facilities as (1) a traditional and intuitivedivide-and-conquer paradigm for solving large and complex problems in various fields, (2)formal specification of the behaviors of IMAs for checking the syntactic correctness of visual expressions or semantic anomalies, and (3)automatic aids like validation of temporal constraints and verification of visual expressions. In this paper, we investigate the properties of IMAs for recognizing the inherent interactivity and concurrency. We propose a specification method based on Milner'sCalculus of Communicating Systems (CCS), which is a well-known formal mechanism for specifying the concurrency in various distributed applications. We also design and implement an authoring system calledEventor (Event Editor), which is based on CCS and composed of three tools: a Temporal Synchronizer, a Spatial Synchronizer, and a User Interaction Builder. They focus on describing the temporal and spatial synchronizations and user interactions while they rely on existing tools in Intel's Digital Video Interactive (DVI) for supporting other functionalities. By editing a simple computer aided instruction (CAI) application, we illustrate that our specification mechanism is well-suited for handling the interactivity of multimedia applications, and Eventor is a simple, efficient, and powerful enough tool to handle practical applications. Especially the incremental refinement and the formal specification based on the CCS allow Eventor to be extended with formal verifications to cope with large and complex applications.

[1]  Arch C. Luther Digital video in the PC environment (2nd ed.) , 1990 .

[2]  Mark S. Ackerman,et al.  A construction set for multimedia applications , 1989, IEEE Software.

[3]  Scott M. Stevens Intelligent interactive video simulation of a code inspection , 1989, CACM.

[4]  Ralf Steinmetz,et al.  Synchronization Properties in Multimedia Systems , 1990, IEEE J. Sel. Areas Commun..

[5]  Nick Roussopoulos,et al.  Timing Requirements for Time-Driven Systems Using Augmented Petri Nets , 1983, IEEE Transactions on Software Engineering.

[6]  Ralf G. Herrtwich Time capsules: An abstraction for access to continuous-media data , 2004, Real-Time Systems.

[7]  Carol J. Anderson,et al.  Creating Interactive Multimedia: A Practical Guide , 1990 .

[8]  John T. Stasko Using direct manipulation to build algorithm animations by demonstration , 1991, CHI '91.

[9]  Kristina Hooper,et al.  Learning With Interactive Multimedia: Developing and Using Multimedia Tools in Education , 1990 .

[10]  Hideo Miyahara,et al.  Multimedia Presentation System Harmony with Temporal and Active Media , 1991, USENIX Summer.

[11]  Arch C. Luther,et al.  Digital video in the PC environment , 1989 .

[12]  Robin Milner,et al.  Communication and concurrency , 1989, PHI Series in computer science.

[13]  Hyunsoo Yoon,et al.  Data Abstractions for Multimedia Composition and Synchronization , 1992 .

[14]  Simon J. Gibbs Composite multimedia and active objects , 1991, OOPSLA 1991.

[15]  Arif Ghafoor,et al.  Synchronization and Storage Models for Multimedia Objects , 1990, IEEE J. Sel. Areas Commun..

[16]  Dick C. A. Bulterman,et al.  Structured multimedia authoring , 1993, MULTIMEDIA '93.

[17]  Polle Zellweger,et al.  Automatic temporal layout mechanisms , 1993, MULTIMEDIA '93.