Timing issues in multimedia formats: review of the principles and comparison of existing formats

In recent years. a large number of new multimedia (MM) formats have been created. It is widely recognized that the life cycle for a MM document consists of three areas. First of all, a document model is needed to model the MM scenario. Secondly, this document model is to be translated into a computer description. Finally, a set of synchronization primitives must be defined in order to be able to present the computer description to the end-user. The contribution of this paper is the definition of an integrated reference model that covers all three areas. For each of the three areas a model is put forward, based on the current state-of-the-art in that area. From these models, a reference model is created consisting of ten rules and a document model. This model is then applied to a number of real-world MM formats (SMIL, QuickTime, RealVideo, Advanced Streaming Format, Shockwave, and MPEG-4). Finally, a comparison is presented showing the results obtained from applying the reference model to the MM formats.

[1]  Christina Class.  Synchronization in distributed multimedia applications , 2000 .

[2]  Susanne Boll,et al.  ZYX-A Multimedia Document Model for Reuse and Adaptation of Multimedia Content , 2001, IEEE Trans. Knowl. Data Eng..

[3]  M. Chial,et al.  in simple , 2003 .

[4]  James F. Allen.  Maintaining knowledge about temporal intervals , 1983, CACM.

[5]  E. Fleischman,et al.  Advanced Streaming Format (ASF) Specification , 1998 .

[6]  Ralf Steinmetz,et al.  Synchronization Properties in Multimedia Systems , 1990, IEEE J. Sel. Areas Commun..

[7]  Julien Signes.  Binary Format for Scene (BIFS): combining MPEG-4 media to build rich multimedia services , 1998, Electronic Imaging.

[8]  Thomas D. C. Little,et al.  A Temporal Reference Framework for Multimedia Synchronization , 1996, IEEE J. Sel. Areas Commun..

[9]  John R. Smith,et al.  MPEG-4 Authoring using SMIL , 2000 .

[10]  Touradj Ebrahimi,et al.  The MPEG-4 Book , 2002 .

[11]  Elisa Bertino,et al.  Temporal Synchronization Models for Multimedia Data , 1998, IEEE Trans. Knowl. Data Eng..

[12]  Andrzej Duda,et al.  Synchronized Multimedia for the WWW , 1998, Comput. Networks.

[13]  Kurt Rothermel,et al.  Representing time in multimedia systems , 1994, 1994 Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[14]  Ralf Steinmetz,et al.  Human Perception of Jitter and Media Synchronization , 1996, IEEE J. Sel. Areas Commun..

[15]  Jin Yu.  A Simple, Intuitive Hypermedia Synchronization Model and its Realization in the Browser/Java Environment , 1997 .