A Multimedia Model Based on Structured Media and Sub-Elements for Complex Multimedia Authoring and Presentation

Declarative definition of multimedia presentation such as provided by SMIL standard can be considered as the most significant advance in the multimedia integration domain. However, the requirements of a model that could express richer scenarios for presentations are always a challenge. The work presented here proposes an extended model based on the concept of structured media and sub-elements that allows a finer granularity and a more semantic specification of significant events and locations inside media fragments. The new media fragments can be composed in multimedia scenarios through the specification of temporal, spatial and spatio-temporal relations. Moreover, we propose an abstract animation model that can be combined with the intra-media temporal structuration to specify animation effects in a flexible, not redundant and easy to maintain way. The underlying model is the Madeus model that is a flexible model based on the structural, interval, region and relative constraints. This paper describes the sub-element and the abstract animation models and shows how they are implemented in the Madeus multimedia framework. A complete schema of the video authoring tool based on this model is also specified. Thanks to that, the fine-grained authoring of multimedia scenarios with video media can be done in an easy and effective way.

[1]  Peiya Liu,et al.  A Multimedia Authoring-in-the-Large Environment to Support Complex Product Documentation , 2004, Multimedia Tools and Applications.

[2]  Shih-Fu Chang,et al.  Self-describing schemes for interoperable MPEG-7 multimedia content descriptions , 1998, Electronic Imaging.

[3]  John R. Smith,et al.  MPEG-7 multimedia description schemes , 2001, IEEE Trans. Circuits Syst. Video Technol..

[4]  François Pachet,et al.  Using Description Logics for Indexing Audiovisual Documents , 1998, Description Logics.

[5]  R. Brunelli,et al.  A Survey on the Automatic Indexing of Video Data, , 1999, J. Vis. Commun. Image Represent..

[6]  Lloyd Rutledge,et al.  Improving Media Fragment Integration in Emerging Web Formats , 2001 .

[7]  James F. Allen.  Maintaining knowledge about temporal intervals , 1983, CACM.

[8]  Dan Vodislav.  Visual programming for animation in user interfaces , 1995, Proceedings of Symposium on Visual Languages.

[9]  Rémi Ronfard,et al.  Audiovisual-based hypermedia authoring: using structured representations for efficient access to AV documents , 1999, HYPERTEXT '99.

[10]  Jocelyne Nanard,et al.  Media construction formalism specifying abstractions for multimedia scenario design , 2000, New Rev. Hypermedia Multim..

[11]  Muriel Jourdan,et al.  A Scalable Toolkit for Designing Multimedia Authoring Environments , 2000, Multimedia Tools and Applications.

[12]  Jane Hunter,et al.  A Comparison of Schemas for Video Metadata Representation , 1999, Comput. Networks.

[13]  Kurt Rothermel,et al.  Representing time in multimedia systems , 1994, 1994 Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[14]  Cécile Roisin,et al.  A PROPOSAL FOR A VIDEO MODELING FOR COMPOSING MULTIMEDIA DOCUMENT , 2000 .

[15]  Jane Hunter.  A Proposal for an MPEG-7 Description Definition Language , 1999 .

[16]  John R. Smith,et al.  Multimedia content description in the InfoPyramid , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[17]  Susanne Boll,et al.  ZYX - A Semantic Model for Multimedia Documents and Presentations , 1999, DS-8.

[18]  Jane Hunter,et al.  MPEG-7 Harmonization with Dublin Core: Current Status and Concerns , 2000 .

[19]  Ombretta Gaggi,et al.  A synchronization model for hypermedia documents navigation , 2000, SAC '00.