Extension of Timeline-based Editing for Non-deterministic Temporal Behavior in SMIL2.0 Authoring

Timeline-based editing provides nonprofessional users an intuitive and friendly way for multimedia authoring, but the schedule-based and deterministic property of timeline results in the lack of the ability for supporting non-deterministic temporal behavior, which is one of the key features of SMIL2.0. This paper presents our elaborate effort of supporting non-deterministic temporal behavior by timeline-based editing. The concept of Dividable Dynamic Timeline (DDTL) is proposed in the paper, which includes two novel features: dividable timeline and dynamic section. With DDTL, authors can create interactive multimedia presentations while enjoying the convenience of timeline. Mechanisms of converting from DDTL editing results to SMIL2.0 and the reuse of SMIL2.0 scripts are presented in the paper. By the reuse of existing SMIL2.0 scripts and the flexible features of DDTL, an efficient and friendly authoring environment for SMIL2.0based interactive multimedia presentations can be provided. Implementation of the system provides a friendly WYSIWYG environment and multiple views/windows are provided by the systems to help SMIL2.0 authors compose multimedia presentations efficiently.

[1]  Muriel Jourdan,et al.  Multiviews interfaces for multimedia authoring environments , 1998, Proceedings 1998 MultiMedia Modeling. MMM'98 (Cat. No.98EX200).

[2]  Timos K. Sellis,et al.  Specifying and Authoring Multimedia Scenarios , 1999, IEEE Multim..

[3]  Junehwa Song,et al.  Interactive authoring of multimedia documents , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[4]  Rogério Ferreira Rodrigues,et al.  Modeling, authoring and formatting hypermedia documents in the HyperProp system , 2000, Multimedia Systems.

[5]  Soon Myoung Chung,et al.  Timed Petri net representation of the Synchronized Multimedia Integration Language (SMIL) of XML , 2003, Proceedings ITCC 2003. International Conference on Information Technology: Coding and Computing.

[6]  Chun-Chuan Yang,et al.  Modeling of the non-deterministic synchronization behaviors in SMIL2.0 documents , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[7]  Chun-Chuan Yang,et al.  Design and implementation of the just-in-time retrieving policy for schedule-based distributed multimedia presentations , 2004, J. Syst. Softw..

[8]  Soon Myoung Chung,et al.  Timed Petri net representation of SMIL , 2005, IEEE MultiMedia.

[9]  Arjeh M. Cohen,et al.  Synchronized Multimedia Integration Language (SMIL) 2.0 , 1998 .

[10]  Dick C. A. Bulterman SMIL 2.0 part 1: overview, concepts, and structure , 2001 .

[11]  Chun-Chuan Yang,et al.  Synchronization modeling and its application for SMIL2.0 presentations , 2007, J. Syst. Softw..

[12]  Hervé Martin,et al.  A STORM* environment for building multimedia presentations , 1998, Proceedings Twelfth International Conference on Information Networking (ICOIN-12).

[13]  Rik Van de Walle,et al.  Timing issues in multimedia formats: review of the principles and comparison of existing formats , 2004, IEEE Transactions on Multimedia.

[14]  Dick C. A. Bulterman,et al.  Structured multimedia authoring , 1993, MULTIMEDIA '93.

[15]  Jau-Hsiung Huang,et al.  A Multimedia Synchronization Model and Its Implementation in Transport Protocols , 1996, IEEE J. Sel. Areas Commun..

[16]  Ombretta Gaggi,et al.  A visual authoring environment for prototyping multimedia presentations , 2002, Fourth International Symposium on Multimedia Software Engineering, 2002. Proceedings..

[17]  A. Y. Chang Design of an intelligent distributed multimedia presentation system using temporal algebra and SMIL , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[18]  Scott E. Hudson,et al.  The walk-through approach to authoring multimedia documents , 1994, MULTIMEDIA '94.

[19]  Sun Shin An,et al.  Design and implementation of IMAT (Internet Multimedia Authoring Tool) using a unified spatio-temporal relationship model , 1999, 1999 IEEE Third Workshop on Multimedia Signal Processing (Cat. No.99TH8451).

[20]  Chun-Chuan Yang,et al.  SMILAuthor: An Authoring System for SMIL-Based Multimedia Presentations , 2003, Multimedia Tools and Applications.

[21]  Vincent Quint,et al.  Editing SMIL with Timelines , 2003 .

[22]  Cécile Roisin,et al.  A Multimedia Model Based on Structured Media and Sub-Elements for Complex Multimedia Authoring and Presentation , 2002, Int. J. Softw. Eng. Knowl. Eng..

[23]  Chun-Chuan Yang,et al.  Reuse of SMI 2.0 scripts in dividable dynamic timeline-based authoring , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[24]  Timos K. Sellis,et al.  Interactive Multimedia Documents: A Modeling, Authoring and Rendering Approach , 2000, Multimedia Tools and Applications.

[25]  Dick C. A. Bulterman,et al.  SMIL 2.0 Part 2: Examples and Comparisons , 2002, IEEE Multim..

[26]  Celso A. S. Santos,et al.  About the semantic verification of SMIL documents , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[27]  Anthony Y. Chang Design of consistent SMIL documents for distributed multimedia presentation using temporal algebra , 2005, 11th International Conference on Parallel and Distributed Systems (ICPADS'05).

[28]  Chun-Chuan Yang,et al.  Dividable dynamic timeline-based authoring for SMI 2.0 presentations , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[29]  Do Hyung Lee,et al.  A collaborative authoring system for multimedia presentation , 2004, 2004 IEEE International Conference on Communications (IEEE Cat. No.04CH37577).

[30]  Celso A. S. Santos,et al.  Experience with RT-LOTOS, a temporal extension of the LOTOS formal description technique , 2000, Comput. Commun..

[31]  Pierre de Saqui-Sannes,et al.  Multimedia Authoring with Hierarchical Timed Stream Petri Nets and Java , 2004, Multimedia Tools and Applications.