CÉU-MEDIA: Local Inter-Media Synchronization using CÉU

The semantics of current multimedia languages is informal and may lead to the development of ambiguous applications. In this paper we investigate the use of the synchronous language Céu for programming local multimedia applications, in particular, those applications that can be described as a set of synchronized media objects. Céu has a deterministic, concise and accurate semantics which, along with high-level programming constructs, makes the language an attractive alternative for developing multimedia applications. We also present Céu-Media, a library for programming multimedia in Céu. Céu-Media implementation guarantees that the properties of the Céu synchronous semantics are reflected in the multimedia presentation, ensuring inter-media synchronization. We compare the synchronization paradigm of Céu with those of NCL and SMIL, and examine the implementation of representative use cases.

[1]  Stephen A. Edwards,et al.  The synchronous languages 12 years later , 2003, Proc. IEEE.

[2]  Celso A. S. Santos,et al.  Verifying Hypermedia Applications by Using an MDE Approach , 2014, SAM.

[3]  Arjeh M. Cohen,et al.  Synchronized Multimedia Integration Language (SMIL) 2.0 , 1998 .

[4]  Perry R. Cook,et al.  ChucK: a programming language for on-the-fly, real-time audio synthesis and multimedia , 2004, MULTIMEDIA '04.

[5]  Dominique Fober,et al.  FAUST : an Efficient Functional Approach to DSP Programming , 2009 .

[6]  Roberto Ierusalimschy,et al.  Safe system-level concurrency on resource-constrained nodes , 2013, SenSys '13.

[7]  Gérard Berry,et al.  The foundations of Esterel , 2000, Proof, Language, and Interaction.

[8]  Miller S. Puckette,et al.  The Theory and Technique of Electronic Music , 2007 .

[9]  Débora C. Muchaluat-Saade,et al.  Automating the analysis of NCL documents with a model-driven approach , 2013, WebMedia.

[10]  Abdelghani Ghomari,et al.  Towards a Formal Approach for Verifying Temporal Coherence in a SMIL Document Presentation , 2013, MEDI.

[11]  Roberto Ierusalimschy,et al.  Structured synchronous reactive programming with Céu , 2015, MODULARITY.

[12]  Jean-Christophe Le Lann,et al.  POLYCHRONY for System Design , 2003, J. Circuits Syst. Comput..

[13]  Luiz Fernando Gomes Soares,et al.  TAL—Template Authoring Language , 2012, Journal of the Brazilian Computer Society.

[14]  David García,et al.  A framework for efficient and rapid development of cross-platform audio applications , 2008, MM '06.

[15]  Albert Benveniste,et al.  The synchronous approach to reactive and real-time systems , 1991 .

[16]  Débora C. Muchaluat-Saade,et al.  XTemplate 3.0: spatio-temporal semantics and structure reuse for hypermedia compositions , 2011, Multimedia Tools and Applications.

[17]  F. Osório,et al.  Journal of the Brazilian Computer Society , 2009 .

[18]  Pascal Raymond,et al.  The synchronous data flow programming language LUSTRE , 1991, Proc. IEEE.