Engineering multimedia applications on the basis of multi-structured descriptions of audiovisual contents

We focus our interest on the engineering of multimedia applications whose purpose is to exploit and make best use of the audiovisual heritage by means of prospective exploration of virtual access to audiovisual documents through multi-structured descriptions of these. Multi-structured descriptions are composed of multiple descriptors that are expressed using the FDL (Feria Description Language) object language whose expressive power is emphasized. FDL notably provides a multimedia developer with operations on descriptions and their inner descriptors, as well as temporal aggregation data types. An experimental multimedia application that makes extensive use of FDL concepts and mechanisms is outlined. It explores the use of syncing between the narrative structure of the text of a play and the narrative structure of different broadcasted performances of this play, at multiple granularity levels.

[1]  Alexandre Allauzen,et al.  Adaptation automatique du modèle de langage d'un système de transcription de journaux parlés : Modélisation probabiliste du langage naturel , 2003 .

[2]  Ian Horrocks,et al.  From SHIQ and RDF to OWL: the making of a Web Ontology Language , 2003, J. Web Semant..

[3]  James F. Allen.  Maintaining knowledge about temporal intervals , 1983, CACM.

[4]  Rémi Ronfard,et al.  Audiovisual-based hypermedia authoring: using structured representations for efficient access to AV documents , 1999, HYPERTEXT '99.

[5]  John Lewis,et al.  Automated lip-sync: Background and techniques , 1991, Comput. Animat. Virtual Worlds.

[6]  Cécile Roisin,et al.  The limsee3 multimedia authoring model , 2006, DocEng '06.

[7]  Werner Bailer,et al.  Detailed audiovisual profile: enabling interoperability between MPEG-7 based systems , 2006, 2006 12th International Multi-Media Modelling Conference.

[8]  Yannick Prié,et al.  Integration of Semantic Web Technology in an Annotation-based Hypervideo System , 2006 .

[9]  Frédéric Bimbot,et al.  Sirocco, un système ouvert de reconnaissance de la parole. , 2002 .

[10]  Renato Iannella,et al.  Uniform Resource Names (URN) Namespace Definition Mechanisms , 2002, RFC.

[11]  Yannick Prié,et al.  Advene: active reading through hypervideo , 2005, HYPERTEXT '05.

[12]  Mohan S. Kankanhalli,et al.  Metadata handling: A video perspective , 2006, TOMCCAP.

[13]  Marc Caillet.  Un système expert d'aide à la classification taxonomique de classes de descripteurs , 2007, Actes d'IC.

[14]  Valérie Beaudouin,et al.  The Metrometer: a Tool for Analysing French Verse , 1996 .

[15]  Vincent Brunie,et al.  Ingénierie des documents audiovisuels : le projet FERIA. Une approche centrée sur la description des contenus , 2006, Tech. Sci. Informatiques.

[16]  Raphaël Troncy,et al.  Enabling Multimedia Metadata Interoperability by Defining Formal Semantics of MPEG-7 Profiles , 2006, SAMT.

[17]  Raphaël Troncy,et al.  A Motivating Scenario for Designing an Extensible Audio-Visual Description , 2004 .

[18]  Diego Calvanese,et al.  The Description Logic Handbook , 2007 .

[19]  Fernando Pereira,et al.  Weighted finite-state transducers in speech recognition , 2002, Comput. Speech Lang..

[20]  Maria da Graça Campos Pimentel,et al.  Structuring interactive TV documents , 2003, DocEng '03.

[21]  Jane Hunter,et al.  Adding Multimedia to the Semantic Web: Building an MPEG-7 ontology , 2001, SWWS.

[22]  James F. Allen.  Towards a General Theory of Action and Time , 1984, Artif. Intell..

[23]  Deborah L. McGuinness,et al.  OWL Web ontology language overview , 2004 .

[24]  Howard Bowman,et al.  Synchronization in Multimedia Documents , 1998, EP.

[25]  Howard Bowman,et al.  Mexitl: Multimedia in Executable Interval Temporal Logic , 2003, Formal Methods Syst. Des..

[26]  Rémi Ronfard,et al.  A framework for aligning and indexing movies with their script , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[27]  Nabil Layaïda,et al.  Madeus: an authoring environment for interactive multimedia documents , 1997, Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[28]  Roger K. Moore.  Computer Speech and Language , 1986 .

[29]  Nabil Layaïda,et al.  Madeus, and authoring environment for interactive multimedia documents , 1998, MULTIMEDIA '98.

[30]  Fernando Pereira,et al.  MPEG-7 the generic multimedia content description standard, part 1 - Multimedia, IEEE , 2001 .

[31]  Dick C. A. Bulterman,et al.  The Amsterdam hypermedia model: adding time and context to the Dexter model , 1994, CACM.

[32]  Herng-Yow Chen,et al.  Exploring media correlation and synchronization for navigated hypermedia documents , 2005, MULTIMEDIA '05.

[33]  François Pachet,et al.  Clavis: a temporal reasoning system for classification of audiovisual sequences , 2000 .

[34]  Timothy K. Shih,et al.  Formal Model of Temporal Properties Underlying Multimedia Presentation , 1996, MMM.