Emergent Semantics in Personalized Multimedia Content

Authoring of personalized multimedia content can be considered as a process consisting of selecting, composing, and assembling media elements into coherent multimedia presentations that meet the user’s or user group’s preferences, interests, current situation, and environment. In the approaches we find today, media items and semantically rich metadata information are used for the selection and composition task. However, most valuable semantics for the media elements and the resulting multimedia content that emerge with and in the authoring process are not considered any further. This means that the effort for semantically enriching media content comes to a sudden halt in the created multimedia document – which is very unfortunate. In this paper, we propose with the SemanticMM4U framework an integrated approach for deriving and exploiting multimedia semantics that arise with and from the creation of personalized multimedia content and make it available for further use and applications. In this approach, not only the metadata are considered that are semantically evolving from the media elements of the newly created presentation. Also the actual usage of media elements for the authoring can emerge new semantics of the single media elements employed. In the application domain of authoring of digital photo albums we show where and how semantics emerge in the authoring process and how these contribute to an even richer media content pool, both for single media and also for the composition and its later use.

[1]  Lynda Hardman,et al.  Application-Specic Constraints for Multimedia Presentation Generation , 2001 .

[2]  I. V. Shevera.  Synchronized multimedia integration language , 2004 .

[3]  Muriel Jourdan,et al.  A GENERIC ARCHITECTURE FOR AUTOMATED CONSTRUCTION OF MULTIMEDIA PRESENTATIONS , 2001 .

[4]  Susanne Boll,et al.  Paving the Last Mile for Multi-Channel Multimedia Presentation Generation , 2005, 11th International Multimedia Modelling Conference.

[5]  Farshad Fotouhi,et al.  Emergent semantics and the multimedia semantic web , 2002, SGMD.

[6]  Simone Santini,et al.  Emergent Semantics through Interaction in Image Databases , 2001, IEEE Trans. Knowl. Data Eng..

[7]  Peter Brusilovsky,et al.  Methods and techniques of adaptive hypermedia , 1996, User Modeling and User-Adapted Interaction.

[8]  Susanne Boll,et al.  Context-driven smart authoring of multimedia content with xSMART , 2005, MULTIMEDIA '05.

[9]  Frank Nack,et al.  Designing annotation before it's needed , 2001, MULTIMEDIA '01.

[10]  Susanne Boll,et al.  MM4U: A Framework for Creating Personalized Multimedia Content , 2005 .

[11]  Tayeb Lemlouma,et al.  Context-aware adaptation for mobile devices , 2004, IEEE International Conference on Mobile Data Management, 2004. Proceedings. 2004.

[12]  Jun Yang,et al.  What Can Expressive Semantics Tell: Retrieval Model for a Flash-Movie Search Engine , 2005, CIVR.

[13]  B. S. Manjunath,et al.  Introduction to MPEG-7: Multimedia Content Description Interface , 2002 .

[14]  Lloyd Rutledge,et al.  Towards a multimedia formatting vocabulary , 2003, WWW '03.

[15]  Jane Hunter,et al.  Dynamic Generation of Intelligent Multimedia Presentations through Semantic Inferencing , 2002, ECDL.

[16]  Sonja Zillner,et al.  EMMO: Tradable Units of Knowledge-Enriched Multimedia Content , 2005 .

[17]  Natalia Stash,et al.  AHA! The adaptive hypermedia architecture , 2003, HYPERTEXT '03.

[18]  Farshad Fotouhi,et al.  Using Coherent Semantic Subpaths to Derive Emergent Semantics , 2004, KES.

[19]  Frank Nack.  Capture and transfer of metadata during video production , 2005, MHC '05.

[20]  Hongjing Wu,et al.  Design issues for general-purpose adaptive hypermedia systems , 2001, HYPERTEXT '01.

[21]  Rik Van de Walle,et al.  MPEG-21: goals and achievements , 2001 .