A knowledge-based framework for multimedia adaptation

AbstractPersonalized delivery of multimedia content over the Internet opens new business perspectives for future multimedia applications and thus plays an important role in the ongoing MPEG-7 and MPEG-21 multimedia standardization efforts. Based on these standards, next-generation multimedia services will be able to automatically prepare the digital content before delivery according to the client's device capabilities, the network conditions, or even the user's content preferences. However, these services will have to deal with a variety of different end user devices, media formats, as well as with additional metadata when adapting the original media resources. In parallel, an increasing number of commercial or open-source media transformation tools will be available, capable of exploiting such descriptive metadata or dealing with new media formats; thus it is not realistic that a single tool will support all possible transformations.In this paper, we present a novel, fully knowledge-based approach for building such multimedia adaptation services, addressing the above mentioned issues of openness, extensibility, and concordance with existing and upcoming standards. In our approach, the original media is transformed in multiple adaptation steps performed by an extensible set of external tools, where the construction of adequate adaptation sequences is solved in an Artificial Intelligence planning process. The interoperability issue is addressed by exploiting standardized Semantic Web Services technology. This technology allows us to express tool capabilities and execution semantics in a declarative and well-defined form. In this context, existing multimedia standards serve as a shared domain ontology.The presented approach was implemented and successfully evaluated in an official ISO/IEC MPEG (Moving Picture Experts Group) Core Experiment and is currently under further evaluation by the standardization body.

[1]  Matthias De Geyter,et al.  Multi-step media adaptation: implementation of a knowledge-based engine , 2005, WWW '05.

[2]  Fernando Pereira,et al.  MPEG-7 the generic multimedia content description standard, part 1 - Multimedia, IEEE , 2001 .

[3]  Hermann Hellwagner,et al.  Architecture of a quality based intelligent proxy (QBIX) for MPEG-4 videos , 2003, WWW '03.

[4]  Hermann Hellwagner,et al.  Metadata driven adaptation in the ADMITS project , 2003, Signal Process. Image Commun..

[5]  Chen-Hsiu Huang.  Video Transcoding Architectures and Techniques : An Overview , 2003 .

[6]  Tom Bylander,et al.  The Computational Complexity of Propositional STRIPS Planning , 1994, Artif. Intell..

[7]  Michael G. Strintzis,et al.  Region-Based Image Retrieval Using an Object Ontology and Relevance Feedback , 2004, EURASIP J. Adv. Signal Process..

[8]  A FRAMEWORK.  VizIR A Framework for Visual Information Retrieval , 2003 .

[9]  Paul H. Lewis,et al.  SCULPTEUR: Towards a New Paradigm for Multimedia Museum Information Handling , 2003, SEMWEB.

[10]  Godfrey Rust,et al.  The MPEG‐21 Rights Data Dictionary and New Approaches to Semantics , 2006 .

[11]  P. Beek,et al.  Text of 15938-5 FCD Information Technology-Multimedia Content Description Interface-Pard 5 Multimedia Description Schemes , 2001 .

[12]  Elisa Bertino,et al.  MPGS: An Interactive Tool for the Specification and Generation of Multimedia Presentations , 2000, IEEE Trans. Knowl. Data Eng..

[13]  Óscar Corcho,et al.  SWS for Financial Overdrawn Alerting , 2004, SEMWEB.

[14]  Ivan Bratko,et al.  Prolog Programming for Artificial Intelligence , 1986 .

[15]  Deborah L. McGuinness,et al.  OWL Web ontology language overview , 2004 .

[16]  Rik Van de Walle,et al.  MPEG-21: goals and achievements , 2001 .

[17]  Jerry R. Hobbs,et al.  DAML-S: Semantic Markup for Web Services , 2001, SWWS.

[18]  Xin Wang.  MPEG-21 Rights Expression Language: Enabling Interoperable Digital Rights Management , 2004, IEEE Multim..

[19]  Xin Wang,et al.  The MPEG-21 rights expression language and rights data dictionary , 2005, IEEE Transactions on Multimedia.

[20]  Sophie Devillers,et al.  Information Technology-Multimedia Framework (MPEG-21)-Part 7: Digital Item Adaptation , 2006 .

[21]  Ivan Bratko,et al.  Prolog (3rd ed.): programming for artificial intelligence , 2000 .

[22]  Jan Gecsei,et al.  Adaptation in Distributed Multimedia Systems , 1997, IEEE Multim..

[23]  Michael G. Strintzis,et al.  Multimedia Content Indexing and Retrieval Using an Object Ontology , 2005, Multimedia Content and the Semantic Web.

[24]  Christian Timmerer,et al.  Digital item adaptation: overview of standardization and research activities , 2005, IEEE Transactions on Multimedia.

[25]  Hermann Hellwagner,et al.  An Extensible Framework for Knowledge-Based Multimedia Adaptation , 2004, IEA/AIE.

[26]  Touradj Ebrahimi,et al.  From the guest editors - Universal multimedia access , 2003 .

[27]  G Stix,et al.  The mice that warred. , 2001, Scientific American.

[28]  James A. Hendler,et al.  The Semantic Web" in Scientific American , 2001 .

[29]  Blai Bonet,et al.  Faster Heuristic Search Algorithms for Planning with Uncertainty and Full Feedback , 2003, IJCAI.

[30]  Avrim Blum,et al.  Fast Planning Through Planning Graph Analysis , 1995, IJCAI.

[31]  WangXin.  MPEG-21 Rights Expression Language , 2004 .

[32]  Maria Fox,et al.  PDDL2.1: An Extension to PDDL for Expressing Temporal Planning Domains , 2003, J. Artif. Intell. Res..

[33]  Touradj Ebrahimi,et al.  MPEG-based personalized content delivery , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[34]  Fabien Gandon,et al.  Using Semantic Web Services for Context-Aware Mobile Applications , 2004 .

[35]  Xiang Zhang,et al.  OREL: an ontology-based rights expression language , 2004, WWW Alt. '04.

[36]  Dietmar Jannach,et al.  A Multimedia Adaptation Framework based on Semantic Web Technology , 2005 .