A Framework for Utility-Based Multimedia Adaptation

Content adaptation is an important issue of multimedia frameworks in order to achieve universal multimedia access (UMA), i.e., to enable consumption of multimedia content independently of the given resource limitations, terminal capabilities, and user preferences. The digital item adaptation (DIA) standard, one of the core specifications of the MPEG-21 framework, supports content adaptation considering a wide range of networks, devices, and user preferences. Most adaptive multimedia frameworks targeting the UMA vision do not consider utility aspects in their adaptation decisions. This paper focuses on a generic semantic-based audio-visual utility model for DIA that aims to enhance the multimedia experience for the user. Our proposed model is able to take the semantics and the perceptual features of the content as well as the users' specific utility aspects into account. Based on a detailed analysis of these constraints, we will show how the model reacts on individual input data. For choosing the best adaptation decision considering resource limitations on client and server sides as well as network characteristics, we evaluate four algorithms for performing this adaptation decision taking task. We will discuss results according to some use case scenarios

[1]  Yong Man Ro,et al.  Semantic Quality for Content-Aware Video Adaptation , 2005, 2005 IEEE 7th Workshop on Multimedia Signal Processing.

[2]  Robin D. Burke,et al.  Hybrid Recommender Systems: Survey and Experiments , 2002, User Modeling and User-Adapted Interaction.

[3]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.

[4]  Hermann Hellwagner,et al.  Fast Adaptation Decision Taking for Cross-Modal Multimedia Content Adaptation , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[5]  Hoang Tuy,et al.  Monotonic Optimization: Problems and Solution Approaches , 2000, SIAM J. Optim..

[6]  M. Angela Sasse,et al.  Can small be beautiful?: assessing image resolution requirements for mobile TV , 2005, MULTIMEDIA '05.

[7]  José María Martínez Sanchez,et al.  Multimedia Content Adaptation Within the CAIN Framework Via Constraints Satisfaction and Optimization , 2006, Adaptive Multimedia Retrieval.

[8]  Josep Lluís de la Rosa i Esteva,et al.  A Taxonomy of Recommender Agents on the Internet , 2003, Artificial Intelligence Review.

[9]  Alexander Felfernig,et al.  Knowledge-based Interactive Selling of Financial Services with FSAdvisor , 2005, AAAI.

[10]  D. S. Hands,et al.  A basic multimedia quality model , 2004, IEEE Transactions on Multimedia.

[11]  Eunmi Oh,et al.  Audio adaptation according to usage environment and perceptual quality metrics , 2005, IEEE Transactions on Multimedia.

[12]  Touradj Ebrahimi,et al.  Semantic video analysis for adaptive content delivery and automatic description , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[14]  Stefan Winkler,et al.  Audiovisual quality evaluation of low-bitrate video , 2005, IS&T/SPIE Electronic Imaging.

[15]  Yong Man Ro,et al.  Modality conversion for QoS management in universal multimedia access , 2005 .

[16]  John R. Smith,et al.  MPEG-7 multimedia description schemes , 2001, IEEE Trans. Circuits Syst. Video Technol..

[17]  Ian Burnett,et al.  Universal multimedia experiences for tomorrow , 2003 .

[18]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.

[19]  Yong Wang,et al.  Optimal adaptation decision-taking for terminal and network quality-of-service , 2005, IEEE Transactions on Multimedia.

[20]  Christian Timmerer,et al.  Digital item adaptation: overview of standardization and research activities , 2005, IEEE Transactions on Multimedia.

[21]  Barry Smyth,et al.  A Live-User Evaluation of Incremental Dynamic Critiquing , 2005, ICCBR.

[22]  Christof Faller,et al.  MAXIMIZING AUDIOVISUAL QUALITY AT LOW BITRATES , 2005 .

[23]  Thomas Schiex,et al.  Valued Constraint Satisfaction Problems: Hard and Easy Problems , 1995, IJCAI.

[24]  Stefan Winkler,et al.  Digital Video Quality: Vision Models and Metrics , 2005 .

[25]  Christian Timmerer,et al.  A knowledge-based framework for multimedia adaptation , 2006, Applied Intelligence.

[26]  Hermann Hellwagner,et al.  A semantic-based multi-modal utility approach for multimedia adaptation , 2006 .

[27]  Miha Grcar.  USER PROFILING: COLLABORATIVE FILTERING , 2004 .

[28]  David M. Pennock,et al.  Categories and Subject Descriptors , 2001 .