Adaptation of Multimedia Presentations for Different Display Sizes in the Presence of Preferences and Temporal Constraints

Multimedia content adaptation has become important due to many devices with different amounts of resources like display sizes, memories, and computation capabilities. Existing studies perform content adaptation on web pages and other media files that have the same start times and durations. In this paper, we present a content adaptation method for multimedia presentations constituting media files with different start times and durations. We perform adaptation based on preferences and temporal constraints specified by authors and generate an order of importance among media files. Our method can automatically generate layouts by computing the locations, start times, and durations of the media files. We compare three solutions to generate layouts: 1) exhaustive search, 2) dynamic programming, and 3) greedy algorithms. We analyze the presentations by varying screen resolutions, media files, preferences, and temporal constraints. Our analysis shows that screen utilizations are 92%, 85%, and 80% for the three methods, respectively. The time to generate layouts for a presentation with 100 media files is 1200, 17, and 10 s, respectively, for the three methods.

[1]  John R. Smith,et al.  Adapting Multimedia Internet Content for Universal Access , 1999, IEEE Trans. Multim..

[2]  John D. Garofalakis,et al.  Use of RSS feeds for content adaptation in mobile web browsing , 2006, W4A '06.

[3]  A. Y. Chang.  Design of an intelligent distributed multimedia presentation system using temporal algebra and SMIL , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[4]  Akira Kinno,et al.  An efficient caching mechanism for XML content adaptation , 2004, 10th International Multimedia Modelling Conference, 2004. Proceedings..

[5]  José María Martínez Sanchez,et al.  Virtual Camera Tools for an Image2Video Application , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[6]  Polle Zellweger,et al.  Automatic temporal layout mechanisms , 1993, MULTIMEDIA '93.

[7]  James F. Allen.  Maintaining knowledge about temporal intervals , 1983, CACM.

[8]  Maw-Sheng Chern,et al.  An optimization model for Web content adaptation , 2006, Comput. Networks.

[9]  Yung-Hsiang Lu,et al.  Preference-based adaptation of multimedia presentations for different display sizes , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[10]  S. Edelkamp,et al.  Cost-Optimal Planning with Constraints and Preferences in Large State Spaces , 2006 .

[11]  Jun Kong,et al.  Spatial graph grammars for graphical user interfaces , 2006, TCHI.

[12]  Ronen I. Brafman,et al.  Qualitative decision making in adaptive presentation of structured information , 2004, TOIS.

[13]  Chichang Jou,et al.  A Semantics-Based Automatic Web Content Adaptation Framework for Mobile Devices , 2007, WEBIST.

[14]  Philip S. Yu,et al.  Collaborative proxy system for distributed Web content transcoding , 2000, CIKM '00.

[15]  John R. Smith,et al.  Multimedia content description in the InfoPyramid , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[16]  Alan Borning,et al.  Constraint-based document layout for the Web , 2000, Multimedia Systems.

[17]  Jun Kong,et al.  Parsing Spatial Graph Grammars , 2004, 2004 IEEE Symposium on Visual Languages - Human Centric Computing.

[18]  S.J.H. Yang,et al.  Applying Content Adaptation to Mobile Learning , 2007, Second International Conference on Innovative Computing, Informatio and Control (ICICIC 2007).

[19]  Polle Zellweger,et al.  Scheduling Multimedia Documents Using Temporal Constraints , 1992, NOSSDAV.

[20]  Ronen I. Brafman,et al.  Preference‐Based Constrained Optimization with CP‐Nets , 2004, Comput. Intell..

[21]  JanRong-Hong,et al.  An optimization model for Web content adaptation , 2006 .

[22]  Ronen I. Brafman,et al.  Adaptive Rich Media Presentations via Preference-Based Constrained Optimization , 2004, Preferences.

[23]  Kevin Curran,et al.  TeleMorph: A Fuzzy Logic Approach to Network-Aware Transmoding in Mobile Intelligent Multimedia Presentation Systems , 2007, IEEE Journal of Selected Topics in Signal Processing.

[24]  Farokh B. Bastani,et al.  A Flexible Content Adaptation System Using a Rule-Based Approach , 2007, IEEE Transactions on Knowledge and Data Engineering.

[25]  Muriel Jourdan,et al.  Using Temporal Constraints Networks to manage Temporal Scenario of Multimedia Documents , 1998 .

[26]  Sung-Ju Lee,et al.  Caching strategies in transcoding-enabled proxy systems for streaming media distribution networks , 2004, IEEE Transactions on Multimedia.

[27]  Majid Sarrafzadeh,et al.  Fast Template Placement for Reconfigurable Computing Systems , 2000, IEEE Des. Test Comput..

[28]  Yong Man Ro,et al.  Modality conversion for QoS management in universal multimedia access , 2005 .

[29]  Jun Kong,et al.  Authoring multimedia documents through grammatical specifications , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[30]  Jaeyoung Yang,et al.  ScalableWeb News Adaptation To Mobile Devices Using Visual Block Segmentation for Ubiquitous Media Services , 2007, 2007 International Conference on Multimedia and Ubiquitous Engineering (MUE'07).

[31]  Heidrun Schumann,et al.  Adaptive Layout for Interactive Documents , 2008, Smart Graphics.

[32]  Francis C. M. Lau,et al.  Relationship-aware content adaptation of structured Web documents for mobile computing , 2005, 11th International Conference on Parallel and Distributed Systems (ICPADS'05).

[33]  Ming-Syan Chen,et al.  Versatile Transcoding Proxy for Internet Content Adaptation , 2008, IEEE Transactions on Multimedia.

[34]  Fan Zhang,et al.  Streaming media caching algorithms for transcoding proxies , 2002, Proceedings International Conference on Parallel Processing.