Runtime Personalization of Multi-Device User Interfaces: Enhanced Accessibility for Media Consumption in Heterogeneous Environments by User Interface Adaptation

The diversity of end-user devices in combination with a growing user base poses important challenges for providing easy access to the huge amount of content and services currently available. Each device has its typical set of capabilities and characteristics that must be taken into account to create an appropriate user interface that provides interactive access to multimedia data and services. Furthermore, end-users also have their specific requirements that influence the accessibility of data and services for individual access. The approach we present in this paper is geared towards the idea of universal access to interactive multimedia data and services for everyone, independent of the user characteristics or end-user device capabilities. For this purpose we combine user and device models with high-level user interface description languages in order to decouple the interface presentation from its platform, and to generate the most suitable interface on a per-user, per- device basis making use of the semantics that are provided by user and device profile.

[1]  Vittorio Scarano,et al.  Efficient edge-services for colorblind users , 2006, WWW '06.

[2]  Dan R. Olsen,et al.  Cross-modal interaction using XWeb , 2000, UIST '00.

[3]  Jean Vanderdonckt,et al.  Developing User Interfaces with XML: Advances on User Interface Description Language , 2004 .

[4]  Boris Brandherm,et al.  Gumo - The General User Model Ontology , 2005, User Modeling.

[5]  Jonathan Foote,et al.  Discriminative techniques for keyframe selection , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[6]  Stina Nylander,et al.  Ubiquitous service access through adapted user interfaces on multiple devices , 2004, Personal and Ubiquitous Computing.

[7]  Benjamin Michotte,et al.  USIXML: A User Interface Description Language for Context-Sensitive User Interfaces , 2004 .

[8]  Marc Abrams,et al.  UIML: An Appliance-Independent XML User Interface Language , 1999, Comput. Networks.

[9]  Jan Van den Bergh,et al.  Towards modeling context-sensitive interactive applications: the context-sensitive user interface profile (CUP) , 2005, SoftVis '05.

[10]  Shih-Fu Chang,et al.  VisualSEEk: a fully automated content-based image query system , 1997, MULTIMEDIA '96.

[11]  Kris Luyten,et al.  UIML.NET: an Open UIML Renderer for the .Net Framework , 2004, CADUI.

[12]  B. S. Manjunath,et al.  Color and texture descriptors , 2001, IEEE Trans. Circuits Syst. Video Technol..

[13]  Chia-Hung Yeh,et al.  Techniques for movie content analysis and skimming: tutorial and overview on video abstraction techniques , 2006, IEEE Signal Processing Magazine.

[14]  Marcel Worring,et al.  Mediamill: Searching Multimedia Archives Based on Learned Semantics , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[15]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Kris Luyten,et al.  Service-Interaction Descriptions: Augmenting Services with User Interface Models , 2007, EHCI/DS-VIS.

[17]  Krzysztof Z. Gajos,et al.  SUPPLE: automatically generating user interfaces , 2004, IUI '04.

[18]  Kris Luyten,et al.  Profile-aware multi-device interfaces: an MPEG-21-based approach for accessible user interfaces , 2005 .

[19]  Jean Vanderdonckt,et al.  Applying model-based techniques to the development of UIs for mobile computers , 2001, IUI '01.

[20]  Anthony Vetro,et al.  MPEG-21 digital item adaptation: enabling universal multimedia access , 2004, IEEE MultiMedia.

[21]  Shih-Fu Chang,et al.  Overview of the MPEG-7 standard , 2001, IEEE Trans. Circuits Syst. Video Technol..