On personalizing Web content through reinforcement learning

Nowadays, a large use of personalization techniques is used to adapt Web content to users’ habits, mainly with the aim of offering appropriate products and services. This paper presents a system that uses personalization and adaptation techniques, in order to transcode or modify contents (e.g., adapt text fonts) so as to meet preferences and needs of elderly users and users with disabilities. Such an adaptation can have a positive effect, in particular for users with some reading-related disabilities (i.e., people with dyslexia, users with low vision, users with color blindness, elderly people.). To avoid issues arising from applying transformations to the whole content, the proposed system uses Web intelligence to perform automatic adaptations on single elements composing a Web page. The transformation is applied on the basis of a reinforcement learning algorithm which manages a user profile. The system is evaluated through simulations and a real assessment, where elderly users where asked to use the system prototype for a time period and to perform some specific tasks. Results of the qualitative evaluation confirm the feasibility of the proposal, showing its validity and the users’ appreciation.

[1]  David Beymer,et al.  An Eye Tracking Study of How Font Size, Font Type, and Pictures Influence Online Reading , 2007 .

[2]  Özgü Can,et al.  User Profiling for Policy Management in Social Communities , 2012, 2012 IEEE 36th Annual Computer Software and Applications Conference.

[3]  Uwe Leimstoll,et al.  Context-Aware Website Personalization , 2011, KES.

[4]  Paola Salomoni,et al.  Exploiting Reinforcement Learning to Profile Users and Personalize Web Pages , 2014, 2014 IEEE 38th International Computer Software and Applications Conference Workshops.

[5]  Chris Watkins,et al.  Learning from delayed rewards , 1989 .

[6]  Krzysztof Z. Gajos,et al.  Automatically generating personalized user interfaces with Supple , 2010, Artif. Intell..

[7]  Jakob Nielsen,et al.  A mathematical model of the finding of usability problems , 1993, INTERCHI.

[8]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[9]  Marco Roccetti,et al.  Custom E-Learning Experiences: Working with Profiles for Multiple Content Sources Access and Adaptation , 2009 .

[10]  Ricardo Baeza-Yates,et al.  DysWebxia 2.0!: more accessible text for people with dyslexia , 2013, W4A.

[11]  Vincent P. Wade,et al.  Towards Cross Site Personalisation , 2013, 2013 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT).

[12]  Marc Torrent-Moreno,et al.  Enhancing accessibility: Mobile to ATM case study , 2012, 2012 IEEE Consumer Communications and Networking Conference (CCNC).

[13]  Peter Dayan,et al.  Technical Note: Q-Learning , 2004, Machine Learning.

[14]  Agata Filipowska,et al.  Scalable Adaptation of Web Applications to Users' Behavior , 2012, ICCCI.

[15]  Michael L. Bernard,et al.  The effects of font type and size on the legibility and reading time of online text by older adults , 2001, CHI Extended Abstracts.

[16]  Renata Pontin de Mattos Fortes,et al.  Adapting Web content for low-literacy readers by using lexical elaboration and named entities labeling , 2010, New Rev. Hypermedia Multim..

[17]  Shoshana Loeb,et al.  Fluid user models for personalized mobile apps Overview of the BrightNotes™ system , 2013, 2013 IEEE 10th Consumer Communications and Networking Conference (CCNC).

[18]  Gordon E. Legge,et al.  Psychophysics of Reading in Normal and Low Vision , 2006 .

[19]  Andy Brown,et al.  Audio access to calendars , 2010, W4A.

[20]  Franziska Klügl-Frohnmeyer,et al.  PROGRAMMING AGENT BEHAVIOR BY LEARNING IN SIMULATION MODELS , 2012, Appl. Artif. Intell..

[21]  Patrick Langdon,et al.  Investigating the Accessibility of Program Selection Menus of a Digital TV Interface , 2011, HCI.

[22]  Ricardo Baeza-Yates,et al.  Layout guidelines for web text and a web service to improve accessibility for dyslexics , 2012, W4A.

[23]  M. Tinker Legibility of print , 1963 .

[24]  Balaraman Ravindran,et al.  Personalized Web-page Rendering System , 2008, COMAD.

[25]  Paola Salomoni,et al.  User centered and context dependent personalization through experiential transcoding , 2014, 2014 IEEE 11th Consumer Communications and Networking Conference (CCNC).

[26]  Enrico Rukzio,et al.  Investigating selection and reading performance on a mobile phone while walking , 2010, Mobile HCI.

[27]  Vasant Honavar,et al.  Preference Based Service Adaptation Using Service Substitution , 2013, 2013 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT).

[28]  Marco Roccetti,et al.  Profiling learners with special needs for custom e-learning experiences, a closed case? , 2007, W4A '07.

[29]  J. Graham Strong,et al.  The Legibility of Typefaces for Readers with Low Vision: A Research Review , 2007 .

[30]  Shawn Lawton Henry,et al.  Developing Text Customisation Functionality Requirements of PDF Reader and Other User Agents , 2012, ICCHP.

[31]  Wanlei Zhou,et al.  Learning User Preference Patterns for Top-N Recommendations , 2012, 2012 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology.

[32]  Paola Salomoni,et al.  Experiential Adaptation to Provide User-Centered Web Content Personalization , 2013 .

[33]  Yeliz Yesilada,et al.  Experiential transcoding: an EyeTracking approach , 2013, W4A.

[34]  David Beymer,et al.  An eye tracking study of how font size and type influence online reading , 2008 .