Enhancing Recommender Systems for TV by Face Recognition

Recommender systems have proven their usefulness as a tool to cope with the information overload problem for many online services offering movies, books, or music. Recommender systems rely on identifying individual users and deducing their preferences from the feedback they provide on the content. To automate this user identification and feedback process for TV applications, we propose a solution based on face detection and recognition services. These services output useful information such as an estimation of the age, the gender, and the mood of the person. Demographic characteristics (age and gender) are used to classify the user and cope with the cold start problem. Detected smiles and emotions are used as an automatic feedback mechanism during content consumption. Accurate results are obtained in case of a frontal view of the face. Head poses deviating from a frontal view and suboptimal illumination conditions may hinder face detection and recognition, especially if parts of the face, such as eyes or mouth are not sufficiently visible.

[1]  Joemon M. Jose,et al.  Integrating facial expressions into user profiling for the improvement of a multimodal recommender system , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[2]  Jie Deng,et al.  Emotion-based music retrieval and recommendation , 2014 .

[3]  David J. Kriegman,et al.  The yale face database , 1997 .

[4]  Takeo Kanade,et al.  The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[5]  Suh-Yin Lee,et al.  Emotion-based music recommendation by association discovery from film music , 2005, MULTIMEDIA '05.

[6]  Toon De Pessemier,et al.  Comparison of group recommendation algorithms , 2014, Multimedia Tools and Applications.

[7]  Paul Resnick,et al.  Recommender systems , 1997, CACM.

[8]  Toon De Pessemier,et al.  Context-aware recommendations through context and activity recognition in a mobile environment , 2014, Multimedia Tools and Applications.

[9]  Marko Tkalcic,et al.  Using affective parameters in a content-based recommender system for images , 2010, User Modeling and User-Adapted Interaction.