Visually-Aware Video Recommendation in the Cold Start

Recommender Systems have become essential tools in any modern video-sharing platform. Although, recommender systems have shown to be effective in generating personalized suggestions in video-sharing platforms, however, they suffer from the so-called New Item problem. New item problem, as part of Cold Start problem, happens when a new item is added to the system catalogue and the recommender system has no or little data available for that new item. In such a case, the system may fail to meaningfully recommend the new item to the users. In this paper, we propose a novel recommender system that is based on visual tags, i.e., tags that are automatically annotated to videos based on visual description of the videos. Such visual tags can be used in an extreme cold start situation, where neither any rating, nor any tag is available for the new video. The visual tags could also be used in the moderate cold start situation when the new video might have been annotated with few tags. This type of content features can be extracted automatically without any human involvement and have been shown to be very effective in representing the video content. We have used a large dataset of videos and shown that automatically extracted visual tags can be incorporated into the cold start recommendation process and achieve superior results compared to the recommendation based on human-annotated tags.

[1]  Milind R. Naphade,et al.  A probabilistic framework for semantic video indexing, filtering, and retrieval , 2001, IEEE Trans. Multim..

[2]  Christian Wartena,et al.  Using Tag Co-occurrence for Recommendation , 2009, 2009 Ninth International Conference on Intelligent Systems Design and Applications.

[3]  Francesco Ricci,et al.  A survey of active learning in collaborative filtering recommender systems , 2016, Comput. Sci. Rev..

[4]  Junjun Zhang,et al.  Tag propagation based recommendation across diverse social media , 2014, WWW.

[5]  Mouzhi Ge,et al.  Using Tags and Latent Factors in a Food Recommender System , 2015, Digital Health.

[6]  Jie Fang,et al.  Incorporating Sentiment Analysis for Improved Tag-Based Recommendation , 2011, 2011 IEEE Ninth International Conference on Dependable, Autonomic and Secure Computing.

[7]  Hamed Zamani,et al.  Current challenges and visions in music recommender systems research , 2017, International Journal of Multimedia Information Retrieval.

[8]  Francesco Ricci,et al.  Cold-Start Management with Cross-Domain Collaborative Filtering and Tags , 2013, EC-Web.

[9]  Franca Garzotto,et al.  Toward Effective Movie Recommendations Based on Mise-en-Scène Film Styles , 2015, CHItaly.

[10]  Paolo Cremonesi,et al.  Exploring the Semantic Gap for Movie Recommendations , 2017, RecSys.

[11]  Francesco Ricci,et al.  Prediction of music pairwise preferences from facial expressions , 2019, IUI.

[12]  Marcelo G. Manzato gSVD++: supporting implicit feedback on recommender systems with metadata awareness , 2013, SAC '13.

[13]  Pasquale Lops,et al.  A content-collaborative recommender that exploits WordNet-based user profiles for neighborhood formation , 2007, User Modeling and User-Adapted Interaction.

[14]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[15]  Francesco Ricci,et al.  A Research Tool for User Preferences Elicitation with Facial Expressions , 2017, RecSys.

[16]  Tao Zhou,et al.  Solving the cold-start problem in recommender systems with social tags , 2010 .

[17]  Yehuda Koren,et al.  Advances in Collaborative Filtering , 2011, Recommender Systems Handbook.

[18]  Zhou Su,et al.  What Videos Are Similar with You?: Learning a Common Attributed Representation for Video Recommendation , 2014, ACM Multimedia.

[19]  Farshad Bakhshandegan Moghaddam,et al.  Cold-start solutions for recommendation systems , 2019, Big Data Recommender Systems - Volume 2: Application Paradigms.

[20]  Alberto Signoroni,et al.  Who is the Film's Director? Authorship Recognition Based on Shot Features , 2019, IEEE MultiMedia.