Heterogeneous Recommendation via Deep Low-Rank Sparse Collective Factorization

A real-world recommender usually adopts heterogeneous types of user feedbacks, for example, numerical ratings such as 5-star grades and binary ratings such as likes and dislikes. In this work, we focus on transferring knowledge from binary ratings to numerical ratings, facing a more serious data sparsity problem. Conventional Collective Factorization methods usually assume that there are shared user and item latent factors across multiple related domains, but may ignore the shared common knowledge of rating patterns. Furthermore, existing works may also fail to consider the hierarchical structures in the heterogeneous recommendation scenario (i.e., genre, sub-genre, detailed-category). To address these challenges, in this paper, we propose a novel Deep Low-rank Sparse Collective Factorization (DLSCF) framework for heterogeneous recommendation. Specifically, we adopt low-rank sparse decomposition to capture the common rating patterns in related domains while splitting the domain-specific patterns. We also factorize the model in multiple layers to capture the affiliation relation between latent categories and sub-categories. We propose both batch and Stochastic Gradient Descent (SGD) based optimization algorithms for solving DLSCF. Experimental results on MoviePilot, Netfilx, Flixter, MovieLens10M and MovieLens20M datasets demonstrate the effectiveness of the proposed algorithms, by comparing them with several state-of-the-art batch and SGD based approaches.

[1]  Hao Luo,et al.  Cross-Domain Recommendation via Cluster-Level Latent Factor Model , 2013, ECML/PKDD.

[2]  John Riedl,et al.  Application of Dimensionality Reduction in Recommender System - A Case Study , 2000 .

[3]  Yehuda Koren,et al.  Factor in the neighbors: Scalable and accurate collaborative filtering , 2010, TKDD.

[4]  Huan Liu,et al.  Exploring Implicit Hierarchical Structures for Recommender Systems , 2015, IJCAI.

[5]  George Trigeorgis,et al.  A Deep Semi-NMF Model for Learning Hidden Representations , 2014, ICML.

[6]  Jun Li,et al.  Deep Convolutional Neural Network with Independent Softmax for Large Scale Face Recognition , 2016, ACM Multimedia.

[7]  Iván Cantador,et al.  Exploiting Social Tags in Matrix Factorization Models for Cross-domain Collaborative Filtering , 2014, CBRecSys@RecSys.

[8]  Geoffrey J. Gordon,et al.  Relational learning via collective matrix factorization , 2008, KDD.

[9]  Qiang Yang,et al.  Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence Transfer Learning to Predict Missing Ratings via Heterogeneous User Feedbacks , 2022 .

[10]  Lior Rokach,et al.  Facebook single and cross domain data for recommendation systems , 2013, User Modeling and User-Adapted Interaction.

[11]  Andrea Montanari,et al.  Matrix Completion from Noisy Entries , 2009, J. Mach. Learn. Res..

[12]  Yun Fu,et al.  Low-Rank Common Subspace for Multi-view Learning , 2014, 2014 IEEE International Conference on Data Mining.

[13]  Yun Fu,et al.  Deep Low-rank Sparse Collective Factorization for Cross-Domain Recommendation , 2017, ACM Multimedia.

[14]  Kai Lu,et al.  Exploiting and Exploring Hierarchical Structure in Music Recommendation , 2012, AIRS.

[15]  Min Zhao,et al.  Unifying explicit and implicit feedback for collaborative filtering , 2010, CIKM.

[16]  Bin Cao,et al.  Multi-Domain Collaborative Filtering , 2010, UAI.

[17]  Qiang Yang,et al.  Can Movies and Books Collaborate? Cross-Domain Collaborative Filtering for Sparsity Reduction , 2009, IJCAI.

[18]  Yehuda Koren,et al.  Factorization meets the neighborhood: a multifaceted collaborative filtering model , 2008, KDD.

[19]  Ming Shao,et al.  Consensus Style Centralizing Auto-Encoder for Weak Style Classification , 2016, AAAI.

[20]  Tsvi Kuflik,et al.  Mediation of user models for enhanced personalization in recommender systems , 2007, User Modeling and User-Adapted Interaction.

[21]  Junfeng Yang,et al.  A Fast Algorithm for Edge-Preserving Variational Multichannel Image Restoration , 2009, SIAM J. Imaging Sci..

[22]  Heyan Huang,et al.  Cross-Domain Collaborative Filtering with Review Text , 2015, IJCAI.

[23]  Zhong Ming,et al.  Interaction-Rich Transfer Learning for Collaborative Filtering with Heterogeneous User Feedback , 2014, IEEE Intelligent Systems.

[24]  Geert-Jan Houben,et al.  Cross-system user modeling and personalization on the Social Web , 2013, User Modeling and User-Adapted Interaction.

[25]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[26]  Shan-Hung Wu,et al.  Non-Linear Cross-Domain Collaborative Filtering via Hyper-Structure Transfer , 2015, ICML.

[27]  Yun Fu,et al.  Multi-View Clustering via Deep Matrix Factorization , 2017, AAAI.

[28]  Thomas S. Huang,et al.  Studying Very Low Resolution Recognition Using Deep Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[30]  Roberto Turrin,et al.  Cross-Domain Recommender Systems , 2015, Recommender Systems Handbook.

[31]  Ming Shao,et al.  Deep Robust Encoder Through Locality Preserving Low-Rank Dictionary , 2016, ECCV.

[32]  Shaghayegh Sahebi,et al.  It Takes Two to Tango: An Exploration of Domain Pairs for Cross-Domain Collaborative Filtering , 2015, RecSys.

[33]  Qiang Yang,et al.  Transfer Learning in Collaborative Filtering for Sparsity Reduction , 2010, AAAI.

[34]  Tsvi Kuflik,et al.  Cross social networks interests predictions based ongraph features , 2013, RecSys.

[35]  Paolo Cremonesi,et al.  Cross-domain recommendations without overlapping data: myth or reality? , 2014, RecSys '14.

[36]  Chi-Hoon Lee,et al.  Web personalization expert with combining collaborative filtering and association rule mining technique , 2001, Expert Syst. Appl..

[37]  Qiang Yang,et al.  Transfer learning for collaborative filtering via a rating-matrix generative model , 2009, ICML '09.

[38]  Peter J. Haas,et al.  Large-scale matrix factorization with distributed stochastic gradient descent , 2011, KDD.

[39]  Ming Shao,et al.  Latent Low-Rank Transfer Subspace Learning for Missing Modality Recognition , 2014, AAAI.

[40]  Guy Shani,et al.  TALMUD: transfer learning for multiple domains , 2012, CIKM.

[41]  Guandong Xu,et al.  Personalized recommendation via cross-domain triadic factorization , 2013, WWW.

[42]  Francesco Ricci,et al.  Cold-Start Management with Cross-Domain Collaborative Filtering and Tags , 2013, EC-Web.

[43]  Qiang Yang,et al.  Transfer Learning for Collective Link Prediction in Multiple Heterogenous Domains , 2010, ICML.

[44]  Steven C. H. Hoi,et al.  Online multi-task collaborative filtering for on-the-fly recommender systems , 2013, RecSys.

[45]  Ngoc Thanh Nguyen,et al.  A method for collaborative recommendation using knowledge integration tools and hierarchical structure of user profiles , 2013, Knowl. Based Syst..

[46]  Qiang Yang,et al.  Transfer learning in heterogeneous collaborative filtering domains , 2013, Artif. Intell..