Social regularized von Mises–Fisher mixture model for item recommendation

Collaborative filtering (CF) is a widely used technique to guide the users of web applications towards items that might interest them. CF approaches are severely challenged by the characteristics of user-item preference matrices, which are often high dimensional and extremely sparse. Recently, several works have shown that incorporating information from social networks—such as friendship and trust relationships—into traditional CF alleviates the sparsity related issues and yields a better recommendation quality, in most cases. More interestingly, even with comparable performances, social-based CF is more beneficial than traditional CF; the former makes it possible to provide recommendations for cold start users. In this paper, we propose a novel model that leverages information from social networks to improve recommendations. While existing social CF models are based on popular modelling assumptions such as Gaussian or Multinomial, our model builds on the von Mises–Fisher assumption which turns out to be more adequate, than the aforementioned assumptions, for high dimensional sparse data. Setting the estimate of the model parameters under the maximum likelihood approach, we derive a scalable learning algorithm for analyzing data with our model. Empirical results on several real-world datasets provide strong support for the advantages of the proposed model.

[1]  Xiaojin Zhu,et al.  Harmonic mixtures: combining mixture models and graph-based methods for inductive and scalable semi-supervised learning , 2005, ICML.

[2]  Greg Linden,et al.  Amazon . com Recommendations Item-to-Item Collaborative Filtering , 2001 .

[3]  J. Bobadilla,et al.  Recommender systems survey , 2013, Knowl. Based Syst..

[4]  Bryan Silverthorn,et al.  Spherical Topic Models , 2010, ICML.

[5]  Inderjit S. Dhillon,et al.  Information-theoretic co-clustering , 2003, KDD '03.

[6]  Jiming Liu,et al.  Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence Social Collaborative Filtering by Trust , 2022 .

[7]  Martin Ester,et al.  A matrix factorization technique with trust propagation for recommendation in social networks , 2010, RecSys '10.

[8]  Suvrit Sra,et al.  A short note on parameter approximation for von Mises-Fisher distributions: and a fast implementation of Is(x) , 2012, Comput. Stat..

[9]  Mohamed Nadif,et al.  Model-based Co-clustering for High Dimensional Sparse Data , 2016, AISTATS.

[10]  Mohamed Nadif,et al.  Co-clustering , 2013, Encyclopedia of Database Systems.

[11]  Gérard Govaert,et al.  Mutual information, phi-squared and model-based co-clustering for contingency tables , 2018, Adv. Data Anal. Classif..

[12]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[13]  Inderjit S. Dhillon,et al.  Concept Decompositions for Large Sparse Text Data Using Clustering , 2004, Machine Learning.

[14]  Shin Ishii,et al.  Parameter estimation for von Mises–Fisher distributions , 2007, Comput. Stat..

[15]  Deng Cai,et al.  Topic modeling with network regularization , 2008, WWW.

[16]  Tina Eliassi-Rad,et al.  A Probabilistic Model for Using Social Networks in Personalized Item Recommendation , 2015, RecSys.

[17]  Yehuda Koren,et al.  Factorization meets the neighborhood: a multifaceted collaborative filtering model , 2008, KDD.

[18]  Daniel Thalmann,et al.  ETAF: An extended trust antecedents framework for trust prediction , 2014, 2014 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM 2014).

[19]  Nicola Barbieri,et al.  Probabilistic Approaches to Recommendations , 2014, Probabilistic Approaches to Recommendations.

[20]  John Riedl,et al.  Application of Dimensionality Reduction in Recommender System - A Case Study , 2000 .

[21]  Nello Cristianini,et al.  Machine Learning and Knowledge Discovery in Databases (ECML PKDD) , 2010 .

[22]  Yiming Yang,et al.  Von Mises-Fisher Clustering Models , 2014, ICML.

[23]  Hady Wirawan Lauw,et al.  Semantic visualization for spherical representation , 2014, KDD.

[24]  Neil Yorke-Smith,et al.  TrustSVD: Collaborative Filtering with Both the Explicit and Implicit Influence of User Trust and of Item Ratings , 2015, AAAI.

[25]  Christian Posse,et al.  Workshop on recommendation utility evaluation: beyond RMSE -- RUE 2012 , 2012, RecSys.

[26]  Michael R. Lyu,et al.  SoRec: social recommendation using probabilistic matrix factorization , 2008, CIKM '08.

[27]  P. Deb Finite Mixture Models , 2008 .

[28]  Inderjit S. Dhillon,et al.  Clustering on the Unit Hypersphere using von Mises-Fisher Distributions , 2005, J. Mach. Learn. Res..

[29]  Hui Tian,et al.  A new user similarity model to improve the accuracy of collaborative filtering , 2014, Knowl. Based Syst..

[30]  Dean P. Foster,et al.  Clustering Methods for Collaborative Filtering , 1998, AAAI 1998.

[31]  Huan Liu,et al.  mTrust: discerning multi-faceted trust in a connected world , 2012, WSDM '12.

[32]  Roberto Turrin,et al.  Performance of recommender algorithms on top-n recommendation tasks , 2010, RecSys '10.

[33]  Chao Liu,et al.  Recommender systems with social regularization , 2011, WSDM '11.

[34]  Jiawei Han,et al.  Modeling hidden topics on document manifold , 2008, CIKM '08.

[35]  Mohamed Nadif,et al.  Stochastic Co-clustering for Document-Term Data , 2016, SDM.

[36]  Julien Delporte,et al.  Socially Enabled Preference Learning from Implicit Feedback Data , 2013, ECML/PKDD.

[37]  Daniele Loiacono,et al.  An analysis of the 2014 RecSys Challenge , 2014, RecSysChallenge '14.

[38]  Michael R. Lyu,et al.  Learning to recommend with social trust ensemble , 2009, SIGIR.

[39]  Hujun Bao,et al.  Laplacian Regularized Gaussian Mixture Model for Data Clustering , 2011, IEEE Transactions on Knowledge and Data Engineering.

[40]  Neil Yorke-Smith,et al.  A Novel Bayesian Similarity Measure for Recommender Systems , 2013, IJCAI.

[41]  G. McLachlan,et al.  The EM algorithm and extensions , 1996 .

[42]  Gérard Govaert,et al.  Model-Based Co-clustering for Continuous Data , 2010, 2010 Ninth International Conference on Machine Learning and Applications.

[43]  Mohamed Nadif,et al.  A dynamic collaborative filtering system via a weighted clustering approach , 2016, Neurocomputing.

[44]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[45]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[46]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[47]  G. McLachlan,et al.  Extensions of the EM Algorithm , 2007 .

[48]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .