Improving Recommendations by Embedding Multi-Entity Relationships With Latent Dual-Metric Learning

Recently, latent vector embedding has become a research hotspot, with its great representative ability to measure the latent relationships among different views. However, most researches utilize the inner product of latent vectors as the representation of relationships, and they develop some embedding models based on this theory. In this paper, we take deep insight into the existing embedding models and find that utilizing the inner product may increase several problems: 1) in latent space, the inner product among three vectors may violate triangle principle; 2) the inner product cannot measure the relationships between vectors in the same category, such as user and user and item and item; and 3) the inner product cannot catch the collaborative relationships (user–user and item–item) for collaborative filtering. Along with this line, we propose a latent vector embedding model for collaborative filtering: latent dual metric embedding (LDME), which utilizes the dual-Euclidean distance in latent space, instead of the inner product, to represent different types of relationships (user–user, item–item, and user–item) with a uniform framework. Specifically, we design an embedding loss function in LDME, which can measure the close and remote relationships between entities, tackle the above problems, and achieve a more clear, well-explained embedding result. Extensive experiments are conducted on several real-world datasets (Amazon, Yelp, Taobao, and Jingdong), where the expiring results demonstrate that LDME can overperform some state-of-the-art user–item embedding models and can benefit the existing collaborative filtering models.

[1]  Qiang Yang,et al.  One-Class Collaborative Filtering , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[2]  Jiawei Han,et al.  Bridging Collaborative Filtering and Semi-Supervised Learning: A Neural Approach for POI Recommendation , 2017, KDD.

[3]  Dongwon Lee,et al.  “Told you i didn't like it”: Exploiting uninteresting items for effective collaborative filtering , 2016, 2016 IEEE 32nd International Conference on Data Engineering (ICDE).

[4]  Wenge Rong,et al.  A Social Recommender Based on Factorization and Distance Metric Learning , 2017, IEEE Access.

[5]  Xing Xie,et al.  CCCFNet: A Content-Boosted Collaborative Filtering Neural Network for Cross Domain Recommender Systems , 2017, WWW.

[6]  Pong C. Yuen,et al.  Semi-supervised Region Metric Learning for Person Re-identification , 2018, International Journal of Computer Vision.

[7]  Michael R. Lyu,et al.  Geo-Teaser: Geo-Temporal Sequential Embedding Rank for POI Recommendation , 2018 .

[8]  Qi Wang,et al.  Locality constraint distance metric learning for traffic congestion detection , 2018, Pattern Recognit..

[9]  Xiangnan He,et al.  Attentive Collaborative Filtering: Multimedia Recommendation with Item- and Component-Level Attention , 2017, SIGIR.

[10]  Jing Huang,et al.  Interpretable Convolutional Neural Networks with Dual Local and Global Attention for Review Rating Prediction , 2017, RecSys.

[11]  Dong Wang,et al.  Robust Distance Metric Learning via Bayesian Inference , 2018, IEEE Transactions on Image Processing.

[12]  Yan Wang,et al.  Burg Matrix Divergence-Based Hierarchical Distance Metric Learning for Binary Classification , 2017, IEEE Access.

[13]  Yuan Jiang,et al.  Fast generalization rates for distance metric learning , 2018, Machine Learning.

[14]  Robert Tibshirani,et al.  The Elements of Statistical Learning , 2001 .

[15]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[16]  Naren Ramakrishnan,et al.  A Gradient-based Adaptive Learning Framework for Efficient Personal Recommendation , 2017, RecSys.

[17]  Michael Luca,et al.  Fake It Till You Make It: Reputation, Competition, and Yelp Review Fraud , 2015 .

[18]  Tat-Seng Chua,et al.  Neural Collaborative Filtering , 2017, WWW.

[19]  Lei Zheng,et al.  Joint Deep Modeling of Users and Items Using Reviews for Recommendation , 2017, WSDM.

[20]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[21]  Yong Cheng,et al.  Directional Illumination Estimation Sets and Multilevel Matching Metric for Illumination-Robust Face Recognition , 2017, IEEE Access.

[22]  Xin Du,et al.  Distributed Semi-Supervised Metric Learning , 2016, IEEE Access.

[23]  Tie Liu,et al.  Convex clustering with metric learning , 2018, Pattern Recognit..

[24]  Hui Xiong,et al.  Sequential Recommender System based on Hierarchical Attention Networks , 2018, IJCAI.

[25]  Jiwen Lu,et al.  Deep transfer metric learning , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Haiping Xu,et al.  Automatic topic discovery of online hospital reviews using an improved LDA with Variational Gibbs Sampling , 2017, 2017 IEEE International Conference on Big Data (Big Data).

[27]  F. Maxwell Harper,et al.  The MovieLens Datasets: History and Context , 2016, TIIS.

[28]  Nicholas Jing Yuan,et al.  Representation Learning with Pair-wise Constraints for Collaborative Ranking , 2017, WSDM.

[29]  Deborah Estrin,et al.  Collaborative Metric Learning , 2017, WWW.

[30]  David Zhang,et al.  Distance Metric Learning via Iterated Support Vector Machines , 2017, IEEE Transactions on Image Processing.

[31]  Jun Zhang,et al.  A Neural Collaborative Filtering Model with Interaction-based Neighborhood , 2017, CIKM.

[32]  Dechang Pi,et al.  Metric Learning Combining With Boosting for User Distance Measure in Multiple Social Networks , 2017, IEEE Access.

[33]  En Wang,et al.  Improving Existing Collaborative Filtering Recommendations via Serendipity-Based Algorithm , 2018, IEEE Transactions on Multimedia.