Deep User Match Network for Click-Through Rate Prediction

Click-through rate (CTR) prediction is a crucial task in many applications (e.g. recommender systems). Recently deep learning based models have been proposed and successfully applied for CTR prediction by focusing on feature interaction or user interest based on the item-to-item relevance between user behaviors and candidate item. However, these existing models neglect the user-to-user relevance between the target user and those who like the candidate item, which can reflect the preference of target user. To this end, in this paper, we propose a novel Deep User Match Network (DUMN) which measures the user-to-user relevance for CTR prediction. Specifically, in DUMN, we design a User Representation Layer to learn a unified user representation which contains user latent interest based on user behaviors. Then, User Match Layer is designed to measure the user-to-user relevance by matching the target user and those who have interacted with candidate item and modeling their similarities in user representation space. Extensive experimental results on three public real-world datasets validate the effectiveness of DUMN compared with state-of-the-art methods.

[1]  Xing Xie,et al.  xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems , 2018, KDD.

[2]  Yunming Ye,et al.  DeepFM: A Factorization-Machine based Neural Network for CTR Prediction , 2017, IJCAI.

[3]  Wen Jiang,et al.  Deep Multi-Interest Network for Click-through Rate Prediction , 2020, CIKM.

[4]  Enhong Chen,et al.  An Ad CTR Prediction Method Based on Feature Learning of Deep and Shallow Layers , 2017, CIKM.

[5]  Chao Wang,et al.  Deep Time-Aware Item Evolution Network for Click-Through Rate Prediction , 2020, CIKM.

[6]  Yehuda Koren,et al.  Factorization meets the neighborhood: a multifaceted collaborative filtering model , 2008, KDD.

[7]  Enhong Chen,et al.  Sparse Factorization Machines for Click-through Rate Prediction , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[8]  Alejandro Bellogín,et al.  Neighbor Selection and Weighting in User-Based Collaborative Filtering: A Performance Prediction Approach , 2014, TWEB.

[9]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[10]  Enhong Chen,et al.  XCrossNet: Feature Structure-Oriented Learning for Click-Through Rate Prediction , 2021, PAKDD.

[11]  Enhong Chen,et al.  Collaborative List-and-Pairwise Filtering From Implicit Feedback , 2022, IEEE Transactions on Knowledge and Data Engineering.

[12]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.

[13]  Heng-Tze Cheng,et al.  Wide & Deep Learning for Recommender Systems , 2016, DLRS@RecSys.

[14]  Enhong Chen,et al.  Multi-Interactive Attention Network for Fine-grained Feature Learning in CTR Prediction , 2021, WSDM.

[15]  Weiqing Wang,et al.  Online User Representation Learning Across Heterogeneous Social Networks , 2019, SIGIR.

[16]  Jun Wang,et al.  Product-Based Neural Networks for User Response Prediction , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[17]  Rómer Rosales,et al.  Simple and Scalable Response Prediction for Display Advertising , 2014, ACM Trans. Intell. Syst. Technol..

[18]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[19]  Tat-Seng Chua,et al.  Neural Factorization Machines for Sparse Predictive Analytics , 2017, SIGIR.

[20]  Qiang Liu,et al.  TFNet: Multi-Semantic Feature Interaction for CTR Prediction , 2020, SIGIR.

[21]  Martin Wattenberg,et al.  Ad click prediction: a view from the trenches , 2013, KDD.

[22]  Alexandros Karatzoglou,et al.  Session-based Recommendations with Recurrent Neural Networks , 2015, ICLR.

[23]  Guorui Zhou,et al.  Deep Interest Network for Click-Through Rate Prediction , 2017, KDD.

[24]  Chengfu Huo,et al.  Deep Match to Rank Model for Personalized Click-Through Rate Prediction , 2020, AAAI.

[25]  Chang Zhou,et al.  Deep Interest Evolution Network for Click-Through Rate Prediction , 2018, AAAI.

[26]  Jie Gu,et al.  Exploiting Behavioral Consistence for Universal User Representation , 2020, AAAI.