GFEN: Graph Feature Extract Network for Click-Through Rate Prediction

Click-Through Rate (CTR) is a fundamental task in personalized advertising and recommender systems. It is vital to model different orders feature interactions in click-through rate. There are many proposed methods in this field such as FM and its variants. However, many current methods can not adequately and precisely extract feature interactions. In this paper, we improve an effective light weight method called the Graph Feature Extract Network (GFEN) to further explicitly or implicitly model low-order and high-order feature interactions information via Graph Convolutional Network (GCN) and Global Recombination Network (GRN). GCN explicitly models local high-order feature interactions. GRN automatically captures global high-order feature interactions via the diversity pooling layer and recombines global and local feature interactions via fully connection layer. We conduct extensive experiments on there real-world datasets and show that our model achieves the best performance compared to the existing state-of-the-art methods such as CKE, DKN, Wide&Deep, RippleNet etc. Our proposed GFEN is a very light weight model, which can be applied to other complicate model such as Ripplenet based knowledge graph and deep learning models based CTR. The whole model can be efficiently fit on large-scale raw input feature.

[1]  Yann LeCun,et al.  Very Deep Convolutional Networks for Natural Language Processing , 2016, ArXiv.

[2]  Tat-Seng Chua,et al.  Neural Factorization Machines for Sparse Predictive Analytics , 2017, SIGIR.

[3]  Ralph Grishman,et al.  Graph Convolutional Networks With Argument-Aware Pooling for Event Detection , 2018, AAAI.

[4]  Minyi Guo,et al.  Multi-Task Feature Learning for Knowledge Graph Enhanced Recommendation , 2019, WWW.

[5]  Zhuwen Li,et al.  Combinatorial Optimization with Graph Convolutional Networks and Guided Tree Search , 2018, NeurIPS.

[6]  Patrick P. K. Chan,et al.  Convolutional Neural Networks based Click-Through Rate Prediction with Multiple Feature Sequences , 2018, IJCAI.

[7]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Chang Zhou,et al.  Deep Interest Evolution Network for Click-Through Rate Prediction , 2018, AAAI.

[9]  Steffen Rendle,et al.  Factorization Machines with libFM , 2012, TIST.

[10]  Minyi Guo,et al.  RippleNet: Propagating User Preferences on the Knowledge Graph for Recommender Systems , 2018, CIKM.

[11]  Nicholas Jing Yuan,et al.  Collaborative Knowledge Base Embedding for Recommender Systems , 2016, KDD.

[12]  Yunming Ye,et al.  DeepFM: A Factorization-Machine based Neural Network for CTR Prediction , 2017, IJCAI.

[13]  F. Maxwell Harper,et al.  The MovieLens Datasets: History and Context , 2016, TIIS.

[14]  Jieping Ye,et al.  Deep Multi-View Spatial-Temporal Network for Taxi Demand Prediction , 2018, AAAI.

[15]  Alex Fout,et al.  Protein Interface Prediction using Graph Convolutional Networks , 2017, NIPS.

[16]  Minyi Guo,et al.  DKN: Deep Knowledge-Aware Network for News Recommendation , 2018, WWW.

[17]  Liang Wang,et al.  Fi-GNN: Modeling Feature Interactions via Graph Neural Networks for CTR Prediction , 2019, CIKM.

[18]  Paul Covington,et al.  Deep Neural Networks for YouTube Recommendations , 2016, RecSys.

[19]  Wenpeng Yin,et al.  Multichannel Variable-Size Convolution for Sentence Classification , 2015, CoNLL.

[20]  Bin Liu,et al.  Feature Generation by Convolutional Neural Network for Click-Through Rate Prediction , 2019, WWW.

[21]  Yizhou Sun,et al.  Personalized entity recommendation: a heterogeneous information network approach , 2014, WSDM.

[22]  Guorui Zhou,et al.  Deep Interest Network for Click-Through Rate Prediction , 2017, KDD.

[23]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.

[24]  Heng-Tze Cheng,et al.  Wide & Deep Learning for Recommender Systems , 2016, DLRS@RecSys.

[25]  Xing Xie,et al.  xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems , 2018, KDD.