Research on CTR Prediction Based on Deep Learning

Click-through rate (CTR) prediction is critical in Internet advertising and affects web publisher’s profits and advertiser’s payment. In the CTR prediction, the interaction between features is a key factor affecting the prediction rate. The traditional method of obtaining features using feature extraction did not consider the sparseness of advertising data and the highly nonlinear association between features. To reduce the sparseness of data and to mine the hidden features in advertising data, a method that learns the sparse features is proposed. Our method exploits dimension reduction based on decomposition and combines the power of field-aware factorization machines and deep learning to portray the nonlinear associated relationship of data to solve the sparse feature learning problem. The experiment shows that our method improves the effect of CTR prediction and produces economic benefits in Internet advertising.

[1]  Xuerui Wang,et al.  Click-Through Rate Estimation for Rare Events in Online Advertising , 2011 .

[2]  Ilya Trofimov,et al.  Using Neural Networks for Click Prediction of Sponsored Search , 2014, ArXiv.

[3]  Yonghui Song,et al.  A New Deep-Q-Learning-Based Transmission Scheduling Mechanism for the Cognitive Internet of Things , 2018, IEEE Internet of Things Journal.

[4]  Dong Yu,et al.  Deep Crossing: Web-Scale Modeling without Manually Crafted Combinatorial Features , 2016, KDD.

[5]  Erick Cantú-Paz,et al.  Personalized click prediction in sponsored search , 2010, WSDM '10.

[6]  Jun Wang,et al.  Deep Learning over Multi-field Categorical Data - - A Case Study on User Response Prediction , 2016, ECIR.

[7]  Wang Jun,et al.  Product-Based Neural Networks for User Response Prediction , 2016 .

[8]  Maurice K. Wong,et al.  Algorithm AS136: A k-means clustering algorithm. , 1979 .

[9]  Hongtao Lu,et al.  Deep CTR Prediction in Display Advertising , 2016, ACM Multimedia.

[10]  Joaquin Quiñonero Candela,et al.  Web-Scale Bayesian Click-Through rate Prediction for Sponsored Search Advertising in Microsoft's Bing Search Engine , 2010, ICML.

[11]  Gitta Kutyniok,et al.  A Mathematical Framework for Feature Selection from Real-World Data with Non-Linear Observations , 2016, ArXiv.

[12]  Syed Abbas Ali,et al.  Click Through Rate Prediction for Contextual Advertisment Using Linear Regression , 2017, ArXiv.

[13]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[14]  Tamara G. Kolda,et al.  Scalable Tensor Decompositions for Multi-aspect Data Mining , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[15]  Qiang Yang,et al.  Personalized click model through collaborative filtering , 2012, WSDM '12.

[16]  Rohit Kumar,et al.  Predicting clicks: CTR estimation of advertisements using Logistic Regression classifier , 2015, 2015 IEEE International Advance Computing Conference (IACC).

[17]  Pawel Misiorek,et al.  Tensor-Based Modeling of Temporal Features for Big Data CTR Estimation , 2017, BDAS.

[18]  Zhou Ao.  Computational Advertising:A Data-Centric Comprehensive Web Application , 2011 .

[19]  Chong Zhao,et al.  A New Approach for Mobile Advertising Click-Through Rate Estimation Based on Deep Belief Nets , 2017, Comput. Intell. Neurosci..

[20]  Joaquin Quiñonero Candela,et al.  Practical Lessons from Predicting Clicks on Ads at Facebook , 2014, ADKDD'14.

[21]  Lars Schmidt-Thieme,et al.  Pairwise interaction tensor factorization for personalized tag recommendation , 2010, WSDM '10.

[22]  Feng Yu,et al.  A Convolutional Click Prediction Model , 2015, CIKM.

[23]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.

[24]  Heng-Tze Cheng,et al.  Wide & Deep Learning for Recommender Systems , 2016, DLRS@RecSys.

[25]  Chih-Jen Lin,et al.  A Learning-Rate Schedule for Stochastic Gradient Methods to Matrix Factorization , 2015, PAKDD.

[26]  Martin Wattenberg,et al.  Ad click prediction: a view from the trenches , 2013, KDD.

[27]  Olivier Chapelle,et al.  Modeling delayed feedback in display advertising , 2014, KDD.

[28]  Geoffrey E. Hinton,et al.  Autoencoders, Minimum Description Length and Helmholtz Free Energy , 1993, NIPS.

[29]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[30]  Lei Guo,et al.  Traffic Matrix Prediction and Estimation Based on Deep Learning for Data Center Networks , 2016, 2016 IEEE Globecom Workshops (GC Wkshps).

[31]  Jeong-Yoon Lee,et al.  Ensemble of Collaborative Filtering and Feature Engineered Models for Click Through Rate Prediction , 2012 .

[32]  Zhan Li,et al.  Valid data based normalized cross-correlation (VDNCC) for topography identification , 2018, Neurocomputing.

[33]  Rómer Rosales,et al.  Simple and Scalable Response Prediction for Display Advertising , 2014, ACM Trans. Intell. Syst. Technol..

[34]  Yunming Ye,et al.  DeepFM: A Factorization-Machine based Neural Network for CTR Prediction , 2017, IJCAI.

[35]  Matthew Richardson,et al.  Predicting clicks: estimating the click-through rate for new ads , 2007, WWW '07.