ETCF: An Ensemble Model for CTR Prediction

Online advertising has attracted lots of attention in both academic and industrial domains. Among many realworld advertising systems, click through rate (CTR) prediction plays a central role. With a large volume of user history log and given its various features, it is quite a challenge to fully extract the meaningful information inside that amount of data. What's more, for many machine learning models, in order to achieve the best performance of the CTR prediction, a lot of hyper-parameters need to be tuned, which often costs plenty of time. In this paper, we propose an ensemble model named ETCF, which cascades GBDT with gcForest to tackle the practical problems of CTR prediction and do not need much hyper-parameter tuning work to realize its best performance. Experimental results validate the effective prediction power of ETCF against classical baseline models, and the superiority of GBDT transformed features.

[1]  Joaquin Quiñonero Candela,et al.  Web-Scale Bayesian Click-Through rate Prediction for Sponsored Search Advertising in Microsoft's Bing Search Engine , 2010, ICML.

[2]  Zoran Obradovic,et al.  Embedding Technical Analysis Into Neural Network Based Trading Systems , 1996, Appl. Artif. Intell..

[3]  Dumitru Erhan,et al.  Deep Neural Networks for Object Detection , 2013, NIPS.

[4]  Joaquin Quiñonero Candela,et al.  Practical Lessons from Predicting Clicks on Ads at Facebook , 2014, ADKDD'14.

[5]  Dong Wang,et al.  Click-through Prediction for Advertising in Twitter Timeline , 2015, KDD.

[6]  Weiwei Deng,et al.  Model Ensemble for Click Prediction in Bing Search Ads , 2017, WWW.

[7]  Gang Fu,et al.  Deep & Cross Network for Ad Click Predictions , 2017, ADKDD@KDD.

[8]  Palash Goyal,et al.  Graph Embedding Techniques, Applications, and Performance: A Survey , 2017, Knowl. Based Syst..

[9]  Tara N. Sainath,et al.  Deep convolutional neural networks for LVCSR , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[10]  Jiajun Zhang,et al.  Deep Neural Networks in Machine Translation: An Overview , 2015, IEEE Intelligent Systems.

[11]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[12]  Yunming Ye,et al.  DeepFM: A Factorization-Machine based Neural Network for CTR Prediction , 2017, IJCAI.

[13]  Guorui Zhou,et al.  Deep Interest Network for Click-Through Rate Prediction , 2017, KDD.

[14]  Robert P. Sheridan,et al.  Random Forest: A Classification and Regression Tool for Compound Classification and QSAR Modeling , 2003, J. Chem. Inf. Comput. Sci..

[15]  Hongtao Lu,et al.  Deep CTR Prediction in Display Advertising , 2016, ACM Multimedia.

[16]  Yukihiro Tagami,et al.  CTR prediction for contextual advertising: learning-to-rank approach , 2013, ADKDD '13.

[17]  Zhaohui Zheng,et al.  Stochastic gradient boosted distributed decision trees , 2009, CIKM.

[18]  Ji Feng,et al.  Deep Forest: Towards An Alternative to Deep Neural Networks , 2017, IJCAI.

[19]  Ilya Trofimov,et al.  Using boosted trees for click-through rate prediction for sponsored search , 2012, ADKDD '12.

[20]  Martin Wattenberg,et al.  Ad click prediction: a view from the trenches , 2013, KDD.

[21]  Alexander Kolesnikov,et al.  Predicting CTR of new ads via click prediction , 2012, CIKM '12.

[22]  Sungjin Lee,et al.  Joint Embedding of Query and Ad by Leveraging Implicit Feedback , 2015, EMNLP.