Robust Representations for Response Prediction

Measuring the performance of display advertising is an important problem in estimating campaign effectiveness and understanding user behaviors. The two key performance indicators are the click-through rates (CTR) of the ads and conversion rates (CVR) on the advertisers website. Existing approaches for conversion prediction and for click prediction usually look at the two problems in isolation. However there is considerable benefit in jointly solving the problems as the two goals are often intertwined. In this chapter, we aim to predict the conversion response of the users by jointly examining the past purchase behavior and the click response behavior. To achieve this, we explicitly model the temporal dynamics between the click response and purchase activity into a unified framework. More specifically, we propose a novel matrix factorization approach named the dynamic collective matrix factorization (DCMF) to address this problem. Our model considers temporal dynamics of post-click conversions and also takes advantages of the side information of users, advertisements, and items. An efficient optimization algorithm based on stochastic gradient descent is presented in the chapter. We further show that our approach can be used to measure the effectiveness of advertisements. Our approach and several representative baselines are evaluated on a public dataset and a real-world marketing dataset. Extensive experimental results demonstrate that our model achieves significant improvements over the baselines.

[1]  Yehuda Koren,et al.  Factor in the neighbors: Scalable and accurate collaborative filtering , 2010, TKDD.

[2]  Jun Wang,et al.  Real-Time Bidding Based Display Advertising: Mechanisms and Algorithms , 2016, ECIR.

[3]  Ee-Peng Lim,et al.  Modeling Temporal Adoptions Using Dynamic Matrix Factorization , 2013, 2013 IEEE 13th International Conference on Data Mining.

[4]  David Lo,et al.  Predicting response in mobile advertising with hierarchical importance-aware factorization machine , 2014, WSDM.

[5]  Joaquin Quiñonero Candela,et al.  Web-Scale Bayesian Click-Through rate Prediction for Sponsored Search Advertising in Microsoft's Bing Search Engine , 2010, ICML.

[6]  Juan-Zi Li,et al.  Typicality-Based Collaborative Filtering Recommendation , 2014, IEEE Transactions on Knowledge and Data Engineering.

[7]  Max Welling,et al.  Bayesian Matrix Factorization with Side Information and Dirichlet Process Mixtures , 2010, AAAI.

[8]  Vikas Sindhwani,et al.  Learning evolving and emerging topics in social media: a dynamic nmf approach with temporal regularization , 2012, WSDM '12.

[9]  Tie-Yan Liu,et al.  Relational click prediction for sponsored search , 2012, WSDM '12.

[10]  Mark Goadrich,et al.  The relationship between Precision-Recall and ROC curves , 2006, ICML.

[11]  Yong Yu,et al.  SVDFeature: a toolkit for feature-based collaborative filtering , 2012, J. Mach. Learn. Res..

[12]  Lars Schmidt-Thieme,et al.  Collective Matrix Factorization of Predictors, Neighborhood and Targets for Semi-supervised Classification , 2014, PAKDD.

[13]  Alexandros Nanopoulos,et al.  Repeat Consumption Recommendation Based on Users Preference Dynamics and Side Information , 2015, WWW.

[14]  Alexander J. Smola,et al.  Scalable hierarchical multitask learning algorithms for conversion optimization in display advertising , 2014, WSDM.

[15]  Nicolas Kourtellis,et al.  Dynamic Matrix Factorization with Priors on Unknown Values , 2015, KDD.

[16]  Yehuda Koren,et al.  Collaborative filtering with temporal dynamics , 2009, KDD.

[17]  Ram Akella,et al.  Measuring the effectiveness of display advertising: a time series approach , 2011, WWW.

[18]  Seungjin Choi,et al.  Scalable Variational Bayesian Matrix Factorization with Side Information , 2014, AISTATS.

[19]  Yun Fu,et al.  Matching via Dimensionality Reduction for Estimation of Treatment Effects in Digital Marketing Campaigns , 2016, IJCAI.

[20]  Chih-Jen Lin,et al.  A fast parallel SGD for matrix factorization in shared memory systems , 2013, RecSys.

[21]  Deepak Agarwal,et al.  GLMix: Generalized Linear Mixed Models For Large-Scale Response Prediction , 2016, KDD.

[22]  Xindong Wu,et al.  Cross-Domain Collaborative Filtering over Time , 2011, IJCAI.

[23]  Michael K. Ng,et al.  Robust and Non-Negative Collective Matrix Factorization for Text-to-Image Transfer Learning , 2015, IEEE Transactions on Image Processing.

[24]  Richang Hong,et al.  A Spatial-Temporal Probabilistic Matrix Factorization Model for Point-of-Interest Recommendation , 2016, SDM.

[25]  Yiqun Liu,et al.  Incorporating Non-sequential Behavior into Click Models , 2015, SIGIR.

[26]  Guandong Xu,et al.  Personalized recommendation via cross-domain triadic factorization , 2013, WWW.

[27]  Rómer Rosales,et al.  Simple and Scalable Response Prediction for Display Advertising , 2014, ACM Trans. Intell. Syst. Technol..

[28]  Geoffrey J. Gordon,et al.  Relational learning via collective matrix factorization , 2008, KDD.

[29]  Matthew Richardson,et al.  Predicting clicks: estimating the click-through rate for new ads , 2007, WWW '07.

[30]  Deepak Agarwal,et al.  Spatio-temporal models for estimating click-through rate , 2009, WWW '09.

[31]  R. Srikant,et al.  Collaborative filtering with information-rich and information-sparse entities , 2014, Machine Learning.

[32]  Jun Wang,et al.  Deep Learning over Multi-field Categorical Data - - A Case Study on User Response Prediction , 2016, ECIR.

[33]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[34]  Geoffrey J. Gordon,et al.  A Bayesian Matrix Factorization Model for Relational Data , 2010, UAI.

[35]  Ahmet Bulut,et al.  TopicMachine: Conversion Prediction in Search Advertising Using Latent Topic Models , 2014, IEEE Transactions on Knowledge and Data Engineering.

[36]  Steffen Rendle,et al.  Factorization Machines with libFM , 2012, TIST.

[37]  Rómer Rosales,et al.  Post-click conversion modeling and analysis for non-guaranteed delivery display advertising , 2012, WSDM '12.

[38]  Yun Fu,et al.  Predicting User Behavior in Display Advertising via Dynamic Collective Matrix Factorization , 2015, SIGIR.

[39]  Olivier Chapelle,et al.  Offline Evaluation of Response Prediction in Online Advertising Auctions , 2015, WWW.

[40]  Sachin Garg,et al.  Response prediction using collaborative filtering with hierarchies and side-information , 2011, KDD.

[41]  Makoto Yamada,et al.  Consistent Collective Matrix Completion under Joint Low Rank Structure , 2014, AISTATS.

[42]  Sheng Li,et al.  Deep Collaborative Filtering via Marginalized Denoising Auto-encoder , 2015, CIKM.

[43]  Wentong Li,et al.  Estimating conversion rate in display advertising from past erformance data , 2012, KDD.

[44]  Hanghang Tong,et al.  Fast Mining of a Network of Coevolving Time Series , 2015, SDM.

[45]  Ruslan Salakhutdinov,et al.  Bayesian probabilistic matrix factorization using Markov chain Monte Carlo , 2008, ICML '08.

[46]  M. de Rijke,et al.  A Comparative Study of Click Models for Web Search , 2015, CLEF.

[47]  Sunho Park,et al.  Hierarchical Bayesian Matrix Factorization with Side Information , 2013, IJCAI.

[48]  Rong Pan,et al.  Constrained collective matrix factorization , 2012, RecSys.

[49]  Yehuda Koren,et al.  Yahoo! music recommendations: modeling music ratings with temporal dynamics and item taxonomy , 2011, RecSys '11.

[50]  Erick Cantú-Paz,et al.  Personalized click prediction in sponsored search , 2010, WSDM '10.

[51]  Michael A. King,et al.  Ensemble learning methods for pay-per-click campaign management , 2015, Expert Syst. Appl..

[52]  Brian D. Davison,et al.  Co-factorization machines: modeling user interests and predicting individual decisions in Twitter , 2013, WSDM.

[53]  Vanja Josifovski,et al.  Finding the right consumer: optimizing for conversion in display advertising campaigns , 2012, WSDM '12.

[54]  ChengXiang Zhai,et al.  Exploiting rich user information for one-class collaborative filtering , 2012, Knowledge and Information Systems.

[55]  Wu-Jun Li,et al.  Coupled Group Lasso for Web-Scale CTR Prediction in Display Advertising , 2014, ICML.

[56]  Deepak Agarwal,et al.  LASER: a scalable response prediction platform for online advertising , 2014, WSDM.

[57]  Milad Shokouhi,et al.  Behavioral dynamics on the web: Learning, modeling, and prediction , 2013, TOIS.