User Response Prediction in Online Advertising

Online advertising, as a vast market, has gained significant attention in various platforms ranging from search engines, third-party websites, social media, and mobile apps. The prosperity of online campaigns is a challenge in online marketing and is usually evaluated by user response through different metrics, such as clicks on advertisement (ad) creatives, subscriptions to products, purchases of items, or explicit user feedback through online surveys. Recent years have witnessed a significant increase in the number of studies using computational approaches, including machine learning methods, for user response prediction. However, existing literature mainly focuses on algorithmic-driven designs to solve specific challenges, and no comprehensive review exists to answer many important questions. What are the parties involved in the online digital advertising eco-systems? What type of data are available for user response prediction? How do we predict user response in a reliable and/or transparent way? In this survey, we provide a comprehensive review of user response prediction in online advertising and related recommender applications. Our essential goal is to provide a thorough understanding of online advertising platforms, stakeholders, data availability, and typical ways of user response prediction. We propose a taxonomy to categorize state-of-the-art user response prediction methods, primarily focusing on the current progress of machine learning methods used in different online platforms. In addition, we also review applications of user response prediction, benchmark datasets, and open source codes in the field.

[1]  Lina Yao,et al.  Face to Purchase: Predicting Consumer Choices with Structured Facial and Behavioral Traits Embedding , 2020, Knowl. Based Syst..

[2]  Florence March,et al.  2016 , 2016, Affair of the Heart.

[3]  Ed H. Chi,et al.  DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systems , 2020, WWW.

[4]  Dietmar Jannach,et al.  Why Are Deep Learning Models Not Consistently Winning Recommender Systems Competitions Yet?: A Position Paper , 2020, RecSys Challenge.

[5]  Xingquan Zhu,et al.  TriNE: Network Representation Learning for Tripartite Heterogeneous Networks , 2020, 2020 IEEE International Conference on Knowledge Graph (ICKG).

[6]  Lior Rokach,et al.  Iterative Boosting Deep Neural Networks for Predicting Click-Through Rate , 2020, ArXiv.

[7]  Stefanos Zafeiriou,et al.  AutoGroup: Automatic Feature Grouping for Modelling Explicit High-Order Feature Interactions in CTR Prediction , 2020, SIGIR.

[8]  Dietmar Jannach,et al.  Methodological Issues in Recommender Systems Research (Extended Abstract) , 2020, IJCAI.

[9]  Zi Huang,et al.  GAG: Global Attributed Graph Neural Network for Streaming Session-based Recommendation , 2020, SIGIR.

[10]  Yuandong Tian,et al.  Towards Automated Neural Interaction Discovery for Click-Through Rate Prediction , 2020, KDD.

[11]  Qi Pi,et al.  Search-based User Interest Modeling with Lifelong Sequential Behavior Data for Click-Through Rate Prediction , 2020, CIKM.

[12]  Nan Li,et al.  Maximizing Cumulative User Engagement in Sequential Recommendation: An Online Optimization Perspective , 2020, KDD.

[13]  Weinan Zhang,et al.  User Behavior Retrieval for Click-Through Rate Prediction , 2020, SIGIR.

[14]  Xiangnan He,et al.  How to Retrain Recommender System?: A Sequential Meta-Learning Method , 2020, SIGIR.

[15]  Zi Huang,et al.  Exploiting Cross-session Information for Session-based Recommendation with Graph Neural Networks , 2020, ACM Trans. Inf. Syst..

[16]  Kaigui Bian,et al.  Preference-Aware Mask for Session-Based Recommendation with Bidirectional Transformer , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[17]  Bin Liu,et al.  AutoFIS: Automatic Feature Interaction Selection in Factorization Models for Click-Through Rate Prediction , 2020, KDD.

[18]  Ping Li,et al.  Distributed Hierarchical GPU Parameter Server for Massive Scale Deep Learning Ads Systems , 2020, MLSys.

[19]  Chao Wang,et al.  Adversarial Multimodal Representation Learning for Click-Through Rate Prediction , 2020, WWW.

[20]  Jiliang Tang,et al.  Jointly Learning to Recommend and Advertise , 2020, KDD.

[21]  Xiangnan He,et al.  LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation , 2020, SIGIR.

[22]  Yang Chen,et al.  Interpretable Click-Through Rate Prediction through Hierarchical Attention , 2020, WSDM.

[23]  Xingquan Zhu,et al.  Deep Learning for User Interest and Response Prediction in Online Display Advertising , 2020, Data Science and Engineering.

[24]  Alexandros Karatzoglou,et al.  Parameter-Efficient Transfer from Sequential Behaviors for User Modeling and Recommendation , 2020, SIGIR.

[25]  Jianke Zhu,et al.  Deep Time-Stream Framework for Click-Through Rate Prediction by Tracking Interest Evolution , 2020, AAAI.

[26]  Ming Wu,et al.  Learning Feature Interactions with Lorentzian Factorization Machine , 2019, AAAI.

[27]  Jing Zhang,et al.  Entire Space Multi-Task Modeling via Post-Click Behavior Decomposition for Conversion Rate Prediction , 2019, SIGIR.

[28]  Cody A. Coleman,et al.  MLPerf Training Benchmark , 2019, MLSys.

[29]  Carl F. Mela,et al.  Online Display Advertising Markets: A Literature Review and Future Directions , 2019, Inf. Syst. Res..

[30]  Jinyang Gao,et al.  Privileged Features Distillation at Taobao Recommendations , 2019, KDD.

[31]  Jian Zhao,et al.  Operation-aware Neural Networks for User Response Prediction , 2019, Neural Networks.

[32]  Bo Zhang,et al.  Joint Modeling of Local and Global Behavior Dynamics for Session-Based Recommendation , 2020, ECAI.

[33]  Jeroen van den Hoven,et al.  Modelling and predicting User Engagement in mobile applications , 2020, Data Sci..

[34]  Santanu S. Dey,et al.  Order Matters at Fanatics Recommending Sequentially Ordered Products by LSTM Embedded with Word2Vec , 2019, ArXiv.

[35]  Djordje Gligorijevic,et al.  Time-Aware Prospective Modeling of Users for Online Display Advertising , 2019, ArXiv.

[36]  Chen Lin,et al.  FLEN: Leveraging Field for Scalable CTR Prediction , 2019, ArXiv.

[37]  Tao Deng,et al.  Learning Compositional, Visual and Relational Representations for CTR Prediction in Sponsored Search , 2019, CIKM.

[38]  Jing Zhang,et al.  Conversion Rate Prediction via Post-Click Behaviour Modeling , 2019, ArXiv.

[39]  Liang Wang,et al.  Fi-GNN: Modeling Feature Interactions via Graph Neural Networks for CTR Prediction , 2019, CIKM.

[40]  Yongfeng Zhang,et al.  A pareto-efficient algorithm for multiple objective optimization in e-commerce recommendation , 2019, RecSys.

[41]  Data-driven Curation, Learning and Analysis for Inferring Evolving IoT Botnets in the Wild , 2019, ARES.

[42]  Vinh Nguyen Xuan Truong,et al.  An Integrated Effectiveness Framework of Mobile In-App Advertising , 2019, Australas. J. Inf. Syst..

[43]  Weinan Zhang,et al.  An end-to-end neighborhood-based interaction model for knowledge-enhanced recommendation , 2019, Proceedings of the 1st International Workshop on Deep Learning Practice for High-Dimensional Sparse Data.

[44]  Nitesh V. Chawla,et al.  Heterogeneous Graph Neural Network , 2019, KDD.

[45]  Yongliang Li,et al.  Metapath-guided Heterogeneous Graph Neural Network for Intent Recommendation , 2019, KDD.

[46]  Nitesh V. Chawla,et al.  Online Purchase Prediction via Multi-Scale Modeling of Behavior Dynamics , 2019, KDD.

[47]  Aaron Flores,et al.  Predicting Different Types of Conversions with Multi-Task Learning in Online Advertising , 2019, KDD.

[48]  Jung-Woo Ha,et al.  Tripartite Heterogeneous Graph Propagation for Large-scale Social Recommendation , 2019, RecSys.

[49]  Yi Ren,et al.  Graph Intention Network for Click-through Rate Prediction in Sponsored Search , 2019, SIGIR.

[50]  Lucas Theis,et al.  Addressing delayed feedback for continuous training with neural networks in CTR prediction , 2019, RecSys.

[51]  Li Li,et al.  Click-through rate prediction with the user memory network , 2019, Proceedings of the 1st International Workshop on Deep Learning Practice for High-Dimensional Sparse Data.

[52]  Lucas Lacasa,et al.  Prediction is very hard, especially about conversion. Predicting user purchases from clickstream data in fashion e-commerce , 2019, ArXiv.

[53]  Guorui Zhou,et al.  Res-embedding for deep learning based click-through rate prediction modeling , 2019, Proceedings of the 1st International Workshop on Deep Learning Practice for High-Dimensional Sparse Data.

[54]  Xiuwu Zhang,et al.  Representation Learning-Assisted Click-Through Rate Prediction , 2019, IJCAI.

[55]  Li Li,et al.  Deep Spatio-Temporal Neural Networks for Click-Through Rate Prediction , 2019, KDD.

[56]  Xiang Ren,et al.  Characterizing and Forecasting User Engagement with In-App Action Graph: A Case Study of Snapchat , 2019, KDD.

[57]  Ashwin Aravindakshan,et al.  Measuring and forecasting mobile game app engagement , 2019, International Journal of Research in Marketing.

[58]  Yinghai Lu,et al.  Deep Learning Recommendation Model for Personalization and Recommendation Systems , 2019, ArXiv.

[59]  Junlin Zhang,et al.  FiBiNET: combining feature importance and bilinear feature interaction for click-through rate prediction , 2019, RecSys.

[60]  Guorui Zhou,et al.  Practice on Long Sequential User Behavior Modeling for Click-Through Rate Prediction , 2019, KDD.

[61]  Tat-Seng Chua,et al.  Neural Graph Collaborative Filtering , 2019, SIGIR.

[62]  Keping Yang,et al.  Deep Session Interest Network for Click-Through Rate Prediction , 2019, IJCAI.

[63]  Junlin Zhang,et al.  FAT-DeepFFM: Field Attentive Deep Field-aware Factorization Machine , 2019, ICDM.

[64]  Xiao Lin,et al.  Value-aware Recommendation based on Reinforcement Profit Maximization , 2019, WWW.

[65]  Jure Leskovec,et al.  Knowledge-aware Graph Neural Networks with Label Smoothness Regularization for Recommender Systems , 2019, KDD.

[66]  Yehuda Koren,et al.  On the Difficulty of Evaluating Baselines: A Study on Recommender Systems , 2019, ArXiv.

[67]  Lei Zheng,et al.  Lifelong Sequential Modeling with Personalized Memorization for User Response Prediction , 2019, SIGIR.

[68]  Qing He,et al.  Warm Up Cold-start Advertisements: Improving CTR Predictions via Learning to Learn ID Embeddings , 2019, SIGIR.

[69]  Kianoosh G. Boroojeni,et al.  Deep Learning-based Model to Fight Against Ad Click Fraud , 2019, ACM Southeast Regional Conference.

[70]  Bin Liu,et al.  Feature Generation by Convolutional Neural Network for Click-Through Rate Prediction , 2019, WWW.

[71]  Yanfang Ye,et al.  Heterogeneous Graph Attention Network , 2019, WWW.

[72]  Li Zhang,et al.  Field-Aware Neural Factorization Machine for Click-Through Rate Prediction , 2019, IEEE Access.

[73]  Nitesh V. Chawla,et al.  SHNE: Representation Learning for Semantic-Associated Heterogeneous Networks , 2019, WSDM.

[74]  Nitesh V. Chawla,et al.  Neural Tensor Factorization for Temporal Interaction Learning , 2019, WSDM.

[75]  Carl Landwher,et al.  2018 , 2019, Communications of the ACM.

[76]  Minyi Guo,et al.  Multi-Task Feature Learning for Knowledge Graph Enhanced Recommendation , 2019, WWW.

[77]  Namrata Chaudhary,et al.  Expanding Click and Buy rates: Exploration of evaluation metrics that measure the impact of personalized recommendation engines on e-commerce platforms , 2019, ArXiv.

[78]  Jian Tang,et al.  AutoInt: Automatic Feature Interaction Learning via Self-Attentive Neural Networks , 2018, CIKM.

[79]  Chang Zhou,et al.  Deep Interest Evolution Network for Click-Through Rate Prediction , 2018, AAAI.

[80]  Zheng-Jun Zha,et al.  Multi-Level Deep Cascade Trees for Conversion Rate Prediction in Recommendation System , 2018, AAAI.

[81]  Mehrad Jaloli,et al.  Implicit Life Event Discovery From Call Transcripts Using Temporal Input Transformation Network , 2019, IEEE Access.

[82]  M. Varacallo,et al.  2019 , 2019, Journal of Surgical Orthopaedic Advances.

[83]  Ying Liu,et al.  Unstructured Semantic Model supported Deep Neural Network for Click-Through Rate Prediction , 2018, ArXiv.

[84]  S. Hewitt,et al.  2008 , 2018, Los 25 años de la OMC: Una retrospectiva fotográfica.

[85]  Xiaohui Zhao,et al.  A New Approach for Advertising CTR Prediction Based on Deep Neural Network via Attention Mechanism , 2018, Comput. Math. Methods Medicine.

[86]  Saibal K. Pal,et al.  Click-Through Rate Estimation Using CHAID Classification Tree Model , 2018, Advances in Analytics and Applications.

[87]  Yiwen Sun,et al.  Dynamic Hierarchical Empirical Bayes: A Predictive Model Applied to Online Advertising , 2018, ArXiv.

[88]  Christos Faloutsos,et al.  Did We Get It Right? Predicting Query Performance in e-Commerce Search , 2018, eCOM@SIGIR.

[89]  Jari Salo,et al.  Effects of link placements in email newsletters on their click-through rate , 2018 .

[90]  Patrick P. K. Chan,et al.  Convolutional Neural Networks based Click-Through Rate Prediction with Multiple Feature Sequences , 2018, IJCAI.

[91]  Jure Leskovec,et al.  Graph Convolutional Neural Networks for Web-Scale Recommender Systems , 2018, KDD.

[92]  W. Bruce Croft,et al.  Target Apps Selection: Towards a Unified Search Framework for Mobile Devices , 2018, SIGIR.

[93]  Mingjiang Li,et al.  An improved advertising CTR prediction approach based on the fuzzy deep neural network , 2018, PloS one.

[94]  Priyanka Bhatt,et al.  Robust Factorization Machines for User Response Prediction , 2018, WWW.

[95]  Xiao Ma,et al.  Entire Space Multi-Task Model: An Effective Approach for Estimating Post-Click Conversion Rate , 2018, SIGIR.

[96]  Yunming Ye,et al.  DeepFM: An End-to-End Wide & Deep Learning Framework for CTR Prediction , 2018, ArXiv.

[97]  Jian Yang,et al.  Attention Convolutional Neural Network for Advertiser-level Click-through Rate Forecasting , 2018, WWW.

[98]  Yu Sun,et al.  Field-weighted Factorization Machines for Click-Through Rate Prediction in Display Advertising , 2018, WWW.

[99]  Mounia Lalmas,et al.  You must have clicked on this ad by mistake! Data-driven identification of accidental clicks on mobile ads with applications to advertiser cost discounting and click-through rate prediction , 2018, International Journal of Data Science and Analytics.

[100]  Zoran Obradovic,et al.  Deeply Supervised Semantic Model for Click-Through Rate Prediction in Sponsored Search , 2018, ArXiv.

[101]  Xing Xie,et al.  xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems , 2018, KDD.

[102]  Minyi Guo,et al.  RippleNet: Propagating User Preferences on the Knowledge Graph for Recommender Systems , 2018, CIKM.

[103]  Dik Lun Lee,et al.  Billion-scale Commodity Embedding for E-commerce Recommendation in Alibaba , 2018, KDD.

[104]  Minyi Guo,et al.  DKN: Deep Knowledge-Aware Network for News Recommendation , 2018, WWW.

[105]  Yu Zhang,et al.  Image Matters: Visually Modeling User Behaviors Using Advanced Model Server , 2017, CIKM.

[106]  Guorui Zhou,et al.  Rocket Launching: A Universal and Efficient Framework for Training Well-performing Light Net , 2017, AAAI.

[107]  Guorui Zhou,et al.  Deep Interest Network for Click-Through Rate Prediction , 2017, KDD.

[108]  Sonja Bidmon,et al.  Advertising Effects of In-Game-Advertising vs. In-App-Advertising , 2018 .

[109]  Zhendong Mao,et al.  Knowledge Graph Embedding: A Survey of Approaches and Applications , 2017, IEEE Transactions on Knowledge and Data Engineering.

[110]  Wei Xu,et al.  Improving click-through rate prediction accuracy in online advertising by transfer learning , 2017, WI.

[111]  Liangjie Hong,et al.  An Ensemble-based Approach to Click-Through Rate Prediction for Promoted Listings at Etsy , 2017, ADKDD@KDD.

[112]  Gang Fu,et al.  Deep & Cross Network for Ad Click Predictions , 2017, ADKDD@KDD.

[113]  Xiangnan He,et al.  Attentive Collaborative Filtering: Multimedia Recommendation with Item- and Component-Level Attention , 2017, SIGIR.

[114]  Shubhra Kanti Karmaker Santu,et al.  On Application of Learning to Rank for E-Commerce Search , 2017, SIGIR.

[115]  Tat-Seng Chua,et al.  Neural Factorization Machines for Sparse Predictive Analytics , 2017, SIGIR.

[116]  Tat-Seng Chua,et al.  Attentional Factorization Machines: Learning the Weight of Feature Interactions via Attention Networks , 2017, IJCAI.

[117]  Hui Liu,et al.  ULTR-CTR: Fast Page Grouping Using URL Truncation for Real-Time Click Through Rate Estimation , 2017, 2017 IEEE International Conference on Information Reuse and Integration (IRI).

[118]  Hongxia Jin,et al.  Disguise Adversarial Networks for Click-through Rate Prediction , 2017, IJCAI.

[119]  Amin Mantrach,et al.  Deep Character-Level Click-Through Rate Prediction for Sponsored Search , 2017, SIGIR.

[120]  Bo Zhang,et al.  PBODL : Parallel Bayesian Online Deep Learning for Click-Through Rate Prediction in Tencent Advertising System , 2017, ArXiv.

[121]  Jie Cao,et al.  Fraud Prevention in Online Digital Advertising , 2017, SpringerBriefs in Computer Science.

[122]  Tat-Seng Chua,et al.  Neural Collaborative Filtering , 2017, WWW.

[123]  Weiwei Deng,et al.  Model Ensemble for Click Prediction in Bing Search Ads , 2017, WWW.

[124]  Dean M. Krugman,et al.  Tablets and TV Advertising: Understanding the Viewing Experience , 2017 .

[125]  Yunming Ye,et al.  DeepFM: A Factorization-Machine based Neural Network for CTR Prediction , 2017, IJCAI.

[126]  Foutse Khomh,et al.  Comprehension of Ads-Supported and Paid Android Applications: Are They Different? , 2017, 2017 IEEE/ACM 25th International Conference on Program Comprehension (ICPC).

[127]  Masayuki Arai,et al.  Neural Feature Embedding for User Response Prediction in Real-Time Bidding (RTB) , 2017, SoMePeAS@ECIR.

[128]  Syed Abbas Ali,et al.  Click Through Rate Prediction for Contextual Advertisment Using Linear Regression , 2017, ArXiv.

[129]  Olivier Chapelle,et al.  Field-aware Factorization Machines in a Real-world Online Advertising System , 2017, WWW.

[130]  Quoc V. Le,et al.  Neural Architecture Search with Reinforcement Learning , 2016, ICLR.

[131]  Jun Wang,et al.  Display Advertising with Real-Time Bidding (RTB) and Behavioural Targeting , 2016, Found. Trends Inf. Retr..

[132]  Olivier Chapelle,et al.  Cost-sensitive Learning for Utility Optimization in Online Advertising Auctions , 2016, ADKDD@KDD.

[133]  Wen-Chih Peng,et al.  SEM: A Softmax-based Ensemble Model for CTR estimation in Real-Time Bidding advertising , 2017, 2017 IEEE International Conference on Big Data and Smart Computing (BigComp).

[134]  M. Kubát.  An Introduction to Machine Learning , 2017, Springer International Publishing.

[135]  Hongxia Yang,et al.  Large Scale CVR Prediction through Dynamic Transfer Learning of Global and Local Features , 2016, BigMine.

[136]  Enhong Chen,et al.  Sparse Factorization Machines for Click-through Rate Prediction , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[137]  Yong Yu,et al.  Product-Based Neural Networks for User Response Prediction over Multi-Field Categorical Data , 2018, ACM Trans. Inf. Syst..

[138]  Jun Wang,et al.  User Response Learning for Directly Optimizing Campaign Performance in Display Advertising , 2016, CIKM.

[139]  Hongtao Lu,et al.  Deep CTR Prediction in Display Advertising , 2016, ACM Multimedia.

[140]  Paul Covington,et al.  Deep Neural Networks for YouTube Recommendations , 2016, RecSys.

[141]  Dong Yu,et al.  Deep Crossing: Web-Scale Modeling without Manually Crafted Combinatorial Features , 2016, KDD.

[142]  Jun Wang,et al.  Bid-aware Gradient Descent for Unbiased Learning with Censored Data in Display Advertising , 2016, KDD.

[143]  Naonori Ueda,et al.  Higher-Order Factorization Machines , 2016, NIPS.

[144]  Heng-Tze Cheng,et al.  Wide & Deep Learning for Recommender Systems , 2016, DLRS@RecSys.

[145]  Cheng Guo,et al.  Entity Embeddings of Categorical Variables , 2016, ArXiv.

[146]  Fabrizio Silvestri,et al.  Improving Post-Click User Engagement on Native Ads via Survival Analysis , 2016, WWW.

[147]  Ke Zhou,et al.  Predicting Pre-click Quality for Native Advertisements , 2016, WWW.

[148]  Zilong Jiang,et al.  Research on CTR Prediction for Contextual Advertising Based on Deep Architecture Model , 2016 .

[149]  Gong Chen,et al.  In-Depth Survey of Digital Advertising Technologies , 2016, IEEE Communications Surveys & Tutorials.

[150]  Jun Wang,et al.  Deep Learning over Multi-field Categorical Data - - A Case Study on User Response Prediction , 2016, ECIR.

[151]  Jun Wang,et al.  Implicit Look-Alike Modelling in Display Ads - Transfer Collaborative Filtering to CTR Estimation , 2016, ECIR.

[152]  Arturo Azcorra,et al.  Understanding the Detection of View Fraud in Video Content Portals , 2015, WWW.

[153]  Anh-Phuong Ta,et al.  Factorization machines with follow-the-regularized-leader for CTR prediction in display advertising , 2015, 2015 IEEE International Conference on Big Data (Big Data).

[154]  Liang Wang,et al.  Collaborative Prediction for Multi-entity Interaction With Hierarchical Representation , 2015, CIKM.

[155]  Feng Yu,et al.  A Convolutional Click Prediction Model , 2015, CIKM.

[156]  Neha Sharma,et al.  K-modes Clustering Algorithm for Categorical Data , 2015 .

[157]  Dong Wang,et al.  Click-through Prediction for Advertising in Twitter Timeline , 2015, KDD.

[158]  Fabrizio Silvestri,et al.  Promoting Positive Post-Click Experience for In-Stream Yahoo Gemini Users , 2015, KDD.

[159]  Foster Provost,et al.  Evaluating and Optimizing Online Advertising: Forget the Click, but There Are Good Proxies , 2015, Big Data.

[160]  Michael A. King,et al.  Ensemble learning methods for pay-per-click campaign management , 2015, Expert Syst. Appl..

[161]  Tong Zhang,et al.  Crowd Fraud Detection in Internet Advertising , 2015, WWW.

[162]  Rómer Rosales,et al.  Simple and Scalable Response Prediction for Display Advertising , 2014, ACM Trans. Intell. Syst. Technol..

[163]  Ilya Trofimov,et al.  Using Neural Networks for Click Prediction of Sponsored Search , 2014, ArXiv.

[164]  Uwe Aickelin,et al.  Personalising Mobile Advertising Based on Users' Installed Apps , 2014, 2014 IEEE International Conference on Data Mining Workshop.

[165]  Wenke Lee,et al.  Your Online Interests: Pwned! A Pollution Attack Against Targeted Advertising , 2014, CCS.

[166]  Feiyue Wang,et al.  A survey on real time bidding advertising , 2014, Proceedings of 2014 IEEE International Conference on Service Operations and Logistics, and Informatics.

[167]  Shawn D. Baron,et al.  A Model for Delivering Branding Value Through High-Impact Digital Advertising , 2014, Journal of Advertising Research.

[168]  Joaquin Quiñonero Candela,et al.  Practical Lessons from Predicting Clicks on Ads at Facebook , 2014, ADKDD'14.

[169]  Foster J. Provost,et al.  Scalable hands-free transfer learning for online advertising , 2014, KDD.

[170]  Olivier Chapelle,et al.  Modeling delayed feedback in display advertising , 2014, KDD.

[171]  Tie-Yan Liu,et al.  Sequential Click Prediction for Sponsored Search with Recurrent Neural Networks , 2014, AAAI.

[172]  Sergei Vassilvitskii,et al.  Advertising in a stream , 2014, WWW.

[173]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[174]  Djoerd Hiemstra,et al.  Analysis of Search and Browsing Behavior of Young Users on the Web , 2014, TWEB.

[175]  David Lo,et al.  Predicting response in mobile advertising with hierarchical importance-aware factorization machine , 2014, WSDM.

[176]  David Lo,et al.  Detecting click fraud in online advertising: a data mining approach , 2014, J. Mach. Learn. Res..

[177]  Ramesh K. Sitaraman,et al.  Understanding the effectiveness of video ads: a measurement study , 2013, Internet Measurement Conference.

[178]  Martin Wattenberg,et al.  Ad click prediction: a view from the trenches , 2013, KDD.

[179]  Lars Schmidt-Thieme,et al.  Real-time top-n recommendation in social streams , 2012, RecSys.

[180]  Wentong Li,et al.  Estimating conversion rate in display advertising from past erformance data , 2012, KDD.

[181]  Shu-Chuan Chu.  Viral Advertising in Social Media , 2011 .

[182]  Sachin Garg,et al.  Response prediction using collaborative filtering with hierarchies and side-information , 2011, KDD.

[183]  Deepak Agarwal,et al.  Temporal multi-hierarchy smoothing for estimating rates of rare events , 2011, KDD.

[184]  Oliver J. Rutz,et al.  From Generic to Branded: A Model of Spillover in Paid Search Advertising , 2011 .

[185]  Tamara G. Kolda,et al.  Temporal Link Prediction Using Matrix and Tensor Factorizations , 2010, TKDD.

[186]  Xuerui Wang,et al.  Click-Through Rate Estimation for Rare Events in Online Advertising , 2011 .

[187]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.

[188]  Hang Li,et al.  Do clicks measure recommendation relevancy?: an empirical user study , 2010, RecSys '10.

[189]  Rajiv Khanna,et al.  Estimating rates of rare events with multiple hierarchies through scalable log-linear models , 2010, KDD '10.

[190]  Joaquin Quiñonero Candela,et al.  Web-Scale Bayesian Click-Through rate Prediction for Sponsored Search Advertising in Microsoft's Bing Search Engine , 2010, ICML.

[191]  Hema Raghavan,et al.  Improving ad relevance in sponsored search , 2010, WSDM '10.

[192]  Yifan Hu,et al.  Collaborative Filtering for Implicit Feedback Datasets , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[193]  Yehuda Koren,et al.  Factorization meets the neighborhood: a multifaceted collaborative filtering model , 2008, KDD.

[194]  Tao Mei,et al.  VideoSense: towards effective online video advertising , 2007, ACM Multimedia.

[195]  Andrei Z. Broder,et al.  Estimating rates of rare events at multiple resolutions , 2007, KDD '07.

[196]  Xingquan Zhu,et al.  Knowledge Discovery and Data Mining: Challenges and Realities , 2007 .

[197]  Matthew Richardson,et al.  Predicting clicks: estimating the click-through rate for new ads , 2007, WWW '07.

[198]  Daniel C. Fain,et al.  Predicting Click-Through Rate Using Keyword Clusters , 2006 .

[199]  Hairong Li,et al.  Internet Advertising Formats and Effectiveness , 2004 .

[200]  Yi Li,et al.  COOLCAT: an entropy-based algorithm for categorical clustering , 2002, CIKM '02.

[201]  Jinyuan You,et al.  CLOPE: a fast and effective clustering algorithm for transactional data , 2002, KDD.