User Response Prediction in Online Advertising

Online advertising, as a vast market, has gained significant attention in various platforms ranging from search engines, third-party websites, social media, and mobile apps. The prosperity of online campaigns is a challenge in online marketing and is usually evaluated by user response through different metrics, such as clicks on advertisement (ad) creatives, subscriptions to products, purchases of items, or explicit user feedback through online surveys. Recent years have witnessed a significant increase in the number of studies using computational approaches, including machine learning methods, for user response prediction. However, existing literature mainly focuses on algorithmic-driven designs to solve specific challenges, and no comprehensive review exists to answer many important questions. What are the parties involved in the online digital advertising eco-systems? What type of data are available for user response prediction? How do we predict user response in a reliable and/or transparent way? In this survey, we provide a comprehensive review of user response prediction in online advertising and related recommender applications. Our essential goal is to provide a thorough understanding of online advertising platforms, stakeholders, data availability, and typical ways of user response prediction. We propose a taxonomy to categorize state-of-the-art user response prediction methods, primarily focusing on the current progress of machine learning methods used in different online platforms. In addition, we also review applications of user response prediction, benchmark datasets, and open source codes in the field.

[1]  Jinyuan You,et al.  CLOPE: a fast and effective clustering algorithm for transactional data , 2002, KDD.

[2]  Yi Li,et al.  COOLCAT: an entropy-based algorithm for categorical clustering , 2002, CIKM '02.

[3]  Hairong Li,et al.  Internet Advertising Formats and Effectiveness , 2004 .

[4]  Daniel C. Fain,et al.  Predicting Click-Through Rate Using Keyword Clusters , 2006 .

[5]  Tao Mei,et al.  VideoSense: towards effective online video advertising , 2007, ACM Multimedia.

[6]  Matthew Richardson,et al.  Predicting clicks: estimating the click-through rate for new ads , 2007, WWW '07.

[7]  Xingquan Zhu,et al.  Knowledge Discovery and Data Mining: Challenges and Realities , 2007 .

[8]  Andrei Z. Broder,et al.  Estimating rates of rare events at multiple resolutions , 2007, KDD '07.

[9]  Yifan Hu,et al.  Collaborative Filtering for Implicit Feedback Datasets , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[10]  Yehuda Koren,et al.  Factorization meets the neighborhood: a multifaceted collaborative filtering model , 2008, KDD.

[11]  Joaquin Quiñonero Candela,et al.  Web-Scale Bayesian Click-Through rate Prediction for Sponsored Search Advertising in Microsoft's Bing Search Engine , 2010, ICML.

[12]  Rajiv Khanna,et al.  Estimating rates of rare events with multiple hierarchies through scalable log-linear models , 2010, KDD '10.

[13]  Hema Raghavan,et al.  Improving ad relevance in sponsored search , 2010, WSDM '10.

[14]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.

[15]  Hang Li,et al.  Do clicks measure recommendation relevancy?: an empirical user study , 2010, RecSys '10.

[16]  Shu-Chuan Chu.  Viral Advertising in Social Media , 2011 .

[17]  Xuerui Wang,et al.  Click-Through Rate Estimation for Rare Events in Online Advertising , 2011 .

[18]  Tamara G. Kolda,et al.  Temporal Link Prediction Using Matrix and Tensor Factorizations , 2010, TKDD.

[19]  Oliver J. Rutz,et al.  From Generic to Branded: A Model of Spillover in Paid Search Advertising , 2011 .

[20]  Sachin Garg,et al.  Response prediction using collaborative filtering with hierarchies and side-information , 2011, KDD.

[21]  Deepak Agarwal,et al.  Temporal multi-hierarchy smoothing for estimating rates of rare events , 2011, KDD.

[22]  Wentong Li,et al.  Estimating conversion rate in display advertising from past erformance data , 2012, KDD.

[23]  Lars Schmidt-Thieme,et al.  Real-time top-n recommendation in social streams , 2012, RecSys.

[24]  Martin Wattenberg,et al.  Ad click prediction: a view from the trenches , 2013, KDD.

[25]  Ramesh K. Sitaraman,et al.  Understanding the effectiveness of video ads: a measurement study , 2013, Internet Measurement Conference.

[26]  Shawn D. Baron,et al.  A Model for Delivering Branding Value Through High-Impact Digital Advertising , 2014, Journal of Advertising Research.

[27]  Tie-Yan Liu,et al.  Sequential Click Prediction for Sponsored Search with Recurrent Neural Networks , 2014, AAAI.

[28]  Feiyue Wang,et al.  A survey on real time bidding advertising , 2014, Proceedings of 2014 IEEE International Conference on Service Operations and Logistics, and Informatics.

[29]  Foster J. Provost,et al.  Scalable hands-free transfer learning for online advertising , 2014, KDD.

[30]  David Lo,et al.  Predicting response in mobile advertising with hierarchical importance-aware factorization machine , 2014, WSDM.

[31]  Uwe Aickelin,et al.  Personalising Mobile Advertising Based on Users' Installed Apps , 2014, 2014 IEEE International Conference on Data Mining Workshop.

[32]  Sergei Vassilvitskii,et al.  Advertising in a stream , 2014, WWW.

[33]  David Lo,et al.  Detecting click fraud in online advertising: a data mining approach , 2014, J. Mach. Learn. Res..

[34]  Rómer Rosales,et al.  Simple and Scalable Response Prediction for Display Advertising , 2014, ACM Trans. Intell. Syst. Technol..

[35]  Wenke Lee,et al.  Your Online Interests: Pwned! A Pollution Attack Against Targeted Advertising , 2014, CCS.

[36]  Djoerd Hiemstra,et al.  Analysis of Search and Browsing Behavior of Young Users on the Web , 2014, TWEB.

[37]  Olivier Chapelle,et al.  Modeling delayed feedback in display advertising , 2014, KDD.

[38]  Ilya Trofimov,et al.  Using Neural Networks for Click Prediction of Sponsored Search , 2014, ArXiv.

[39]  Joaquin Quiñonero Candela,et al.  Practical Lessons from Predicting Clicks on Ads at Facebook , 2014, ADKDD'14.

[40]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[41]  Tong Zhang,et al.  Crowd Fraud Detection in Internet Advertising , 2015, WWW.

[42]  Michael A. King,et al.  Ensemble learning methods for pay-per-click campaign management , 2015, Expert Syst. Appl..

[43]  Liang Wang,et al.  Collaborative Prediction for Multi-entity Interaction With Hierarchical Representation , 2015, CIKM.

[44]  Neha Sharma,et al.  K-modes Clustering Algorithm for Categorical Data , 2015 .

[45]  Anh-Phuong Ta,et al.  Factorization machines with follow-the-regularized-leader for CTR prediction in display advertising , 2015, 2015 IEEE International Conference on Big Data (Big Data).

[46]  Fabrizio Silvestri,et al.  Promoting Positive Post-Click Experience for In-Stream Yahoo Gemini Users , 2015, KDD.

[47]  Feng Yu,et al.  A Convolutional Click Prediction Model , 2015, CIKM.

[48]  Dong Wang,et al.  Click-through Prediction for Advertising in Twitter Timeline , 2015, KDD.

[49]  Foster Provost,et al.  Evaluating and Optimizing Online Advertising: Forget the Click, but There Are Good Proxies , 2015, Big Data.

[50]  Jun Wang,et al.  Deep Learning over Multi-field Categorical Data - - A Case Study on User Response Prediction , 2016, ECIR.

[51]  Jun Wang,et al.  Bid-aware Gradient Descent for Unbiased Learning with Censored Data in Display Advertising , 2016, KDD.

[52]  Naonori Ueda,et al.  Higher-Order Factorization Machines , 2016, NIPS.

[53]  Ke Zhou,et al.  Predicting Pre-click Quality for Native Advertisements , 2016, WWW.

[54]  Fabrizio Silvestri,et al.  Improving Post-Click User Engagement on Native Ads via Survival Analysis , 2016, WWW.

[55]  Paul Covington,et al.  Deep Neural Networks for YouTube Recommendations , 2016, RecSys.

[56]  Zilong Jiang,et al.  Research on CTR Prediction for Contextual Advertising Based on Deep Architecture Model , 2016 .

[57]  Jun Wang,et al.  Product-Based Neural Networks for User Response Prediction , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[58]  Heng-Tze Cheng,et al.  Wide & Deep Learning for Recommender Systems , 2016, DLRS@RecSys.

[59]  Enhong Chen,et al.  Sparse Factorization Machines for Click-through Rate Prediction , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[60]  Florence March,et al.  2016 , 2016, Affair of the Heart.

[61]  Hongtao Lu,et al.  Deep CTR Prediction in Display Advertising , 2016, ACM Multimedia.

[62]  Arturo Azcorra,et al.  Understanding the Detection of View Fraud in Video Content Portals , 2016, WWW.

[63]  Gong Chen,et al.  In-Depth Survey of Digital Advertising Technologies , 2016, IEEE Communications Surveys & Tutorials.

[64]  Hongxia Yang,et al.  Large Scale CVR Prediction through Dynamic Transfer Learning of Global and Local Features , 2016, BigMine.

[65]  Jun Wang,et al.  Implicit Look-Alike Modelling in Display Ads - Transfer Collaborative Filtering to CTR Estimation , 2016, ECIR.

[66]  Dong Yu,et al.  Deep Crossing: Web-Scale Modeling without Manually Crafted Combinatorial Features , 2016, KDD.

[67]  Jun Wang,et al.  User Response Learning for Directly Optimizing Campaign Performance in Display Advertising , 2016, CIKM.

[68]  Cheng Guo,et al.  Entity Embeddings of Categorical Variables , 2016, ArXiv.

[69]  Gang Fu,et al.  Deep & Cross Network for Ad Click Predictions , 2017, ADKDD@KDD.

[70]  Bo Zhang,et al.  PBODL : Parallel Bayesian Online Deep Learning for Click-Through Rate Prediction in Tencent Advertising System , 2017, ArXiv.

[71]  Wei Xu,et al.  Improving click-through rate prediction accuracy in online advertising by transfer learning , 2017, WI.

[72]  Yunming Ye,et al.  DeepFM: A Factorization-Machine based Neural Network for CTR Prediction , 2017, IJCAI.

[73]  Masayuki Arai,et al.  Neural Feature Embedding for User Response Prediction in Real-Time Bidding (RTB) , 2017, SoMePeAS@ECIR.

[74]  Zhendong Mao,et al.  Knowledge Graph Embedding: A Survey of Approaches and Applications , 2017, IEEE Transactions on Knowledge and Data Engineering.

[75]  Weiwei Deng,et al.  Model Ensemble for Click Prediction in Bing Search Ads , 2017, WWW.

[76]  Tat-Seng Chua,et al.  Neural Factorization Machines for Sparse Predictive Analytics , 2017, SIGIR.

[77]  Xiangnan He,et al.  Attentive Collaborative Filtering: Multimedia Recommendation with Item- and Component-Level Attention , 2017, SIGIR.

[78]  Amin Mantrach,et al.  Deep Character-Level Click-Through Rate Prediction for Sponsored Search , 2017, SIGIR.

[79]  Syed Abbas Ali,et al.  Click Through Rate Prediction for Contextual Advertisment Using Linear Regression , 2017, ArXiv.

[80]  Quoc V. Le,et al.  Neural Architecture Search with Reinforcement Learning , 2016, ICLR.

[81]  M. Kubát.  An Introduction to Machine Learning , 2017, Springer International Publishing.

[82]  Dean M. Krugman,et al.  Tablets and TV Advertising: Understanding the Viewing Experience , 2017 .

[83]  Foutse Khomh,et al.  Comprehension of Ads-Supported and Paid Android Applications: Are They Different? , 2017, 2017 IEEE/ACM 25th International Conference on Program Comprehension (ICPC).

[84]  Olivier Chapelle,et al.  Cost-sensitive Learning for Utility Optimization in Online Advertising Auctions , 2016, ADKDD@KDD.

[85]  Tat-Seng Chua,et al.  Neural Collaborative Filtering , 2017, WWW.

[86]  Jie Cao,et al.  Fraud Prevention in Online Digital Advertising , 2017, SpringerBriefs in Computer Science.

[87]  Hui Liu,et al.  ULTR-CTR: Fast Page Grouping Using URL Truncation for Real-Time Click Through Rate Estimation , 2017, 2017 IEEE International Conference on Information Reuse and Integration (IRI).

[88]  Olivier Chapelle,et al.  Field-aware Factorization Machines in a Real-world Online Advertising System , 2017, WWW.

[89]  Shubhra Kanti Karmaker Santu,et al.  On Application of Learning to Rank for E-Commerce Search , 2017, SIGIR.

[90]  Jun Wang,et al.  Display Advertising with Real-Time Bidding (RTB) and Behavioural Targeting , 2016, Found. Trends Inf. Retr..

[91]  Wen-Chih Peng,et al.  SEM: A Softmax-based Ensemble Model for CTR estimation in Real-Time Bidding advertising , 2017, 2017 IEEE International Conference on Big Data and Smart Computing (BigComp).

[92]  Liangjie Hong,et al.  An Ensemble-based Approach to Click-Through Rate Prediction for Promoted Listings at Etsy , 2017, ADKDD@KDD.

[93]  Hongxia Jin,et al.  Disguise Adversarial Networks for Click-through Rate Prediction , 2017, IJCAI.

[94]  Tat-Seng Chua,et al.  Attentional Factorization Machines: Learning the Weight of Feature Interactions via Attention Networks , 2017, IJCAI.

[95]  Yunming Ye,et al.  DeepFM: An End-to-End Wide & Deep Learning Framework for CTR Prediction , 2018, ArXiv.

[96]  Yu Zhang,et al.  Image Matters: Visually Modeling User Behaviors Using Advanced Model Server , 2017, CIKM.

[97]  Xiao Ma,et al.  Entire Space Multi-Task Model: An Effective Approach for Estimating Post-Click Conversion Rate , 2018, SIGIR.

[98]  Mingjiang Li,et al.  An improved advertising CTR prediction approach based on the fuzzy deep neural network , 2018, PloS one.

[99]  Xing Xie,et al.  xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems , 2018, KDD.

[100]  W. Bruce Croft,et al.  Target Apps Selection: Towards a Unified Search Framework for Mobile Devices , 2018, SIGIR.

[101]  Priyanka Bhatt,et al.  Robust Factorization Machines for User Response Prediction , 2018, WWW.

[102]  Jari Salo,et al.  Effects of link placements in email newsletters on their click-through rate , 2018 .

[103]  Patrick P. K. Chan,et al.  Convolutional Neural Networks based Click-Through Rate Prediction with Multiple Feature Sequences , 2018, IJCAI.

[104]  Mounia Lalmas,et al.  You must have clicked on this ad by mistake! Data-driven identification of accidental clicks on mobile ads with applications to advertiser cost discounting and click-through rate prediction , 2018, International Journal of Data Science and Analytics.

[105]  Saibal K. Pal,et al.  Click-Through Rate Estimation Using CHAID Classification Tree Model , 2018, Advances in Analytics and Applications.

[106]  Jure Leskovec,et al.  Graph Convolutional Neural Networks for Web-Scale Recommender Systems , 2018, KDD.

[107]  Minyi Guo,et al.  RippleNet: Propagating User Preferences on the Knowledge Graph for Recommender Systems , 2018, CIKM.

[108]  Minyi Guo,et al.  DKN: Deep Knowledge-Aware Network for News Recommendation , 2018, WWW.

[109]  Sonja Bidmon,et al.  Advertising Effects of In-Game-Advertising vs. In-App-Advertising , 2018 .

[110]  S. Hewitt,et al.  2008 , 2018, Los 25 años de la OMC: Una retrospectiva fotográfica.

[111]  Xiaohui Zhao,et al.  A New Approach for Advertising CTR Prediction Based on Deep Neural Network via Attention Mechanism , 2018, Comput. Math. Methods Medicine.

[112]  Dik Lun Lee,et al.  Billion-scale Commodity Embedding for E-commerce Recommendation in Alibaba , 2018, KDD.

[113]  Guorui Zhou,et al.  Deep Interest Network for Click-Through Rate Prediction , 2017, KDD.

[114]  Ying Liu,et al.  Unstructured Semantic Model supported Deep Neural Network for Click-Through Rate Prediction , 2018, ArXiv.

[115]  Yu Sun,et al.  Field-weighted Factorization Machines for Click-Through Rate Prediction in Display Advertising , 2018, WWW.

[116]  Jian Yang,et al.  Attention Convolutional Neural Network for Advertiser-level Click-through Rate Forecasting , 2018, WWW.

[117]  Zoran Obradovic,et al.  Deeply Supervised Semantic Model for Click-Through Rate Prediction in Sponsored Search , 2018, ArXiv.

[118]  Yiwen Sun,et al.  Dynamic Hierarchical Empirical Bayes: A Predictive Model Applied to Online Advertising , 2018, ArXiv.

[119]  Guorui Zhou,et al.  Rocket Launching: A Universal and Efficient Framework for Training Well-performing Light Net , 2017, AAAI.

[120]  Christos Faloutsos,et al.  Did We Get It Right? Predicting Query Performance in e-Commerce Search , 2018, eCOM@SIGIR.

[121]  Yanfang Ye,et al.  Heterogeneous Graph Attention Network , 2019, WWW.

[122]  Li Zhang,et al.  Field-Aware Neural Factorization Machine for Click-Through Rate Prediction , 2019, IEEE Access.

[123]  Yongliang Li,et al.  Metapath-guided Heterogeneous Graph Neural Network for Intent Recommendation , 2019, KDD.

[124]  Chen Lin,et al.  FLEN: Leveraging Field for Scalable CTR Prediction , 2019, ArXiv.

[125]  Jian Tang,et al.  AutoInt: Automatic Feature Interaction Learning via Self-Attentive Neural Networks , 2018, CIKM.

[126]  Xiuwu Zhang,et al.  Representation Learning-Assisted Click-Through Rate Prediction , 2019, IJCAI.

[127]  Namrata Chaudhary,et al.  Expanding Click and Buy rates: Exploration of evaluation metrics that measure the impact of personalized recommendation engines on e-commerce platforms , 2019, ArXiv.

[128]  Nitesh V. Chawla,et al.  SHNE: Representation Learning for Semantic-Associated Heterogeneous Networks , 2019, WSDM.

[129]  Liang Wang,et al.  Fi-GNN: Modeling Feature Interactions via Graph Neural Networks for CTR Prediction , 2019, CIKM.

[130]  Junlin Zhang,et al.  FiBiNET: combining feature importance and bilinear feature interaction for click-through rate prediction , 2019, RecSys.

[131]  M. Varacallo,et al.  2019 , 2019, Journal of Surgical Orthopaedic Advances.

[132]  Keping Yang,et al.  Deep Session Interest Network for Click-Through Rate Prediction , 2019, IJCAI.

[133]  Jung-Woo Ha,et al.  Tripartite Heterogeneous Graph Propagation for Large-scale Social Recommendation , 2019, RecSys.

[134]  Qing He,et al.  Warm Up Cold-start Advertisements: Improving CTR Predictions via Learning to Learn ID Embeddings , 2019, SIGIR.

[135]  Lucas Theis,et al.  Addressing delayed feedback for continuous training with neural networks in CTR prediction , 2019, RecSys.

[136]  Lucas Lacasa,et al.  Prediction is very hard, especially about conversion. Predicting user purchases from clickstream data in fashion e-commerce , 2019, ArXiv.

[137]  Minyi Guo,et al.  Multi-Task Feature Learning for Knowledge Graph Enhanced Recommendation , 2019, WWW.

[138]  Guorui Zhou,et al.  Practice on Long Sequential User Behavior Modeling for Click-Through Rate Prediction , 2019, KDD.

[139]  Yongfeng Zhang,et al.  A pareto-efficient algorithm for multiple objective optimization in e-commerce recommendation , 2019, RecSys.

[140]  Xiang Ren,et al.  Characterizing and Forecasting User Engagement with In-App Action Graph: A Case Study of Snapchat , 2019, KDD.

[141]  Xiao Lin,et al.  Value-aware Recommendation based on Reinforcement Profit Maximization , 2019, WWW.

[142]  Jure Leskovec,et al.  Knowledge-aware Graph Neural Networks with Label Smoothness Regularization for Recommender Systems , 2019, KDD.

[143]  Tao Deng,et al.  Learning Compositional, Visual and Relational Representations for CTR Prediction in Sponsored Search , 2019, CIKM.

[144]  Guorui Zhou,et al.  Res-embedding for deep learning based click-through rate prediction modeling , 2019, Proceedings of the 1st International Workshop on Deep Learning Practice for High-Dimensional Sparse Data.

[145]  Yinghai Lu,et al.  Deep Learning Recommendation Model for Personalization and Recommendation Systems , 2019, ArXiv.

[146]  Chang Zhou,et al.  Deep Interest Evolution Network for Click-Through Rate Prediction , 2018, AAAI.

[147]  Jing Pan,et al.  Order Matters at Fanatics Recommending Sequentially Ordered Products by LSTM Embedded with Word2Vec , 2019, ArXiv.

[148]  Nitesh V. Chawla,et al.  Neural Tensor Factorization for Temporal Interaction Learning , 2019, WSDM.

[149]  Data-driven Curation, Learning and Analysis for Inferring Evolving IoT Botnets in the Wild , 2019, ARES.

[150]  Lei Zheng,et al.  Lifelong Sequential Modeling with Personalized Memorization for User Response Prediction , 2019, SIGIR.

[151]  Djordje Gligorijevic,et al.  Time-Aware Prospective Modeling of Users for Online Display Advertising , 2019, ArXiv.

[152]  Jing Zhang,et al.  Conversion Rate Prediction via Post-Click Behaviour Modeling , 2019, ArXiv.

[153]  Ashwin Aravindakshan,et al.  Measuring and forecasting mobile game app engagement , 2019, International Journal of Research in Marketing.

[154]  Carl Landwher,et al.  2018 , 2019, Communications of the ACM.

[155]  Vinh Nguyen Xuan Truong,et al.  An Integrated Effectiveness Framework of Mobile In-App Advertising , 2019, Australas. J. Inf. Syst..

[156]  Yehuda Koren,et al.  On the Difficulty of Evaluating Baselines: A Study on Recommender Systems , 2019, ArXiv.

[157]  Bin Liu,et al.  Feature Generation by Convolutional Neural Network for Click-Through Rate Prediction , 2019, WWW.

[158]  Tat-Seng Chua,et al.  Neural Graph Collaborative Filtering , 2019, SIGIR.

[159]  Zheng-Jun Zha,et al.  Multi-Level Deep Cascade Trees for Conversion Rate Prediction in Recommendation System , 2018, AAAI.

[160]  Junlin Zhang,et al.  FAT-DeepFFM: Field Attentive Deep Field-aware Factorization Machine , 2019, ICDM.

[161]  Nitesh V. Chawla,et al.  Online Purchase Prediction via Multi-Scale Modeling of Behavior Dynamics , 2019, KDD.

[162]  Kianoosh G. Boroojeni,et al.  Deep Learning-based Model to Fight Against Ad Click Fraud , 2019, ACM Southeast Regional Conference.

[163]  Li Li,et al.  Click-through rate prediction with the user memory network , 2019, Proceedings of the 1st International Workshop on Deep Learning Practice for High-Dimensional Sparse Data.

[164]  Carl F. Mela,et al.  Online Display Advertising Markets: A Literature Review and Future Directions , 2019, Inf. Syst. Res..

[165]  Mehrad Jaloli,et al.  Implicit Life Event Discovery From Call Transcripts Using Temporal Input Transformation Network , 2019, IEEE Access.

[166]  Yi Ren,et al.  Graph Intention Network for Click-through Rate Prediction in Sponsored Search , 2019, SIGIR.

[167]  Aaron Flores,et al.  Predicting Different Types of Conversions with Multi-Task Learning in Online Advertising , 2019, KDD.

[168]  Nitesh V. Chawla,et al.  Heterogeneous Graph Neural Network , 2019, KDD.

[169]  Weinan Zhang,et al.  An end-to-end neighborhood-based interaction model for knowledge-enhanced recommendation , 2019, Proceedings of the 1st International Workshop on Deep Learning Practice for High-Dimensional Sparse Data.

[170]  Yong Yu,et al.  Product-Based Neural Networks for User Response Prediction over Multi-Field Categorical Data , 2018, ACM Trans. Inf. Syst..

[171]  Li Li,et al.  Deep Spatio-Temporal Neural Networks for Click-Through Rate Prediction , 2019, KDD.

[172]  Zi Huang,et al.  GAG: Global Attributed Graph Neural Network for Streaming Session-based Recommendation , 2020, SIGIR.

[173]  Zi Huang,et al.  Exploiting Cross-session Information for Session-based Recommendation with Graph Neural Networks , 2020, ACM Trans. Inf. Syst..

[174]  Ping Li,et al.  Distributed Hierarchical GPU Parameter Server for Massive Scale Deep Learning Ads Systems , 2020, MLSys.

[175]  Jing Zhang,et al.  Entire Space Multi-Task Modeling via Post-Click Behavior Decomposition for Conversion Rate Prediction , 2019, SIGIR.

[176]  Stefanos Zafeiriou,et al.  AutoGroup: Automatic Feature Grouping for Modelling Explicit High-Order Feature Interactions in CTR Prediction , 2020, SIGIR.

[177]  Xingquan Zhu,et al.  Deep Learning for User Interest and Response Prediction in Online Display Advertising , 2020, Data Science and Engineering.

[178]  Jiliang Tang,et al.  Jointly Learning to Recommend and Advertise , 2020, KDD.

[179]  Xiangnan He,et al.  How to Retrain Recommender System?: A Sequential Meta-Learning Method , 2020, SIGIR.

[180]  Xiangnan He,et al.  LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation , 2020, SIGIR.

[181]  Chao Wang,et al.  Adversarial Multimodal Representation Learning for Click-Through Rate Prediction , 2020, WWW.

[182]  Bin Liu,et al.  AutoFIS: Automatic Feature Interaction Selection in Factorization Models for Click-Through Rate Prediction , 2020, KDD.

[183]  Xingquan Zhu,et al.  TriNE: Network Representation Learning for Tripartite Heterogeneous Networks , 2020, 2020 IEEE International Conference on Knowledge Graph (ICKG).

[184]  Qi Pi,et al.  Search-based User Interest Modeling with Lifelong Sequential Behavior Data for Click-Through Rate Prediction , 2020, CIKM.

[185]  Jianke Zhu,et al.  Deep Time-Stream Framework for Click-Through Rate Prediction by Tracking Interest Evolution , 2020, AAAI.

[186]  Cody A. Coleman,et al.  MLPerf Training Benchmark , 2019, MLSys.

[187]  Weinan Zhang,et al.  User Behavior Retrieval for Click-Through Rate Prediction , 2020, SIGIR.

[188]  Kaigui Bian,et al.  Preference-Aware Mask for Session-Based Recommendation with Bidirectional Transformer , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[189]  Dietmar Jannach,et al.  Methodological Issues in Recommender Systems Research (Extended Abstract) , 2020, IJCAI.

[190]  Jian Zhao,et al.  Operation-aware Neural Networks for User Response Prediction , 2019, Neural Networks.

[191]  Dietmar Jannach,et al.  Why Are Deep Learning Models Not Consistently Winning Recommender Systems Competitions Yet?: A Position Paper , 2020, RecSys Challenge.

[192]  Ming Wu,et al.  Learning Feature Interactions with Lorentzian Factorization Machine , 2019, AAAI.

[193]  Yuandong Tian,et al.  Towards Automated Neural Interaction Discovery for Click-Through Rate Prediction , 2020, KDD.

[194]  Nan Li,et al.  Maximizing Cumulative User Engagement in Sequential Recommendation: An Online Optimization Perspective , 2020, KDD.

[195]  Lior Rokach,et al.  Iterative Boosting Deep Neural Networks for Predicting Click-Through Rate , 2020, ArXiv.

[196]  Jinyang Gao,et al.  Privileged Features Distillation at Taobao Recommendations , 2019, KDD.

[197]  Jeroen van den Hoven,et al.  Modelling and predicting User Engagement in mobile applications , 2020, Data Sci..

[198]  Bo Zhang,et al.  Joint Modeling of Local and Global Behavior Dynamics for Session-Based Recommendation , 2020, ECAI.

[199]  Yang Chen,et al.  Interpretable Click-Through Rate Prediction through Hierarchical Attention , 2020, WSDM.

[200]  Alexandros Karatzoglou,et al.  Parameter-Efficient Transfer from Sequential Behaviors for User Modeling and Recommendation , 2020, SIGIR.

[201]  Ed H. Chi,et al.  DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systems , 2020, WWW.

[202]  Lina Yao,et al.  Face to Purchase: Predicting Consumer Choices with Structured Facial and Behavioral Traits Embedding , 2020, Knowl. Based Syst..