Promoting Positive Post-Click Experience for In-Stream Yahoo Gemini Users

Click-through rate (CTR) is the most common metric used to assess the performance of an online advert; another performance of an online advert is the user post-click experience. In this paper, we describe the method we have implemented in Yahoo Gemini to measure the post-click experience on Yahoo mobile news streams via an automatic analysis of advert landing pages. We measure the post-click experience by means of two well-known metrics, dwell time and bounce rate. We show that these metrics can be used as proxy of an advert post-click experience, and that a negative post-click experience has a negative effect on user engagement and future ad clicks. We then put forward an approach that analyses advert landing pages, and show how these can affect dwell time and bounce rate. Finally, we develop a prediction model for advert quality based on dwell time, which was deployed on Yahoo mobile news stream app running on iOS. The results show that, using dwell time as a proxy of post-click experience, we can prioritise higher quality ads. We demonstrate the impact of this on users via A/B testing.

[1]  Hila Becker,et al.  What happens after an ad click?: quantifying the impact of landing pages in web advertising , 2009, CIKM.

[2]  Dustin Hillard,et al.  A predictive model for advertiser value-per-click in sponsored search , 2013, WWW.

[3]  Xiaoli Z. Fern,et al.  Visual appearance of display ads and its effect on click through rate , 2012, CIKM.

[4]  Kathryn E. Boudreau.  Mobile Advertising and its Acceptance by American Consumers , 2013 .

[5]  Peifeng Yin,et al.  Silence is also evidence: interpreting dwell time for recommendation from psychological perspective , 2013, KDD.

[6]  Andrei Z. Broder,et al.  A semantic approach to contextual advertising , 2007, SIGIR.

[7]  J. Friedman.  Stochastic gradient boosting , 2002 .

[8]  Hila Becker,et al.  Context transfer in search advertising , 2009, SIGIR.

[9]  Raymond K. Wong,et al.  Framework for timely and accurate ads on mobile devices , 2009, CIKM.

[10]  SangKeun Lee,et al.  Semantic contextual advertising based on the open directory project , 2013, TWEB.

[11]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[12]  Vassilis Plachouras,et al.  A noisy-channel approach to contextual advertising , 2007, ADKDD '07.

[13]  Ryen W. White,et al.  Modeling dwell time to predict click-level satisfaction , 2014, WSDM.

[14]  Haibin Liu,et al.  Characterizing Landing Pages in Sponsored Search , 2012, 2012 Eighth Latin American Web Congress.

[15]  Chih-Jen Lin,et al.  Dual coordinate descent methods for logistic regression and maximum entropy models , 2011, Machine Learning.

[16]  Suju Rajan,et al.  Beyond clicks: dwell time for personalization , 2014, RecSys '14.

[17]  Yang Song,et al.  Exploring and exploiting user search behavior on mobile and tablet devices to improve search relevance , 2013, WWW '13.

[18]  Elizabeth F. Churchill,et al.  Mobile advertising: evaluating the effects of animation, user and content relevance , 2013, CHI.

[19]  B. Matthews.  Comparison of the predicted and observed secondary structure of T4 phage lysozyme. , 1975, Biochimica et biophysica acta.

[20]  D. Sculley,et al.  Predicting bounce rates in sponsored search advertisements , 2009, KDD.

[21]  David Lo,et al.  Predicting response in mobile advertising with hierarchical importance-aware factorization machine , 2014, WSDM.

[22]  Ron Kohavi,et al.  Trustworthy online controlled experiments: five puzzling outcomes explained , 2012, KDD.

[23]  Yejin Choi,et al.  Using landing pages for sponsored search ad selection , 2010, WWW '10.

[24]  Wilfred Ng.  An introduction to Search Engines and Web Navigation [Book review] , 2007 .

[25]  Rómer Rosales,et al.  Post-click conversion modeling and analysis for non-guaranteed delivery display advertising , 2012, WSDM '12.

[26]  Dragomir Yankov,et al.  Categorization of display ads using image and landing page features , 2011, LDMTA '11.