No More Chasing Waterfalls: A Measurement Study of the Header Bidding Ad-Ecosystem

In recent years, Header Bidding (HB) has gained popularity among web publishers, challenging the status quo in the ad ecosystem. Contrary to the traditional waterfall standard, HB aims to give back to publishers control of their ad inventory, increase transparency, fairness and competition among advertisers, resulting in higher ad-slot prices. Although promising, little is known about how this ad protocol works: What are HB's possible implementations, who are the major players, and what is its network and UX overhead? To address these questions, we design and implement HBDetector: a novel methodology to detect HB auctions on a website at realtime. By crawling 35,000 top Alexa websites, we collect and analyze a dataset of 800k auctions. We find that: (i) 14.28% of top websites utilize HB. (ii) Publishers prefer to collaborate with a few Demand Partners who also dominate the waterfall market. (iii) HB latency can be significantly higher (up to 3X in median case) than waterfall.

[1]  Narseo Vallina-Rodriguez,et al.  Apps, Trackers, Privacy, and Regulators: A Global Study of the Mobile Tracking Ecosystem , 2018, NDSS.

[2]  Balachander Krishnamurthy,et al.  For sale : your data: by : you , 2011, HotNets-X.

[3]  Mark Whitley,et al.  To bid, or not to bid ... , 2006 .

[4]  Vijay Erramilli,et al.  Your browsing behavior for a big mac: economics of personal information online , 2011, WWW.

[5]  Narseo Vallina-Rodriguez,et al.  A Long Way to the Top: Significance, Structure, and Stability of Internet Top Lists , 2018, Internet Measurement Conference.

[6]  Aurélien Garivier,et al.  Optimization of a SSP's Header Bidding Strategy using Thompson Sampling , 2018, KDD.

[7]  Christo Wilson,et al.  Diffusion of User Tracking Data in the Online Advertising Ecosystem , 2018, Proc. Priv. Enhancing Technol..

[8]  Claudio Soriente,et al.  Beyond content analysis: detecting targeted ads via distributed counting , 2019, CoNEXT.

[9]  Narseo Vallina-Rodriguez,et al.  Tracking the Trackers: Towards Understanding the Mobile Advertising and Tracking Ecosystem , 2016, ArXiv.

[10]  Claude Castelluccia,et al.  Selling off User Privacy at Auction , 2014, NDSS.

[11]  G. Loewenstein,et al.  What Is Privacy Worth? , 2013, The Journal of Legal Studies.

[12]  Krishna P. Gummadi,et al.  Investigating Ad Transparency Mechanisms in Social Media: A Case Study of Facebooks Explanations , 2018, NDSS.

[13]  Christo Wilson,et al.  Tracing Information Flows Between Ad Exchanges Using Retargeted Ads , 2018, USENIX Security Symposium.

[14]  Rubén Cuevas Rumín,et al.  FDVT: Data Valuation Tool for Facebook Users , 2017, CHI.

[15]  Gianluca Stringhini,et al.  The Dark Alleys of Madison Avenue: Understanding Malicious Advertisements , 2014, Internet Measurement Conference.

[16]  Evangelos P. Markatos,et al.  The Cost of Digital Advertisement: Comparing User and Advertiser Views , 2018, WWW.

[17]  Pablo Rodriguez,et al.  If you are not paying for it, you are the product: how much do advertisers pay to reach you? , 2017, Internet Measurement Conference.

[18]  Nicu Sebe,et al.  Money walks: a human-centric study on the economics of personal mobile data , 2014, UbiComp.

[19]  Arvind Narayanan,et al.  The Web Never Forgets: Persistent Tracking Mechanisms in the Wild , 2014, CCS.

[20]  Evangelos P. Markatos,et al.  Exclusive: How the (synced) Cookie Monster breached my encrypted VPN session , 2018, EuroSec@EuroSys.

[21]  Balachander Krishnamurthy,et al.  Best paper -- Follow the money: understanding economics of online aggregation and advertising , 2013, Internet Measurement Conference.

[22]  Evangelos P. Markatos,et al.  Measuring ad value without bankrupting user privacy , 2019, ArXiv.

[23]  Evangelos P. Markatos,et al.  Cookie Synchronization: Everything You Always Wanted to Know But Were Afraid to Ask , 2018, WWW.

[24]  Sarah L. Nesbeitt.  The Internet Archive Wayback Machine , 2002 .