Exploring User Perceptions of Discrimination in Online Targeted Advertising

Targeted online advertising now accounts for the largest share of the advertising market, beating out both TV and print ads. While targeted advertising can improve users’ online shopping experiences, it can also have negative effects. A plethora of recent work has found evidence that in some cases, ads may be discriminatory, leading certain groups of users to see better offers (e.g., job ads) based on personal characteristics such as gender. To develop policies around advertising and guide advertisers in mak­ ing ethical decisions, one thing we must better understand is what concerns users and why. In an effort to answer this question, we conducted a pilot study and a multi-step main survey (n=2,086 in total) presenting users with dif­ ferent discriminatory advertising scenarios. We find that overall, 44% of respondents were moderately or very con­ cerned by the scenarios we presented. Respondents found the scenarios significantly more problematic when dis­ crimination took place as a result of explicit demographic targeting rather than in response to online behavior. How­ ever, our respondents’ opinions did not vary based on whether a human or an algorithm was responsible for the discrimination. These findings suggest that future pol­ icy documents should explicitly address discrimination in targeted advertising, no matter its origin, as a significant user concern, and that corporate responses that blame the algorithmic nature of the ad ecosystem may not be helpful for addressing public concerns.

[1]  N. Levinson The Wiener (Root Mean Square) Error Criterion in Filter Design and Prediction , 1946 .

[2]  H. Akaike A new look at the statistical model identification , 1974 .

[3]  Robert Tibshirani,et al.  Bootstrap Methods for Standard Errors, Confidence Intervals, and Other Measures of Statistical Accuracy , 1986 .

[4]  D. Hosmer,et al.  Applied Logistic Regression , 1991 .

[5]  S. Goodman,et al.  Multiple comparisons, explained. , 1998, American journal of epidemiology.

[6]  S. Lange,et al.  Adjusting for multiple testing--when and how? , 2001, Journal of clinical epidemiology.

[7]  E. McColl Cognitive Interviewing. A Tool for Improving Questionnaire Design , 2006, Quality of Life Research.

[8]  Bernhard Debatin,et al.  Facebook and Online Privacy: Attitudes, Behaviors, and Unintended Consequences , 2009, J. Comput. Mediat. Commun..

[9]  J. Turow,et al.  Americans Reject Tailored Advertising and Three Activities that Enable It , 2009 .

[10]  David S. Evans The Online Advertising Industry: Economics, Evolution, and Privacy , 2009 .

[11]  T. Rex A practical guide to the American Community Survey (5-year estimates) , 2010 .

[12]  Lorrie Faith Cranor,et al.  Americans' attitudes about internet behavioral advertising practices , 2010, WPES '10.

[13]  D. Bergemann,et al.  TARGETING IN ADVERTISING MARKETS: IMPLICATIONS FOR OFFLINE VS. ONLINE MEDIA By , 2010 .

[14]  Panagiotis G. Ipeirotis Demographics of Mechanical Turk , 2010 .

[15]  Saikat Guha,et al.  Challenges in measuring online advertising systems , 2010, IMC '10.

[16]  CAN SEARCH DISCRIMINATION BY A MONOPOLIST VIOLATE U.S. ANTITRUST LAWS? , 2011 .

[17]  Avi Goldfarb,et al.  Online advertising, behavioral targeting, and privacy , 2011, Commun. ACM.

[18]  R. Shay,et al.  Measuring the Effectiveness of Privacy Tools for Limiting Behavioral Advertising , 2012 .

[19]  Craig E. Wills,et al.  Understanding what they do with what they know , 2012, WPES '12.

[20]  Vijay Erramilli,et al.  Detecting price and search discrimination on the internet , 2012, HotNets-XI.

[21]  M. Angela Sasse,et al.  Too close for comfort: a study of the effectiveness and acceptability of rich-media personalized advertising , 2012, CHI.

[22]  Latanya Sweeney,et al.  Discrimination in online ad delivery , 2013, CACM.

[23]  Yang Wang,et al.  What matters to users?: factors that affect users' willingness to share information with online advertisers , 2013, SOUPS.

[24]  Ramesh Govindan,et al.  AdReveal: improving transparency into online targeted advertising , 2013, HotNets.

[25]  Roxana Geambasu,et al.  XRay: Enhancing the Web's Transparency with Differential Correlation , 2014, USENIX Security Symposium.

[26]  Qiang Ma,et al.  Adscape: harvesting and analyzing online display ads , 2014, WWW.

[27]  Vijay Erramilli,et al.  I always feel like somebody's watching me: measuring online behavioural advertising , 2014, CoNEXT.

[28]  Michael Carl Tschantz,et al.  Automated Experiments on Ad Privacy Settings , 2014, Proc. Priv. Enhancing Technol..

[29]  D. Tingley,et al.  “Who are these people?” Evaluating the demographic characteristics and political preferences of MTurk survey respondents , 2015 .

[30]  Roxana Geambasu,et al.  Sunlight: Fine-grained Targeting Detection at Scale with Statistical Confidence , 2015, CCS.

[31]  Allison Woodruff,et al.  Intuitions, Analytics, and Killing Ants: Inference Literacy of High School-educated Adults in the US , 2016, SOUPS.

[32]  Alethea Lange A User-Centered Perspective on Algorithmic Personalization , 2017 .

[33]  Jaeyoung Choi,et al.  The Accuracy of the Demographic Inferences Shown on Google's Ad Settings , 2018, WPES@CCS.