An Image of Society

Algorithmically-mediated content is both a product and producer of dominant social narratives, and it has the potential to impact users' beliefs and behaviors. We present two studies on the content and impact of gender and racial representation in image search results for common occupations. In Study 1, we compare 2020 workforce gender and racial composition to that reflected in image search. We find evidence of underrepresentation on both dimensions: women are underrepresented in search at a rate of 42% women for a field with 50% women; people of color are underrepresented with 16% in search compared to an occupation with 22% people of color (the latter being proportional to the U.S. workforce). We also compare our gender representation data with that collected in 2015 by Kay et al., finding little improvement in the last half-decade. In Study 2, we study people's impressions of occupations and sense of belonging in a given field when shown search results with different proportions of women and people of color. We find that both axes of representation as well as people's own racial and gender identities impact their experience of image search results. We conclude by emphasizing the need for designers and auditors of algorithms to consider the disparate impacts of algorithmic content on users of marginalized identities.

[1]  Angèle Christin.  Algorithms in practice: Comparing web journalism and criminal justice , 2017 .

[2]  Shaowen Bardzell,et al.  Imagining Intersectional Futures: Feminist approaches in CSCW , 2017, CSCW Companion.

[3]  Valerie Purdie-Vaughns,et al.  Social identity contingencies: how diversity cues signal threat or safety for African Americans in mainstream institutions. , 2008, Journal of personality and social psychology.

[4]  James A. Landay,et al.  Gender-Inclusive Design: Sense of Belonging and Bias in Web Interfaces , 2018, CHI.

[5]  Katheryn R. Christy,et al.  Leaderboards in a virtual classroom: A test of stereotype threat and social comparison explanations for women's math performance , 2014, Comput. Educ..

[6]  Andrea Ballatore,et al.  Google chemtrails: A methodology to analyze topic representation in search engine results , 2015, First Monday.

[7]  Employed persons by detailed occupation , sex , race , and Hispanic or Latino ethnicity , 2015 .

[8]  George B. Cunningham,et al.  Signals and Cues: LGBT Inclusive Advertising and Consumer Attraction , 2014 .

[9]  Johan Fornäs.  Mirroring meetings, mirroring media: The microphysics of reflexivity , 1994 .

[10]  David García,et al.  Bias in Online Freelance Marketplaces: Evidence from TaskRabbit and Fiverr , 2017, CSCW.

[11]  Elaine Swan.  Commodity Diversity: Smiling Faces as a Strategy of Containment , 2010 .

[12]  A. A. Mitchell,et al.  The Effect of Verbal and Visual Components of Advertisements on Brand Attitudes and Attitude Toward the Advertisement , 1986 .

[13]  P. Allison,et al.  Occupational Feminization and Pay: Assessing Causal Dynamics Using 1950-2000 U.S. Census Data , 2009 .

[14]  C. Steele,et al.  Ambient belonging: how stereotypical cues impact gender participation in computer science. , 2009, Journal of personality and social psychology.

[15]  David Lazer,et al.  Auditing the Personalization and Composition of Politically-Related Search Engine Results Pages , 2018, WWW.

[16]  M. Mcneil.  Simians, Cyborgs and Women: The Reinvention of Nature , 1992 .

[17]  Sean A. Munson,et al.  Unequal Representation and Gender Stereotypes in Image Search Results for Occupations , 2015, CHI.

[18]  Paul Baker,et al.  ‘Why do white people have thin lips?’ Google and the perpetuation of stereotypes via auto-complete search forms , 2013 .

[19]  K. Crenshaw.  Demarginalizing the Intersection of Race and Sex: A Black Feminist Critique of Antidiscrimination Doctrine, Feminist Theory and Antiracist Politics , 1989 .

[20]  Gianluca Demartini,et al.  Investigating User Perception of Gender Bias in Image Search: The Role of Sexism , 2018, SIGIR.

[21]  P. Moriearty.  Framing Justice: Media, Bias, and Legal Decisionmaking , 2010 .

[22]  Robert W. Stewart,et al.  Examining the Draw of Diversity: How Diversity Climate Perceptions Affect Job‐Pursuit Intentions , 2013 .

[23]  S. L. Star,et al.  The Ethnography of Infrastructure , 1999 .

[24]  Ella Hamonic,et al.  Welcome to the Course: Early Social Cues Influence Women's Persistence in Computer Science , 2020, CHI.

[25]  J. Landay,et al.  SearchMedia and Elections : A Longitudinal Investigation of Political Search Results in the 2018 U . S . Elections , 2019 .

[26]  Derek R. Avery.  Reactions to diversity in recruitment advertising--are differences black and white? , 2003, The Journal of applied psychology.

[27]  Krishna P. Gummadi,et al.  Search bias quantification: investigating political bias in social media and web search , 2018, Information Retrieval Journal.

[28]  Ronald E. Robertson,et al.  The search engine manipulation effect (SEME) and its possible impact on the outcomes of elections , 2015, Proceedings of the National Academy of Sciences.

[29]  F. Tripodi.  Searching for Alternative Facts , 2018 .

[30]  D. Fitch,et al.  Review of "Algorithms of oppression: how search engines reinforce racism," by Noble, S. U. (2018). New York, New York: NYU Press. , 2018, CDQR.

[31]  Timothy D. Pippert,et al.  We've got minorities, yes we do: visual representations of racial and ethnic diversity in college recruitment materials , 2013 .

[32]  Karrie Karahalios,et al.  Auditing Race and Gender Discrimination in Online Housing Markets , 2020, ICWSM.

[33]  A. M. Hamilton.  A Genealogy of Critical Race and Digital Studies: Past, Present, and Future , 2020, Sociology of Race and Ethnicity.

[34]  A. Evans.  Diversity in gender and visual representation: a commentary , 2015, Diversity in Gender and Visual Representation.

[35]  Christo Wilson,et al.  Investigating the Impact of Gender on Rank in Resume Search Engines , 2018, CHI.

[36]  Laura E. Buffardi,et al.  "What about me?" Perceptions of exclusion and whites' reactions to multiculturalism. , 2011, Journal of personality and social psychology.

[37]  Inioluwa Deborah Raji,et al.  Actionable Auditing: Investigating the Impact of Publicly Naming Biased Performance Results of Commercial AI Products , 2019, AIES.

[38]  Shelley J. Correll,et al.  Constraints into Preferences: Gender, Status, and Emerging Career Aspirations , 2004 .

[39]  Karrie Karahalios,et al.  Auditing Algorithms : Research Methods for Detecting Discrimination on Internet Platforms , 2014 .

[40]  Christian Sandvig,et al.  Infrastructure studies meet platform studies in the age of Google and Facebook , 2018, New Media Soc..

[41]  Latanya Sweeney,et al.  Discrimination in online ad delivery , 2013, CACM.