Not Just a Preference: Reducing Biased Decision-making on Dating Websites

As dating websites are becoming an essential part of how people meet intimate and romantic partners, it is vital to design these systems to be resistant to, or at least do not amplify, bias and discrimination. Instead, the results of our online experiment with a simulated dating website, demonstrate that popular dating website design choices, such as the user of the swipe interface (swiping in one direction to indicate a like and in the other direction to express a dislike) and match scores, resulted in people racially biases choices even when they explicitly claimed not to have considered race in their decision-making. This bias was significantly reduced when the order of information presentation was reversed such that people first saw substantive profile information related to their explicitly-stated preferences before seeing the profile name and photo. These results indicate that currently-popular design choices amplify people’s implicit biases in their choices of potential romantic partners, but the effects of the implicit biases can be reduced by carefully redesigning the dating website interfaces.

[1]  Krzysztof Z Gajos,et al.  Do People Engage Cognitively with AI? Impact of AI Assistance on Incidental Learning , 2022, IUI.

[2]  Krzysztof Z. Gajos,et al.  To Trust or to Think , 2021, Proc. ACM Hum. Comput. Interact..

[3]  Calvin A. Liang,et al.  Surveillance, Stigma & Sociotechnical Design for HIV , 2020, First Monday.

[4]  Bernd Huber,et al.  Conducting online virtual environment experiments with uncompensated, unsupervised samples , 2020, PloS one.

[5]  Katharina Reinecke,et al.  Controlling for Participants’ Viewing Distance in Large-Scale, Psychophysical Online Experiments Using a Virtual Chinrest , 2020, Scientific Reports.

[6]  M. Mildner,et al.  Re-epithelialization and immune cell behaviour in an ex vivo human skin model , 2020, Scientific Reports.

[7]  Emily Denton,et al.  Towards a critical race methodology in algorithmic fairness , 2019, FAT*.

[8]  BEN GREEN,et al.  The Principles and Limits of Algorithm-in-the-Loop Decision Making , 2019, Proc. ACM Hum. Comput. Interact..

[9]  S. Hurst,et al.  Interventions designed to reduce implicit prejudices and implicit stereotypes in real world contexts: a systematic review , 2019, BMC Psychology.

[10]  M. Heilman,et al.  The Multiple Dimensions of Gender Stereotypes: A Current Look at Men’s and Women’s Characterizations of Others and Themselves , 2019, Front. Psychol..

[11]  Ben Green,et al.  Disparate Interactions: An Algorithm-in-the-Loop Analysis of Fairness in Risk Assessments , 2019, FAT.

[12]  Ben Green,et al.  Data Science as Political Action: Grounding Data Science in a Politics of Justice , 2018, J. Soc. Comput..

[13]  Grace Kao,et al.  Asian American Men in Romantic Dating Markets , 2018, Contexts.

[14]  Christopher T. Conner.  The Gay Gayze: Expressions of Inequality on Grindr , 2018, The Sociological Quarterly.

[15]  Katharina Reinecke,et al.  Volunteer-Based Online Studies With Older Adults and People with Disabilities , 2018, ASSETS.

[16]  Solon Barocas,et al.  Debiasing Desire , 2018, Proc. ACM Hum. Comput. Interact..

[17]  R. Romano.  Something Old, Something New: Black Women, Interracial Dating, and the Black Marriage Crisis , 2018, differences.

[18]  M. Kollmayer,et al.  Gender stereotypes in education: Development, consequences, and interventions , 2018 .

[19]  Chong‐suk Han,et al.  Very Few People Say “No Whites”: Gay Men of Color and the Racial Politics of Desire , 2018, Sociological spectrum : the official journal of the Mid-South Sociological Association.

[20]  Barbara E. Engelhardt,et al.  How algorithmic confounding in recommendation systems increases homogeneity and decreases utility , 2017, RecSys.

[21]  Josue Ortega,et al.  The Strength of Absent Ties: Social Integration via Online Dating , 2017, ArXiv.

[22]  Paul W. Eastwick,et al.  Is Romantic Desire Predictable? Machine Learning Applied to Initial Romantic Attraction , 2017, Psychological science.

[23]  Carl Vogel,et al.  Women's perspective on using Tinder: a user study of gender dynamics in a mobile device application , 2017, SIGDOC.

[24]  L. Winner.  Do Artifacts Have Politics? , 2017, Emerging Technologies: Ethics, Law and Governance.

[25]  Silvia Lindtner,et al.  Constructing a Desiring User: Discourse, Rurality, and Design in Location-Based Social Networks , 2017, CSCW.

[26]  Cynthia Feliciano,et al.  Racialized Femininity and Masculinity in the Preferences of Online Same-sex Daters , 2017 .

[27]  Julius Daugbjerg Bjerrekær,et al.  The OKCupid dataset: A very large public dataset of dating site users , 2016 .

[28]  L. Hausmann,et al.  The Impact of Cognitive Stressors in the Emergency Department on Physician Implicit Racial Bias. , 2016, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[29]  Gary O'Reilly,et al.  Dual-process cognitive interventions to enhance diagnostic reasoning: a systematic review , 2016, BMJ Quality & Safety.

[30]  Tamera Coyne-Beasley,et al.  Implicit Racial/Ethnic Bias Among Health Care Professionals and Its Influence on Health Care Outcomes: A Systematic Review. , 2015, American journal of public health.

[31]  Sonu Bedi.  Sexual Racism: Intimacy as a Matter of Justice , 2015, The Journal of Politics.

[32]  Christy E. Newman,et al.  Is Sexual Racism Really Racism? Distinguishing Attitudes Toward Sexual Racism and Generic Racism Among Gay and Bisexual Men , 2015, Archives of Sexual Behavior.

[33]  Katharina Reinecke,et al.  LabintheWild: Conducting Large-Scale Online Experiments With Uncompensated Samples , 2015, CSCW.

[34]  N. McGlynn.  Thinking fast and slow. , 2014, Australian veterinary journal.

[35]  Hyun Jung Oh,et al.  Effects of race, visual anonymity, and social category salience on online dating outcomes , 2014, Comput. Hum. Behav..

[36]  M. Workman,et al.  The effect of cognitive load and patient race on physicians' decisions to prescribe opioids for chronic low back pain: a randomized trial. , 2014, Pain medicine.

[37]  Ernesto Reuben,et al.  How stereotypes impair women’s careers in science , 2014, Proceedings of the National Academy of Sciences.

[38]  Kevin Lewis.  The limits of racial prejudice , 2013, Proceedings of the National Academy of Sciences.

[39]  K. Nakayama,et al.  Is the Web as good as the lab? Comparable performance from Web and lab in cognitive/perceptual experiments , 2012, Psychonomic Bulletin & Review.

[40]  Michael J. Rosenfeld,et al.  Searching for a Mate , 2012 .

[41]  G. Millett,et al.  Modeling the impact of social discrimination and financial hardship on the sexual risk of HIV among Latino and Black men who have sex with men. , 2012, American journal of public health.

[42]  Paul W. Eastwick,et al.  Online Dating , 2012, Psychological science in the public interest : a journal of the American Psychological Society.

[43]  H. Raymond,et al.  Preference for and Maintenance of Anal Sex Roles Among Men Who Have Sex with Men: Sociodemographic and Behavioral Correlates , 2011, Archives of sexual behavior.

[44]  M. Banaji,et al.  Implicit race attitudes predict trustworthiness judgments and economic trust decisions , 2011, Proceedings of the National Academy of Sciences.

[45]  Magdalena Szumilas.  Explaining odds ratios. , 2010, Journal of the Canadian Academy of Child and Adolescent Psychiatry = Journal de l'Academie canadienne de psychiatrie de l'enfant et de l'adolescent.

[46]  Sophie Chen,et al.  How Big is a Big Odds Ratio? Interpreting the Magnitudes of Odds Ratios in Epidemiological Studies , 2010, Commun. Stat. Simul. Comput..

[47]  Diana J. Burgess.  Are Providers More Likely to Contribute to Healthcare Disparities Under High Levels of Cognitive Load? How Features of the Healthcare Setting May Lead to Biases in Medical Decision Making , 2010, Medical decision making : an international journal of the Society for Medical Decision Making.

[48]  Elizabeth Aura McClintock.  When Does Race Matter? Race, Sex, and Dating at an Elite University , 2010 .

[49]  Lindsay Steenberg.  The hypersexuality of race: performing Asian/American women on screen and scene , 2009 .

[50]  Cynthia Feliciano,et al.  Internet Daters’ Body Type Preferences: Race–Ethnic and Gender Differences , 2009, Sex roles.

[51]  Cynthia Feliciano,et al.  Gendered racial exclusion among White internet daters. , 2009, Social science research.

[52]  Kecia M. Thomas,et al.  From Mammy to Superwoman , 2008 .

[53]  J. Shiao,et al.  “SOME ASIAN MEN ARE ATTRACTIVE TO ME, BUT FOR A HUSBAND …” , 2008, Du Bois Review: Social Science Research on Race.

[54]  Chong-suk Han,et al.  No fats, femmes, or Asians: the utility of critical race theory in examining the role of gay stock stories in the marginalization of gay Asian men , 2008 .

[55]  M. Poon,et al.  Negotiating Social Stigma Among Gay Asian Men , 2008 .

[56]  Eva Illouz.  Cold Intimacies: The Making of Emotional Capitalism , 2007 .

[57]  Chong-suk Han,et al.  They Don't Want To Cruise Your Type: Gay Men of Color and the Racial Politics of Exclusion , 2007 .

[58]  Brent Berry,et al.  Friends for better or for worse: Interracial friendship in the United States as seen through wedding party photos , 2006, Demography.

[59]  A. Greenwald,et al.  Implicit Bias: Scientific Foundations , 2006 .

[60]  Donald Braman.  Of Race and Immutability , 2005 .

[61]  M. Dutton.  :Carnal Knowledge and Imperial Power: Race and the Intimate in Colonial Rule , 2004 .

[62]  Adrienne Y. Stith,et al.  Unequal treatment: confronting racial and ethnic disparities in health care. , 2003 .

[63]  J. Jacobs,et al.  Gender Differentials in Intermarriage Among Sixteen Race and Ethnic Groups , 2002 .

[64]  R. Schoen,et al.  The Retrenchment of Marriage: Results from Marital Status Life Tables for the United States, 1995 , 2001 .

[65]  A. McConnell,et al.  Relations among the Implicit Association Test, Discriminatory Behavior, and Explicit Measures of Racial Attitudes , 2001 .

[66]  Eliot R. Smith,et al.  Dual-Process Models in Social and Cognitive Psychology: Conceptual Integration and Links to Underlying Memory Systems , 2000 .

[67]  N. Roese,et al.  Impression valence constrains social explanations: the case of discounting versus conjunction effects. , 1999, Journal of personality and social psychology.

[68]  B. Gilmore.  Jim Crow , 1998 .

[69]  Curtis D. Hardin,et al.  Implicit Stereotyping in Person Judgment. , 1993 .

[70]  David M. Sanbonmatsu,et al.  On the automatic activation of attitudes. , 1986, Journal of personality and social psychology.

[71]  N. Anderson,et al.  Primacy effects in personality impression formation. , 1961, Journal of abnormal and social psychology.

[72]  S. Asch.  Forming impressions of personality. , 1946, Journal of abnormal psychology.

[73]  J. Polanin,et al.  Converting between effect sizes , 2016 .

[74]  J. Steiner,et al.  Unconscious (implicit) bias and health disparities: where do we go from here? , 2011, The Permanente journal.

[75]  J. Steiner,et al.  Unconscious(Implicit)BiasandHealthDisparities: WhereDoWeGofromHere? , 2011 .

[76]  M. Jackson,et al.  From the Cover: Identifying the roles of race-based choice and chance in high school friendship network formation , 2010 .

[77]  J. de Houwer,et al.  Implicit measures: A normative analysis and review. , 2009, Psychological bulletin.

[78]  N. Ambady,et al.  Stereotyping, Prejudice, and Discrimination , 2004 .

[79]  Carl S. Hantman,et al.  U.S. CENSUS BUREAU , 2001 .

[80]  M. Banaji,et al.  Implicit social cognition: attitudes, self-esteem, and stereotypes. , 1995, Psychological review.

[81]  P. Devine.  Stereotypes and prejudice: Their automatic and controlled components. , 1989 .