FACTS-IR: Fairness, Accountability, Confidentiality, Transparency, and Safety in Information Retrieval

The purpose of the SIGIR 2019 workshop on Fairness, Accountability, Confidentiality, Transparency, and Safety (FACTS-IR) was to explore challenges in responsible information retrieval system development and deployment. To this end, the workshop aimed to crowd-source from the larger SIGIR community and draft an actionable research agenda on five key dimensions of responsible information retrieval: fairness, accountability, confidentiality, transparency, and safety. Such an agenda can guide others in the community that are interested in pursuing FACTS-IR research, as well as inform potential funders about relevant research avenues. The workshop brought together a diverse set of researchers and practitioners interested in contributing to the development of a technical research agenda for responsible information retrieval.

[1]  D. Boyd,et al.  Data Voids: Where Missing Data Can Easily Be Exploited , 2018 .

[2]  Ryen W. White Beliefs and biases in web search , 2013, SIGIR.

[3]  Helen Nissenbaum,et al.  Bias in computer systems , 1996, TOIS.

[4]  Helen Nissenbaum,et al.  Shaping the Web: Why the Politics of Search Engines Matters , 2000, Inf. Soc..

[5]  Krishna P. Gummadi,et al.  Equity of Attention: Amortizing Individual Fairness in Rankings , 2018, SIGIR.

[6]  M. de Rijke,et al.  Workshop on Fairness, Accountability, Confidentiality, Transparency, and Safety in Information Retrieval (FACTS-IR) , 2019, SIGIR.

[7]  Sowmya Karunakaran,et al.  Testing Stylistic Interventions to Reduce Emotional Impact of Content Moderation Workers , 2019, HCOMP.

[8]  Alexandra Chouldechova,et al.  Bias in Bios: A Case Study of Semantic Representation Bias in a High-Stakes Setting , 2019, FAT.

[9]  M. de Rijke,et al.  Finding Influential Training Samples for Gradient Boosted Decision Trees , 2018, ICML.

[10]  Justin M. Rao,et al.  Filter Bubbles, Echo Chambers, and Online News Consumption , 2016 .

[11]  Carlos Castillo,et al.  Social Data: Biases, Methodological Pitfalls, and Ethical Boundaries , 2019, Front. Big Data.

[12]  Maura R. Grossman,et al.  Technology-Assisted Review in E-Discovery Can Be More Effective and More Efficient Than Exhaustive Manual Review , 2011 .

[13]  Andrew D. Selbst,et al.  Big Data's Disparate Impact , 2016 .

[14]  Craig MacDonald,et al.  Active Learning Strategies for Technology Assisted Sensitivity Review , 2018, ECIR.

[15]  David García,et al.  Bias in Online Freelance Marketplaces: Evidence from TaskRabbit and Fiverr , 2017, CSCW.

[16]  Michael Veale,et al.  When data protection by design and data subject rights clash , 2018 .

[17]  Lee A. Bygrave,et al.  A right to be forgotten? , 2014, Commun. ACM.

[18]  Sean A. Munson,et al.  Bursting your (filter) bubble: strategies for promoting diverse exposure , 2013, CSCW '13.

[19]  Ben Hutchinson,et al.  50 Years of Test (Un)fairness: Lessons for Machine Learning , 2018, FAT.

[20]  Michael Veale,et al.  Algorithms that remember: model inversion attacks and data protection law , 2018, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[21]  Peng Wang,et al.  Game of Missuggestions: Semantic Analysis of Search-Autocomplete Manipulations , 2018, NDSS.

[22]  Meredith Ringel Morris,et al.  Augmenting web pages and search results to support credibility assessment , 2011, CHI.

[23]  Michael Veale,et al.  When data protection by design and data subject rights clash , 2018 .

[24]  Matthew Lease,et al.  But Who Protects the Moderators? The Case of Crowdsourced Image Moderation , 2018, 1804.10999.

[25]  Yong-Yeol Ahn,et al.  Twitter's Glass Ceiling: The Effect of Perceived Gender on Online Visibility , 2016, ICWSM.

[26]  Berkeley J. Dietvorst,et al.  Algorithm Aversion: People Erroneously Avoid Algorithms after Seeing Them Err , 2014, Journal of experimental psychology. General.

[27]  Tim Miller,et al.  Explainable AI: Beware of Inmates Running the Asylum Or: How I Learnt to Stop Worrying and Love the Social and Behavioural Sciences , 2017, ArXiv.

[28]  Fernando Diaz,et al.  Auditing Search Engines for Differential Satisfaction Across Demographics , 2017, WWW.

[29]  Ana-Andreea Stoica,et al.  Algorithmic Glass Ceiling in Social Networks: The effects of social recommendations on network diversity , 2018, WWW.

[30]  D. Pozen,et al.  The Mosaic Theory, National Security, and the Freedom of Information Act , 2005 .

[31]  Amanda Spink,et al.  Web search : multidisciplinary perspectives , 2008 .

[32]  Abbe Mowshowitz,et al.  Bias on the web , 2002, CACM.

[33]  Eric Goldman,et al.  Search Engine Bias and the Demise of Search Engine Utopianism , 2006 .

[34]  Douglas W. Oard,et al.  Evaluation of information retrieval for E-discovery , 2010, Artificial Intelligence and Law.