Hiring Algorithms: An Ethnography of Fairness in Practice

Although AI is claimed to be superior over human experts in terms of objectivity, efficiency, and effectiveness (Hipps 2017; Miller 2015), its growing influence on the outcomes of our daily lives has become increasingly a source of concern. Critics have accused AI of committing ethical violations, such as being racist, sexist, or harming privacy (Crawford and Calo 2016; O'Neil 2016). For example, Amazon recently had to withdraw its automatic hiring algorithm after discovering that it consistently downgraded resumes of female candidates (Dastin 2018). Several agendas have therefore emerged aimed at addressing and solving ethical issues surrounding AI applications, for example, by calling for regulations to enforce transparency, simplifying machine learning models, or devising auditing algorithms that can evaluate discriminatory outcomes (Crawford and Calo 2016; O'Neil 2016; Pasquale 2015; Selbst et al. 2019). However, so far literature offers little insight into how organizations deal with ethical values and AI in practice. Therefore, this research aims to address the following research question: how do organizational groups engage with AI in practice and how are their ethical values being reconfigured?

[1]  Joshua B. Barbour,et al.  Analytics and expert collaboration: How individuals navigate relationships when working with organizational data , 2018 .

[2]  Ryan Calo,et al.  There is a blind spot in AI research , 2016, Nature.

[3]  Apurv Jain Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy , 2017, Business Economics.

[4]  Wanda J. Orlikowski,et al.  What Happens When Evaluation Goes Online? Exploring Apparatuses of Valuation in the Travel Sector , 2014, Organ. Sci..

[5]  Danah Boyd,et al.  Fairness and Abstraction in Sociotechnical Systems , 2019, FAT.

[6]  Jean Paul Isson,et al.  People analytics in the era of big data , 2016 .

[7]  A. Langley Strategies for Theorizing from Process Data , 1999 .

[8]  Frank A. Pasquale The Black Box Society: The Secret Algorithms That Control Money and Information , 2015 .

[9]  Sue Newell,et al.  Strategic opportunities (and challenges) of algorithmic decision-making: A call for action on the long-term societal effects of 'datification' , 2015, J. Strateg. Inf. Syst..

[10]  R. Boire Predictive analytics: The power to predict who will click, buy, lie, or die , 2013 .

[11]  Wanda J. Orlikowski,et al.  Creating Value in Online Communities: The Sociomaterial Configuring of Strategy, Platform, and Stakeholder Engagement , 2016, Inf. Syst. Res..

[12]  Tina Blegind Jensen,et al.  People Analytics in the Age of Big Data: An Agenda for IS Research , 2017, ICIS.

[13]  Raghu Garud,et al.  Values Work: A Process Study of the Emergence and Performance of Organizational Values Practices , 2013 .