Judgment Call the Game: Using Value Sensitive Design and Design Fiction to Surface Ethical Concerns Related to Technology

Artificial intelligence (AI) technologies are complex socio-technical systems that, while holding much promise, have frequently caused societal harm. In response, corporations, non-profits, and academic researchers have mobilized to build responsible AI, yet how to do this is unclear. Toward this aim, we designed Judgment Call, a game for industry product teams to surface ethical concerns using value sensitive design and design fiction. Through two industry workshops, we found Judgment Call to be effective for considering technology from multiple perspectives and identifying ethical concerns. This work extends value sensitive design and design fiction to ethical AI and demonstrates the game's effective use in industry.

[1]  Kevin I.-J. Ho,et al.  What Would You Do?: Design Fiction and Ethics , 2018, GROUP.

[2]  Robert Jungk,et al.  Future Workshops: How to Create Desirable Futures , 1996 .

[3]  Alan Borning,et al.  A Survey of Value Sensitive Design Methods , 2018, Found. Trends Hum. Comput. Interact..

[4]  Casey Fiesler,et al.  Ad Empathy: A Design Fiction , 2018, GROUP.

[5]  Joseph Lindley,et al.  Back to the future: 10 years of design fiction , 2015, BCS HCI.

[6]  Miroslav Dudík,et al.  Improving Fairness in Machine Learning Systems: What Do Industry Practitioners Need? , 2018, CHI.

[7]  Daisy Yoo,et al.  Stakeholder Tokens: a constructive method for value sensitive design stakeholder analysis , 2017, Ethics and Information Technology.

[8]  Timnit Gebru,et al.  Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification , 2018, FAT.

[9]  Predrag V. Klasnja,et al.  Envisioning systemic effects on persons and society throughout interactive system design , 2008, DIS '08.

[10]  Pierre Wack,et al.  Scenarios : Uncharted Waters Ahead , 1996 .

[11]  David G. Hendry,et al.  Value Sensitive Design , 2019 .

[12]  Latanya Sweeney,et al.  Discrimination in online ad delivery , 2013, CACM.

[13]  Richmond Y. Wong,et al.  When BCIs have APIs: Design Fictions of Everyday Brain-Computer Interface Adoption , 2018, Conference on Designing Interactive Systems.

[14]  michel.  Google's Selfish Ledger is an unsettling vision of Silicon Valley social engineering - e-traces , 2018 .

[15]  Anthony Dunne,et al.  Speculative Everything: Design, Fiction, and Social Dreaming , 2013 .