Stakeholder Participation in AI: Beyond "Add Diverse Stakeholders and Stir"

Both AI and HCI communities increasingly call for more stakeholder participation in AI system design, development, and maintenance [60, 56, 31, 59, 45]. Participation can allow AI systems to better reflect their end users’ and stakeholders’ values, preferences, and needs. It can also help scholars and practitioners to better anticipate and account for AI’s negative downstream impacts, such as fairness and equity breakdowns [6, 25, 23, 42]. In parallel and responding to these calls, participatory AI projects and research publications have started to emerge across HCI and AI communities [46, 34, 27].

[1]  S. Arnstein,et al.  Ladder of Citizen Participation , 2020 .

[2]  J. Gregory.  Scandinavian Approaches to Participatory Design , 2003 .

[3]  Aaron Halfaker,et al.  Keeping Community in the Loop: Understanding Wikipedia Stakeholder Values for Machine Learning-Based Systems , 2020, CHI.

[4]  Judith S. Olson,et al.  Ways of Knowing in HCI , 2014, Springer New York.

[5]  Dharma Dailey,et al.  An Action-Oriented AI Policy Toolkit for Technology Audits by Community Advocates and Activists , 2021, FAccT.

[6]  Devansh Saxena,et al.  A Framework of High-Stakes Algorithmic Decision-Making for the Public Sector Developed through a Case Study of Child-Welfare , 2021, Proc. ACM Hum. Comput. Interact..

[7]  J. Dewey,et al.  The Public and its Problems , 1927 .

[8]  Ariel D. Procaccia,et al.  WeBuildAI , 2019, Proc. ACM Hum. Comput. Interact..

[9]  Marc Steen,et al.  Co-Design as a Process of Joint Inquiry and Imagination , 2013, Design Issues.

[10]  A. Sen,et al.  Social Choice Theory , 1980 .

[11]  Karel Vredenburg,et al.  The state of user-centered design practice , 2005, IEEE Engineering Management Review.

[12]  Dylan Mulvin.  Proxies: The Cultural Work of Standing In , 2021 .

[13]  Alan Borning,et al.  Designing for Human Values in a Urban Simulation System: Value Sensitive Design and Participatory design , 2004 .

[14]  Zoë Hitzig.  The normative gap: mechanism design and ideal theories of justice , 2019, Economics and Philosophy.

[15]  Tone Bratteteig,et al.  Does AI make PD obsolete?: exploring challenges from artificial intelligence to participatory design , 2018, PDC.

[16]  Andrew Smart,et al.  Participatory Problem Formulation for Fairer Machine Learning Through Community Based System Dynamics , 2020, ArXiv.

[17]  C. B. Macpherson,et al.  Democratic Theory: Essays in Retrieval , 1973 .

[18]  Stefan Holmlid,et al.  Participative, co-operative, emancipatory : From participatory design to service design , 2012 .

[19]  W. Lippmann.  The Phantom Public , 1925 .

[20]  Gillian R. Hayes.  Knowing by Doing: Action Research as an Approach to HCI , 2014, Ways of Knowing in HCI.

[21]  Kira Goldner,et al.  Mechanism design for social good , 2018, SIGAI.

[22]  Ana-Andreea Stoica,et al.  Bridging Machine Learning and Mechanism Design towards Algorithmic Fairness , 2021, FAccT.

[23]  Michael J. Muller,et al.  Participatory design , 1993, CACM.

[24]  James S. Fishkin,et al.  Experimenting with a Democratic Ideal: Deliberative Polling and Public Opinion , 2005 .

[25]  Jesper Simonsen,et al.  Routledge International Handbook of Participatory Design , 2012 .

[26]  L. A. Goodman,et al.  Social Choice and Individual Values , 1951 .

[27]  Daria Loi,et al.  PD manifesto for AI futures , 2018, PDC.

[28]  Christopher A. Le Dantec,et al.  Strangers at the Gate: Gaining Access, Building Rapport, and Co-Constructing Community-Based Research , 2015, CSCW.

[29]  Anna Lauren Hoffmann,et al.  Terms of inclusion: Data, discourse, violence , 2020, New Media Soc..

[30]  Daniel L. King,et al.  Freedom is an endless meeting , 2012 .

[31]  Maaike Kleinsmann,et al.  Barriers and enablers for creating shared understanding in co-design projects , 2008 .

[32]  Lauge Baungaard Rasmussen,et al.  Action research—Scandinavian experiences , 2004, AI & SOCIETY.

[33]  L. Hulgård,et al.  Action research and participatory democracy in social enterprise , 2019, Social Enterprise Journal.

[34]  Amalia de Götzen,et al.  Service design and participatory design: time to join forces? , 2020, PDC.

[35]  Michael J. Muller,et al.  Participatory design: the third space in HCI , 2002 .

[36]  Haiyi Zhu,et al.  The Changing Contours of "Participation" in Data-driven, Algorithmic Ecosystems: Challenges, Tactics, and an Agenda , 2018, CSCW Companion.

[37]  A. Sen,et al.  Social Choice Theory: A Re-Examination , 1977 .

[38]  Jake Goldenfein,et al.  Design choices: Mechanism design and platform capitalism , 2021, Big Data & Society.

[39]  Niloufar Salehi,et al.  What If I Don't Like Any Of The Choices? The Limits of Preference Elicitation for Participatory Algorithm Design , 2020, ArXiv.

[40]  Jodi Forlizzi,et al.  Moving beyond user-centered design , 2018, Interactions.

[41]  Kim M. Unertl,et al.  Integrating community-based participatory research and informatics approaches to improve the engagement and health of underserved populations , 2015, J. Am. Medical Informatics Assoc..

[42]  N. Wallerstein,et al.  Using Community-Based Participatory Research to Address Health Disparities , 2006, Health promotion practice.

[43]  John Elliott,et al.  Action research for educational change , 1991 .

[44]  Alan Borning,et al.  Value Sensitive Design: Theory and Methods , 2002 .

[45]  Haiyi Zhu,et al.  Introduction to this special issue on unifying human computer interaction and artificial intelligence , 2020, Hum. Comput. Interact..

[46]  David Owen,et al.  Survey Article: Deliberation, Democracy, and the Systemic Turn , 2015 .

[47]  Archon Fung.  Varieties of Participation in Complex Governance , 2006 .

[48]  Pieter Jan Stappers,et al.  Co-creation and the new landscapes of design , 2008 .