Qualitative Analysis for Human Centered AI

Human-centered artificial intelligence (AI) posits that machine learning and AI should be developed and applied in a socially aware way. In this article, we argue that qualitative analysis (QA) can be a valuable tool in this process, supplementing, informing, and extending the possibilities of AI models. We show this by describing how QA can be integrated in the current prediction paradigm of AI, assisting scientists in the process of selecting data, variables, and model architectures. Furthermore, we argue that QA can be a part of novel paradigms towards Human Centered AI. QA can support scientists and practitioners in practical problem solving and situated model development. It can also promote participatory design approaches, reveal understudied and emerging issues in AI systems, and assist policy making.

[1]  Karamjit S. Gill.  Prediction paradigm: the human price of instrumentalism , 2020, AI & SOCIETY.

[2]  Laura Forlano,et al.  Participation Is not a Design Fix for Machine Learning , 2020, EAAMO.

[3]  Adam D. Reich,et al.  Algorithmic Control in Platform Food Delivery Work , 2019, Socius: Sociological Research for a Dynamic World.

[4]  Toniann Pitassi,et al.  Fairness through awareness , 2011, ITCS '12.

[5]  Blake Lemoine,et al.  Mitigating Unwanted Biases with Adversarial Learning , 2018, AIES.

[6]  Leo Breiman,et al.  Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author) , 2001 .

[7]  Arvind Narayanan,et al.  Mitigating dataset harms requires stewardship: Lessons from 1000 papers , 2021, NeurIPS Datasets and Benchmarks.

[8]  Sean M. McNee,et al.  Being accurate is not enough: how accuracy metrics have hurt recommender systems , 2006, CHI Extended Abstracts.

[9]  Dietmar Jannach,et al.  Recommendations with a Purpose , 2016, RecSys.

[10]  Kristina Lerman,et al.  A Geometric Solution to Fair Representations , 2020, AIES.

[11]  Nicholas Mattei,et al.  We Need Fairness and Explainability in Algorithmic Hiring , 2020, AAMAS.

[12]  Mario Luis Small,et al.  How to Conduct a Mixed Methods Study: Recent Trends in a Rapidly Growing Literature , 2011 .

[13]  Alexandra Chouldechova,et al.  Fair prediction with disparate impact: A study of bias in recidivism prediction instruments , 2016, Big Data.

[14]  Solon Barocas,et al.  Mitigating Bias in Algorithmic Employment Screening: Evaluating Claims and Practices , 2019, SSRN Electronic Journal.

[15]  Dan Jurafsky,et al.  Racial disparities in automated speech recognition , 2020, Proceedings of the National Academy of Sciences.

[16]  Orestis Papakyriakopoulos,et al.  Bias in word embeddings , 2020, FAT*.

[17]  Michael A. Madaio,et al.  Stakeholder Participation in AI: Beyond "Add Diverse Stakeholders and Stir" , 2021, ArXiv.

[18]  Mark Graham,et al.  Good Gig, Bad Gig: Autonomy and Algorithmic Control in the Global Gig Economy , 2018, Work, employment & society : a journal of the British Sociological Association.

[19]  Dan Suciu,et al.  Interventional Fairness: Causal Database Repair for Algorithmic Fairness , 2019, SIGMOD Conference.

[20]  Olga Russakovsky,et al.  Fair Attribute Classification through Latent Space De-biasing , 2020, ArXiv.

[21]  E. Moss,et al.  AI’s social sciences deficit , 2019, Nature Machine Intelligence.

[22]  Andrew Smart,et al.  Participatory Problem Formulation for Fairer Machine Learning Through Community Based System Dynamics , 2020, ArXiv.

[23]  Daniela Rus,et al.  Uncovering and Mitigating Algorithmic Bias through Learned Latent Structure , 2019, AIES.

[24]  Amanda Askell,et al.  AI Safety Needs Social Scientists , 2019, Distill.

[25]  Michelle A. Gan,et al.  An Image of Society: Gender and Racial Representation and Impact in Image Search Results for Occupations , 2021 .

[26]  Danah Boyd,et al.  Fairness and Abstraction in Sociotechnical Systems , 2019, FAT.

[27]  Timnit Gebru,et al.  Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification , 2018, FAT.

[28]  Helen Nissenbaum,et al.  Bias in computer systems , 1996, TOIS.

[29]  Antje Kirchner,et al.  Measuring the predictability of life outcomes with a scientific mass collaboration , 2020, Proceedings of the National Academy of Sciences.

[30]  R. Merton.  The Role of Applied Social Science in the Formation of Policy: A Research Memorandum , 1949, Philosophy of Science.

[31]  Trisha Greenhalgh,et al.  Research impact: a narrative review , 2016, BMC Medicine.

[32]  K. Lum,et al.  To predict and serve? , 2016 .

[33]  Mounia Lalmas,et al.  First Women, Second Sex: Gender Bias in Wikipedia , 2015, HT.

[34]  Mark O. Riedl.  Human-Centered Artificial Intelligence and Machine Learning , 2019, Human Behavior and Emerging Technologies.

[35]  Lucy A. Suchman,et al.  Plans and Situated Actions: The Problem of Human-Machine Communication (Learning in Doing: Social, , 1987 .