What is Human-Centered about Human-Centered AI? A Map of the Research Landscape

The application of Artificial Intelligence (AI) across a wide range of domains comes with both high expectations of its benefits and dire predictions of misuse. While AI systems have largely been driven by a technology-centered design approach, the potential societal consequences of AI have mobilized both HCI and AI researchers towards researching human-centered artificial intelligence (HCAI). However, there remains considerable ambiguity about what it means to frame, design and evaluate HCAI. This paper presents a critical review of the large corpus of peer-reviewed literature emerging on HCAI in order to characterize what the community is defining as HCAI. Our review contributes an overview and map of HCAI research based on work that explicitly mentions the terms ‘human-centered artificial intelligence’ or ‘human-centered machine learning’ or their variations, and suggests future challenges and research directions. The map reveals the breadth of research happening in HCAI, established clusters and the emerging areas of Interaction with AI and Ethical AI. The paper contributes a new definition of HCAI, and calls for greater collaboration between AI and HCI research, and new HCAI constructs.

[1]  Kerk F. Kee,et al.  Algorithm awareness: Why user awareness is critical for personal privacy in the adoption of algorithmic platforms? , 2022, Int. J. Inf. Manag..

[2]  Pradeep Paraman,et al.  Ethical artificial intelligence framework for a good AI society: principles, opportunities and perils , 2022, AI & SOCIETY.

[3]  Milda Norkute,et al.  Cognitive Strategy Prompts: Creativity Triggers for Human Centered AI Opportunity Detection , 2022, Creativity & Cognition.

[4]  Minha Lee,et al.  What If Artificial Intelligence Become Completely Ambient in Our Daily Lives? Exploring Future Human-AI Interaction through High Fidelity Illustrations , 2022, Int. J. Hum. Comput. Interact..

[5]  Ning F. Ma,et al.  From Tool to Companion: Storywriters Want AI Writers to Respect Their Personal Values and Writing Strategies , 2022, Conference on Designing Interactive Systems.

[6]  N. Elmqvist,et al.  DramatVis Personae: Visual Text Analytics for Identifying Social Biases in Creative Writing , 2022, Conference on Designing Interactive Systems.

[7]  Justin D. Weisz,et al.  Extending a Human-AI Collaboration Framework with Dynamism and Sociality , 2022, CHIWORK.

[8]  Georgios M. Santipantakis,et al.  Explaining deep reinforcement learning decisions in complex multiagent settings: towards enabling automation in air traffic flow management , 2022, Applied Intelligence.

[9]  M. Dastani,et al.  Responsibility of AI Systems , 2022, AI & SOCIETY.

[10]  F. Cabitza,et al.  Decisions are not all equal - Introducing a utility metric based on case-wise raters' perceptions , 2022, Comput. Methods Programs Biomed..

[11]  A. Mørch,et al.  Collaborative learning with block-based programming: investigating human-centered artificial intelligence in education , 2022, Behav. Inf. Technol..

[12]  S. Wamba,et al.  Integrating human knowledge into artificial intelligence for complex and ill-structured problems: Informed artificial intelligence , 2022, Int. J. Inf. Manag..

[13]  Mika P. Nieminen,et al.  Governance of Responsible AI: From Ethical Guidelines to Cooperative Policies , 2022, Frontiers in Computer Science.

[14]  Berry Eggen,et al.  Breaking up data-enabled design: expanding and scaling up for the clinical context , 2022, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[15]  Zhiwei Steven Wu,et al.  Imagining new futures beyond predictive systems in child welfare: A qualitative study with impacted stakeholders , 2022, FAccT.

[16]  T. Tuunanen,et al.  Responsible cognitive digital clones as decision-makers: a design science research study , 2022, Eur. J. Inf. Syst..

[17]  A. Cebulla,et al.  Applying ethics to AI in the workplace: the design of a scorecard for Australian workplace health and safety , 2022, AI & SOCIETY.

[18]  B. K. Foguem,et al.  Combining expert-based beliefs and answer sets , 2022, Applied Intelligence.

[19]  Yiqiang Chen,et al.  Human-centered intelligent healthcare: explore how to apply AI to assess cognitive health , 2022, CCF Transactions on Pervasive Computing and Interaction.

[20]  Cliff Lampe,et al.  Sensible AI: Re-imagining Interpretability and Explainability using Sensemaking Theory , 2022, FAccT.

[21]  Jesse Vig,et al.  Interactive Model Cards: A Human-Centered Approach to Model Documentation , 2022, FAccT.

[22]  Àtia Cortés,et al.  Investing in AI for social good: an analysis of European national strategies , 2022, AI & SOCIETY.

[23]  A. Artelt,et al.  Contrasting Explanations for Understanding and Regularizing Model Adaptations , 2022, Neural Processing Letters.

[24]  Giulia Del Gamba,et al.  Towards Responsible AI: A Design Space Exploration of Human-Centered Artificial Intelligence User Interfaces to Investigate Fairness , 2022, Int. J. Hum. Comput. Interact..

[25]  U. Florin,et al.  Co-Designing with AI in Sight , 2022, Proceedings of the Design Society.

[26]  S. Sundar,et al.  Designing for Responsible Trust in AI Systems: A Communication Perspective , 2022, FAccT.

[27]  Antonietta Grasso,et al.  Situational Recommender: Are You On the Spot, Refining Plans, or Just Bored? , 2022, CHI.

[28]  C. Seifert,et al.  How Accurate Does It Feel? – Human Perception of Different Types of Classification Mistakes , 2022, CHI.

[29]  Hamed S. Alavi,et al.  AI beyond Deus ex Machina – Reimagining Intelligence in Future Cities with Urban Experts , 2022, CHI.

[30]  Donald R. Honeycutt,et al.  On the Importance of User Backgrounds and Impressions: Lessons Learned from Interactive AI Applications , 2022, ACM Trans. Interact. Intell. Syst..

[31]  Lydia B. Chilton,et al.  GenAICHI: Generative AI and HCI , 2022, CHI Extended Abstracts.

[32]  Zhiwei Steven Wu,et al.  How Child Welfare Workers Reduce Racial Disparities in Algorithmic Decisions , 2022, CHI.

[33]  Paweł W. Woźniak,et al.  ‘It Is Not Always Discovery Time’: Four Pragmatic Approaches in Designing AI Systems , 2022, CHI.

[34]  K. Hosanagar,et al.  Designing Fair AI in Human Resource Management: Understanding Tensions Surrounding Algorithmic Evaluation and Envisioning Stakeholder-Centered Solutions , 2022, CHI.

[35]  Dong Whi Yoo,et al.  Supporting the Contact Tracing Process with WiFi Location Data: Opportunities and Challenges , 2022, CHI.

[36]  Cecilia R. Aragon,et al.  Interrogating Human-centered Data Science: Taking Stock of Opportunities and Limitations , 2022, CHI Extended Abstracts.

[37]  Kenneth Holstein,et al.  Workshop on Trust and Reliance in AI-Human Teams (TRAIT) , 2022, CHI Extended Abstracts.

[38]  Hao Zhang,et al.  Research on Forecasting of Student Grade Based on Adaptive K-Means and Deep Neural Network , 2022, Wireless Communications and Mobile Computing.

[39]  Suk-Young Lim,et al.  Detecting Deepfake Voice Using Explainable Deep Learning Techniques , 2022, Applied Sciences.

[40]  Jože M. Rožanec,et al.  Enriching Artificial Intelligence Explanations with Knowledge Fragments , 2022, Future Internet.

[41]  P. Fattori,et al.  A Multifunctional Adaptive and Interactive AI system to support people living with stroke, acquired brain or spinal cord injuries: A study protocol , 2022, PloS one.

[42]  Andrew Zaldivar,et al.  Data Cards: Purposeful and Transparent Dataset Documentation for Responsible AI , 2022, FAccT.

[43]  S. Kahai,et al.  Who needs explanation and when? Juggling explainable AI and user epistemic uncertainty , 2022, Int. J. Hum. Comput. Stud..

[44]  A. Gronauer,et al.  Digital Transformation in Smart Farm and Forest Operations Needs Human-Centered AI: Challenges and Future Directions , 2022, Sensors.

[45]  Andreas Theissler,et al.  ConfusionVis: Comparative evaluation and selection of multi-class classifiers based on confusion matrices , 2022, Knowl. Based Syst..

[46]  Ashok K. Goel,et al.  Understanding the Design Space of AI-Mediated Social Interaction in Online Learning: Challenges and Opportunities , 2022, Proc. ACM Hum. Comput. Interact..

[47]  Lydia B. Chilton,et al.  HAI-GEN 2022: 3rd Workshop on Human-AI Co-Creation with Generative Models , 2022, IUI Companion.

[48]  M. Tkalcic,et al.  Sixth HUMANIZE Workshop on Transparency and Explainability in Adaptive Systems Through User Modeling Grounded in Psychological Theory: Summary , 2022, IUI Companion.

[49]  C. Tijus,et al.  Contextualization and Exploration of Local Feature Importance Explanations to Improve Understanding and Satisfaction of Non-Expert Users , 2022, IUI.

[50]  Min Hun Lee,et al.  Towards Efficient Annotations for a Human-AI Collaborative, Clinical Decision Support System: A Case Study on Physical Stroke Rehabilitation Assessment , 2022, IUI.

[51]  W. Mackay,et al.  Deep Learning Uncertainty in Machine Teaching , 2022, IUI.

[52]  Dakuo Wang,et al.  Telling Stories from Computational Notebooks: AI-Assisted Presentation Slides Creation for Presenting Data Science Work , 2022, CHI.

[53]  Agung Mulyo Widodo,et al.  AlexNet Convolutional Neural Network for Disease Detection and Classification of Tomato Leaf , 2022, Electronics.

[54]  D. Gergle,et al.  Model Positionality and Computational Reflexivity: Promoting Reflexivity in Data Science , 2022, CHI.

[55]  Jamy J. Li,et al.  FMEA-AI: AI fairness impact assessment using failure mode and effects analysis , 2022, AI and Ethics.

[56]  Andreea M. Oprescu,et al.  Towards a data collection methodology for Responsible Artificial Intelligence in health: A prospective and qualitative study in pregnancy , 2022, Inf. Fusion.

[57]  T. Kiehl,et al.  The explainability paradox: Challenges for xAI in digital pathology , 2022, Future Gener. Comput. Syst..

[58]  Thomas Herrmann,et al.  Keeping the organization in the loop: a socio-technical extension of human-centered artificial intelligence , 2022, AI & SOCIETY.

[59]  Justin D. Weisz,et al.  Better Together? An Evaluation of AI-Supported Code Translation , 2022, IUI.

[60]  Krzysztof Z Gajos,et al.  Do People Engage Cognitively with AI? Impact of AI Assistance on Incidental Learning , 2022, IUI.

[61]  Justin D. Weisz,et al.  Investigating Explainability of Generative AI for Code through Scenario-based Design , 2022, International Conference on Intelligent User Interfaces.

[62]  D. Gašević,et al.  Rethinking the entwinement between artificial intelligence and human learning: What capabilities do learners need for a world with AI? , 2022, Comput. Educ. Artif. Intell..

[63]  Murat Dikmen,et al.  The effects of domain knowledge on trust in explainable AI and task performance: A case of peer-to-peer lending , 2022, Int. J. Hum. Comput. Stud..

[64]  R. Chatila,et al.  Human-centered AI and robotics , 2022, AI Perspectives.

[65]  R. Cucchiara,et al.  Fine-grained Human Analysis under Occlusions and Perspective Constraints in Multimedia Surveillance , 2022, ACM Trans. Multim. Comput. Commun. Appl..

[66]  Andreas Theodorou,et al.  A sociotechnical perspective for the future of AI: narratives, inequalities, and human control , 2022, Ethics and Information Technology.

[67]  F. Nex,et al.  Embedding artificial intelligence in society: looking beyond the EU AI master plan using the culture cycle , 2022, AI & SOCIETY.

[68]  Milagros Miceli,et al.  Studying Up Machine Learning Data , 2022, Proc. ACM Hum. Comput. Interact..

[69]  T. Timan,et al.  From AI ethics principles to data science practice: a reflection and a gap analysis based on recent frameworks and practical experience , 2022, AI and Ethics.

[70]  Ralf Schmälzle,et al.  Harnessing Artificial Intelligence for Health Message Generation: The Folic Acid Message Engine , 2022, Journal of medical Internet research.

[71]  Mirza Ahsan Ullah,et al.  SoFTNet: A concept-controlled deep learning architecture for interpretable image classification , 2022, Knowl. Based Syst..

[72]  Clinton B. Edwards,et al.  TagLab: AI‐assisted annotation for the fast and accurate semantic segmentation of coral reef orthoimages , 2021, J. Field Robotics.

[73]  Christian F. Baumgartner,et al.  A Human-Centered Machine-Learning Approach for Muscle-Tendon Junction Tracking in Ultrasound Images , 2021, IEEE Transactions on Biomedical Engineering.

[74]  Isabelle Augenstein,et al.  Information fusion as an integrative cross-cutting enabler to achieve robust, explainable, and trustworthy medical artificial intelligence , 2021, Inf. Fusion.

[75]  Claudia Müller-Birn,et al.  Explanation Strategies as an Empirical-Analytical Lens for Socio-Technical Contextualization of Machine Learning Interpretability , 2021, Proc. ACM Hum. Comput. Interact..

[76]  Kimon Kieslich,et al.  Artificial intelligence ethics by design. Evaluating public perception on the importance of ethical design principles of artificial intelligence , 2021, Big Data Soc..

[77]  Ivan Donadello,et al.  EXplainable Neural-Symbolic Learning (X-NeSyL) methodology to fuse deep learning representations with expert knowledge graphs: the MonuMAI cultural heritage use case , 2021, Inf. Fusion.

[78]  Justin D. Weisz,et al.  Documentation Matters: Human-Centered AI System to Assist Data Science Code Documentation in Computational Notebooks , 2021, ACM Trans. Comput. Hum. Interact..

[79]  Silvan Mertes,et al.  GANterfactual—Counterfactual Explanations for Medical Non-experts Using Generative Adversarial Learning , 2020, Frontiers in Artificial Intelligence.

[80]  Niels van Berkel,et al.  Human-centred artificial intelligence: a contextual morality perspective , 2020, Behav. Inf. Technol..

[81]  Stefan Cronholm,et al.  Design Principles for Human-Centred AI , 2022, ECIS.

[82]  A. Bucher,et al.  Does Social Presence Increase Perceived Competence? Evaluating Conversational Agents in Advice Giving Through a Video-Based Survey , 2022 .

[83]  M. Cabrera-Umpiérrez,et al.  Design of Human-Centered Adaptive Support Tools to Improve Workability in Older Workers. A Field of Research of Human-Centered AI , 2022, HCI.

[84]  Chris Biemann,et al.  D-WISE Tool Suite for the Sociology of Knowledge Approach to Discourse , 2022, HCI.

[85]  E. Trewhitt,et al.  SatisfAI: A Serious Tabletop Game to Reveal Human-AI Interaction Dynamics , 2022, HCI.

[86]  Steven L. Alter Agent Responsibility Framework for Digital Agents: Roles and Responsibilities Related to Facets of Work , 2022, BPMDS/EMMSAD@CAiSE.

[87]  Thomas Herrmann Promoting Human Competences by Appropriate Modes of Interaction for Human-Centered-AI , 2022, HCI.

[88]  Pontus Wärnestål,et al.  Exploring the Design Context of AI-Powered Services: A Qualitative Investigation of Designers' Experiences with Machine Learning , 2022, HCI.

[89]  Antoine Marot,et al.  Perspectives on Future Power System Control Centers for Energy Transition , 2022, Journal of Modern Power Systems and Clean Energy.

[90]  Heimo Müller,et al.  Personas for Artificial Intelligence (AI) An Open Source Toolbox , 2022, IEEE Access.

[91]  Candice Schumann Group Fairness in Bandits with Biased Feedback , 2022, AAMAS.

[92]  Sophia Schulze-Weddige,et al.  User Study on the Effects Explainable AI Visualizations on Non-experts , 2022, Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering.

[93]  Adrian Groza,et al.  Interleaving Automatic Segmentation and Expert Opinion for Retinal Conditions , 2021, Diagnostics.

[94]  Craig Vear,et al.  Creative AI and Musicking Robots , 2021, Frontiers in Robotics and AI.

[95]  O. Alsos,et al.  Human-Centered Explainable Artificial Intelligence for Marine Autonomous Surface Vehicles , 2021, Journal of Marine Science and Engineering.

[96]  Arto Laitinen,et al.  AI Systems and Respect for Human Autonomy , 2021, Frontiers in Artificial Intelligence.

[97]  Pamela J. Wisniewski,et al.  MOSafely: Building an Open-Source HCAI Community to Make the Internet a Safer Place for Youth , 2021, CSCW Companion.

[98]  Chi-Chun Lee,et al.  Self-assessed Emotion Classification from Acoustic and Physiological Features within Small-group Conversation , 2021, ICMI Companion.

[99]  Sidney K. D'Mello,et al.  Bias and Fairness in Multimodal Machine Learning: A Case Study of Automated Video Interviews , 2021, ICMI.

[100]  Sharon L. Oviatt,et al.  Technology as Infrastructure for Dehumanization:: Three Hundred Million People with the Same Face , 2021, ICMI.

[101]  Abigail Sellen,et al.  Enabling meaningful use of AI-infused educational technologies for children with blindness: Learnings from the development and piloting of the PeopleLens curriculum , 2021, ASSETS.

[102]  Jed R. Brubaker,et al.  Putting Tools in Their Place: The Role of Time and Perspective in Human-AI Collaboration for Qualitative Analysis , 2021, Proc. ACM Hum. Comput. Interact..

[103]  Peter A. Flach,et al.  Co-Designing Personal Health? Multidisciplinary Benefits and Challenges in Informing Diabetes Self-Care Technologies , 2021, Proc. ACM Hum. Comput. Interact..

[104]  Nazanin Andalibi,et al.  Data Subjects' Conceptualizations of and Attitudes Toward Automatic Emotion Recognition-Enabled Wellbeing Interventions on Social Media , 2021, Proc. ACM Hum. Comput. Interact..

[105]  David G. Schwartz,et al.  The Design of Reciprocal Learning Between Human and Artificial Intelligence , 2021, Proc. ACM Hum. Comput. Interact..

[106]  Karen L. Boyd Datasheets for Datasets help ML Engineers Notice and Understand Ethical Issues in Training Data , 2021, Proc. ACM Hum. Comput. Interact..

[107]  Simone Diniz Junqueira Barbosa,et al.  Exploring the impact of classification probabilities on users' trust in ambiguous instances , 2021, 2021 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC).

[108]  Jules Françoise,et al.  Marcelle: Composing Interactive Machine Learning Workflows and Interfaces , 2021, UIST.

[109]  Naoyuki Kubota,et al.  BCI-based hit-loop agent for human and AI robot co-learning with AIoT application , 2021, Journal of Ambient Intelligence and Humanized Computing.

[110]  P. Markopoulos,et al.  Exploring Peoples' Perception of Autonomy and Reactance in Everyday AI Interactions , 2021, Frontiers in Psychology.

[111]  Milagros Miceli,et al.  Studying Up Machine Learning Data , 2021, Proc. ACM Hum. Comput. Interact..

[112]  S. Salloch,et al.  Artificial Intelligence, Social Media and Depression. ‘Patient’ Autonomy Revisited , 2021, Studia Universitatis Babeş-Bolyai Bioethica.

[113]  Rachel Dzombak,et al.  Human-Centered AI , 2021, IEEE Pervasive Comput..

[114]  Murtuza N. Shergadwala,et al.  Human-Centric Design Requirements and Challenges for Enabling Human-AI Interaction in Engineering Design: An Interview Study , 2021, Volume 6: 33rd International Conference on Design Theory and Methodology (DTM).

[115]  Yoonsuck Choe,et al.  Recognizing creative visual design: multiscale design characteristics in free-form web curation documents , 2021, DocEng.

[116]  Emily Denton,et al.  Do Datasets Have Politics? Disciplinary Values in Computer Vision Dataset Development , 2021, Proc. ACM Hum. Comput. Interact..

[117]  E. G. Al-Sakkari,et al.  Viral outbreaks detection and surveillance using wastewater-based epidemiology, viral air sampling, and machine learning techniques: A comprehensive review and outlook , 2021, Science of The Total Environment.

[118]  Olivier Boissier,et al.  A Multi-Agent Approach to Combine Reasoning and Learning for an Ethical Behavior , 2021, AIES.

[119]  Jonas Lundberg,et al.  Human Autonomy in Future Drone Traffic: Joint Human–AI Control in Temporal Cognitive Work , 2021, Frontiers in Artificial Intelligence.

[120]  Ramya Akula,et al.  Ethical AI for Social Good , 2021, HCI.

[121]  Daniel A. Keim,et al.  Co-adaptive visual data analysis and guidance processes , 2021, Comput. Graph..

[122]  Alessandro Mantelero,et al.  An evidence-based methodology for human rights impact assessment (HRIA) in the development of AI data-intensive systems , 2021, Comput. Law Secur. Rev..

[123]  Tanuja Ganu,et al.  Language Translation as a Socio-Technical System:Case-Studies of Mixed-Initiative Interactions , 2021, COMPASS.

[124]  A. Garbett,et al.  Towards Understanding People’s Experiences of AI Computer Vision Fitness Instructor Apps , 2021, Conference on Designing Interactive Systems.

[125]  Yunyao Li,et al.  Who needs to know what, when?: Broadening the Explainable AI (XAI) Design Space by Looking at Explanations Across the AI Lifecycle , 2021, Conference on Designing Interactive Systems.

[126]  Baptiste Caramiaux,et al.  Prototyping Machine Learning Through Diffractive Art Practice , 2021, Conference on Designing Interactive Systems.

[127]  Youn-Kyung Lim,et al.  Teaching-Learning Interaction: A New Concept for Interaction Design to Support Reflective User Agency in Intelligent Systems , 2021, Conference on Designing Interactive Systems.

[128]  Jon E. Froehlich,et al.  Toward User-Driven Sound Recognizer Personalization with People Who Are d/Deaf or Hard of Hearing , 2021, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[129]  P. Markopoulos,et al.  ”It’s like a puppet master”: User Perceptions of Personal Autonomy when Interacting with Intelligent Technologies , 2021, UMAP.

[130]  Ji-Hun Lim,et al.  A Study on the Modeling of Major Factors for the Principles of AI Ethics , 2021, DG.O.

[131]  Gergana Vladova,et al.  Reinvigorating the Discourse on Human-Centered Artificial Intelligence in Educational Technologies , 2021, Technology Innovation Management Review.

[132]  Philipp Wintersberger,et al.  Operationalizing Human-Centered Perspectives in Explainable AI , 2021, CHI Extended Abstracts.

[133]  Farah Magrabi,et al.  Realizing AI in Healthcare: Challenges Appearing in the Wild , 2021, CHI Extended Abstracts.

[134]  Philippe A. Palanque,et al.  Automation Experience at the Workplace , 2021, CHI Extended Abstracts.

[135]  Sebastian Tschiatschek,et al.  Social Sensemaking with AI: Designing an Open-ended AI Experience with a Blind Child , 2021, CHI.

[136]  Jeffrey M. Rzeszotarski,et al.  Designing Interactive Transfer Learning Tools for ML Non-Experts , 2021, CHI.

[137]  Michael Desmond,et al.  Designing Ground Truth and the Social Life of Labels , 2021, CHI.

[138]  Praveen K. Paritosh,et al.  “Everyone wants to do the model work, not the data work”: Data Cascades in High-Stakes AI , 2021, CHI.

[139]  David A. Joyner,et al.  Towards Mutual Theory of Mind in Human-AI Interaction: How Language Reflects What Students Perceive About a Virtual Teaching Assistant , 2021, CHI.

[140]  Daniel P. Siewiorek,et al.  A Human-AI Collaborative Approach for Clinical Decision Making on Rehabilitation Assessment , 2021, CHI.

[141]  Ji-Hyun Lee,et al.  A Deeper Look at Autonomous Vehicle Ethics: An Integrative Ethical Decision-Making Framework to Explain Moral Pluralism , 2021, Frontiers in Robotics and AI.

[142]  Ulas Bagci,et al.  Attention-guided analysis of infrastructure damage with semi-supervised deep learning , 2021 .

[143]  Maria Riveiro,et al.  "That's (not) the output I expected!" On the role of end user expectations in creating explanations of AI systems , 2021, Artif. Intell..

[144]  Kyungsik Han,et al.  FANCY: Human-centered, Deep Learning-based Framework for Fashion Style Analysis , 2021, WWW.

[145]  Eytan Adar,et al.  Towards A Process Model for Co-Creating AI Experiences , 2021, Conference on Designing Interactive Systems.

[146]  Panagiotis Germanakos,et al.  Fifth HUMANIZE workshop on Transparency and Explainability in Adaptive Systems through User Modeling Grounded in Psychological Theory: Summary , 2021, IUI Companion.

[147]  Eytan Adar,et al.  ProtoAI: Model-Informed Prototyping for AI-Powered Interfaces , 2021, IUI.

[148]  Kai Heinrich,et al.  Machine learning and deep learning , 2021, Electron. Mark..

[149]  Aaron Striegel,et al.  Person-Centered Predictions of Psychological Constructs with Social Media Contextualized by Multimodal Sensing , 2021, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[150]  Ibrahim Demir,et al.  An ethical decision-making framework with serious gaming: a smart water case study on flooding , 2021 .

[151]  Constantin Houy,et al.  Explainable Artificial Intelligence (XAI) Supporting Public Administration Processes - On the Potential of XAI in Tax Audit Processes , 2021, Wirtschaftsinformatik.

[152]  Nuria Oliver,et al.  Ethical machines: The human-centric use of artificial intelligence , 2021, iScience.

[153]  Emily M. Bender,et al.  On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜 , 2021, FAccT.

[154]  Rhema Vaithianathan,et al.  Sibyl: Understanding and Addressing the Usability Challenges of Machine Learning In High-Stakes Decision Making , 2021, IEEE Transactions on Visualization and Computer Graphics.

[155]  Donghee Shin,et al.  The effects of explainability and causability on perception, trust, and acceptance: Implications for explainable AI , 2021, Int. J. Hum. Comput. Stud..

[156]  Zhiwei Steven Wu,et al.  Soliciting Stakeholders’ Fairness Notions in Child Maltreatment Predictive Systems , 2021, CHI.

[157]  Aniello Castiglione,et al.  A human-centered artificial intelligence approach for privacy protection of elderly App users in smart cities , 2021, Neurocomputing.

[158]  Samantha Robertson,et al.  Modeling Assumptions Clash with the Real World: Transparency, Equity, and Community Challenges for Student Assignment Algorithms , 2021, CHI.

[159]  Arvind Satyanarayan,et al.  Beyond Expertise and Roles: A Framework to Characterize the Stakeholders of Interpretable Machine Learning and their Needs , 2021, CHI.

[160]  Erick Oduor,et al.  AutoDS: Towards Human-Centered Automation of Data Science , 2021, CHI.

[161]  Aditya G. Parameswaran,et al.  Whither AutoML? Understanding the Role of Automation in Machine Learning Workflows , 2021, CHI.

[162]  Mark O. Riedl,et al.  Expanding Explainability: Towards Social Transparency in AI systems , 2021, CHI.

[163]  Arne Berger,et al.  Machine Learning Uncertainty as a Design Material: A Post-Phenomenological Inquiry , 2021, CHI.

[164]  Feng Tian,et al.  CASS , 2021, Proc. ACM Hum. Comput. Interact..

[165]  S. Salloch,et al.  Artificial Intelligence, Social Media and Depression. A New Concept of Health-Related Digital Autonomy , 2021, The American journal of bioethics : AJOB.

[166]  Thierry Bellet,et al.  Human-Centered AI to Support an Adaptive Management of Human-Machine Transitions with Vehicle Automation , 2020, Inf..

[167]  Ann Blandford,et al.  Designing Visual Markers for Continuous Artificial Intelligence Support , 2020, ACM Trans. Comput. Heal..

[168]  Mehul Bhatt,et al.  Commonsense Visual Sensemaking for Autonomous Driving: On Generalised Neurosymbolic Online Abduction Integrating Vision and Semantics , 2020, Artif. Intell..

[169]  Raymond Fok,et al.  Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance , 2020, CHI.

[170]  Xiang 'Anthony' Chen,et al.  Lessons Learned from Designing an AI-Enabled Diagnosis Tool for Pathologists , 2020, Proc. ACM Hum. Comput. Interact..

[171]  Kostiantyn Kucher,et al.  StackGenVis: Alignment of Data, Algorithms, and Models for Stacking Ensemble Learning Using Performance Metrics , 2020, IEEE Transactions on Visualization and Computer Graphics.

[172]  Baptiste Caramiaux,et al.  Designing Deep Reinforcement Learning for Human Parameter Exploration , 2019, ACM Trans. Comput. Hum. Interact..

[173]  Daniel A. Keim,et al.  Integrating Data and Model Space in Ensemble Learning by Visual Analytics , 2018, IEEE Transactions on Big Data.

[174]  Timnit Gebru,et al.  Datasheets for datasets , 2018, Commun. ACM.

[175]  Daniel G. Goldstein,et al.  Manipulating and Measuring Model Interpretability , 2018, CHI.

[176]  Carlos Santiago,et al.  Introduction of human-centric AI assistant to aid radiologists for multimodal breast image classification , 2021, Int. J. Hum. Comput. Stud..

[177]  J. Molka-Danielsen,et al.  Design and Deployment Considerations for Ethically Advanced Technologies for Human Flourishing in the Workplace , 2021, HWID.

[178]  Andreas Holzinger The Next Frontier: AI We Can Really Trust , 2021, PKDD/ECML Workshops.

[179]  Stefan Schmager,et al.  A Toolkit to Enable the Design of Trustworthy AI , 2021, HCI.

[180]  Jana Thompson,et al.  Mental Models and Interpretability in AI Fairness Tools and Code Environments , 2021, HCI.

[181]  Helmut Degen,et al.  How to Explain It to Facility Managers? A Qualitative, Industrial User Research Study for Explainability , 2021, HCI.

[182]  W. Mackay,et al.  How do People Train a Machine? Strategies and (Mis)Understandings , 2021 .

[183]  Anna Marie Schröder,et al.  Unboxing the Algorithm: Designing an Understandable Algorithmic Experience in Music Recommender Systems , 2021, Perspectives@RecSys.

[184]  Carla Simone,et al.  The need to move away from agential-AI: Empirical investigations, useful concepts and open issues , 2021, Int. J. Hum. Comput. Stud..

[185]  C. Emmanouilidis,et al.  Human in the AI Loop in Production Environments , 2021, APMS.

[186]  Thomas Baudel,et al.  ObjectivAIze: Measuring Performance and Biases in Augmented Business Decision Systems , 2021, INTERACT.

[187]  Martin Christof Kindsmüller,et al.  HCD3A: An HCD Model to Design Data-Driven Apps , 2021, HCI.

[188]  Theodore Jensen,et al.  Disentangling Trust and Anthropomorphism Toward the Design of Human-Centered AI Systems , 2021, HCI.

[189]  Stavroula Ntoa,et al.  From a Workshop to a Framework for Human-Centered Artificial Intelligence , 2021, HCI.

[190]  Markus Helfert,et al.  Towards Design Principles for User-Centric Explainable AI in Fraud Detection , 2021, HCI.

[191]  Jennifer Heier,et al.  Design Intelligence - Taking Further Steps Towards New Methods and Tools for Designing in the Age of AI , 2021, HCI.

[192]  Yiannis Kompatsiaris,et al.  The AI4Media Project: Use of Next-Generation Artificial Intelligence Technologies for Media Sector Applications , 2021, AIAI.

[193]  Mutlu Cukurova,et al.  Investigating Students' Experiences with Collaboration Analytics for Remote Group Meetings , 2021, AIED.

[194]  Benjamin Klöpper,et al.  XAI for Operations in the Process Industry - Applications, Theses, and Research Directions , 2021, AAAI Spring Symposium: Combining Machine Learning with Knowledge Engineering.

[195]  Magy Seif El-Nasr,et al.  Understanding Player Patterns by Combining Knowledge-Based Data Abstraction with Interactive Visualization , 2020, CHI PLAY.

[196]  Colin Porlezza,et al.  AI should embody our values: Investigating journalistic values to inform AI technology design , 2020, NordiCHI.

[197]  Kaisa Väänänen,et al.  Respecting Human Autonomy through Human-Centered AI , 2020, NordiCHI.

[198]  Antonios Liapis,et al.  Invisible AI-driven HCI Systems – When, Why and How , 2020, NordiCHI.

[199]  Ben Shneiderman,et al.  Bridging the Gap Between Ethics and Practice , 2020, ACM Trans. Interact. Intell. Syst..

[200]  HONG SHEN,et al.  Designing Alternative Representations of Confusion Matrices to Support Non-Expert Public Understanding of Algorithm Performance , 2020, Proc. ACM Hum. Comput. Interact..

[201]  Ben Shneiderman,et al.  Human-Centered Artificial Intelligence: Three Fresh Ideas , 2020, AIS Transactions on Human-Computer Interaction.

[202]  Jan Peters,et al.  Multi-Channel Interactive Reinforcement Learning for Sequential Tasks. , 2020 .

[203]  Jan Peters,et al.  Multi-Channel Interactive Reinforcement Learning for Sequential Tasks , 2020, Frontiers in Robotics and AI.

[204]  Jan Auernhammer,et al.  Human-centered AI: The role of Human-centered Design Research in the development of AI , 2020, DRS2020: Synergy.

[205]  Anil K. Raj,et al.  Interpretation of SVM Using Data Mining Technique to Extract Syllogistic Rules - Exploring the Notion of Explainable AI in Diagnosing CAD , 2020, CD-MAKE.

[206]  Andreas Theissler,et al.  ML-ModelExplorer: An Explorative Model-Agnostic Approach to Evaluate and Compare Multi-class Classifiers , 2020, CD-MAKE.

[207]  Freddy Lécué,et al.  Explainable Artificial Intelligence: Concepts, Applications, Research Challenges and Visions , 2020, CD-MAKE.

[208]  Alina Glushkova,et al.  Human Movement Representation on Multivariate Time Series for Recognition of Professional Gestures and Forecasting Their Trajectories , 2020, Frontiers in Robotics and AI.

[209]  Hendrik Heuer,et al.  How Fake News Affect Trust in the Output of a Machine Learning System for News Curation , 2020, MISDOOM.

[210]  Evangelos Pournaras,et al.  Collective Learning: A 10-Year Odyssey to Human-centered Distributed Intelligence , 2020, 2020 IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS).

[211]  Annika Kaltenhauser,et al.  Beyond the Buzzwords: On the Perspective of AI in UX and Vice Versa , 2020, HCI.

[212]  Thomas Herrmann,et al.  Socio-Technical Design of Hybrid Intelligence Systems - The Case of Predictive Maintenance , 2020, HCI.

[213]  Phil Jackson,et al.  Flatpack ML: How to Support Designers in Creating a New Generation of Customizable Machine Learning Applications , 2020, HCI.

[214]  Ming Qian,et al.  Defining a Human-Machine Teaming Model for AI-Powered Human-Centered Machine Translation Agent by Learning from Human-Human Group Discussion: Dialog Categories and Dialog Moves , 2020, HCI.

[215]  Kirsten Ostherr Artificial Intelligence and Medical Humanities , 2020, Journal of Medical Humanities.

[216]  M. Søndergaard,et al.  More-Than-Human Design and AI: In Conversation with Agents , 2020, Conference on Designing Interactive Systems.

[217]  Andreas Butz,et al.  "You Have to Piece the Puzzle Together": Implications for Designing Decision Support in Intensive Care , 2020, Conference on Designing Interactive Systems.

[218]  Pratyusha Kalluri,et al.  Don’t ask if artificial intelligence is good or fair, ask how it shifts power , 2020, Nature.

[219]  Margarita Robles Carrillo,et al.  Artificial intelligence: From ethics to law , 2020 .

[220]  Andreas A. Veglis,et al.  Employing a Chatbot for News Dissemination during Crisis: Design, Implementation and Evaluation , 2020, Future Internet.

[221]  Marieke M. M. Peeters,et al.  Hybrid collective intelligence in a human–AI society , 2020, AI & SOCIETY.

[222]  Mary Lou Maher,et al.  Making Sense of Student Success and Risk Through Unsupervised Machine Learning and Interactive Storytelling , 2020, AIED.

[223]  Monojit Choudhury,et al.  Do Multilingual Users Prefer Chat-bots that Code-mix? Let's Nudge and Find Out! , 2020, Proc. ACM Hum. Comput. Interact..

[224]  Ben Shneiderman,et al.  Design Lessons From AI’s Two Grand Goals: Human Emulation and Useful Applications , 2020, IEEE Transactions on Technology and Society.

[225]  Zhibin Zhou,et al.  ML Lifecycle Canvas: Designing Machine Learning-Empowered UX with Material Lifecycle Thinking , 2020, Hum. Comput. Interact..

[226]  Qian Yang,et al.  Re-examining Whether, Why, and How Human-AI Interaction Is Uniquely Difficult to Design , 2020, CHI.

[227]  Cynthia L. Bennett,et al.  The Care Work of Access , 2020, CHI.

[228]  Lauren Wilcox,et al.  A Human-Centered Evaluation of a Deep Learning System Deployed in Clinics for the Detection of Diabetic Retinopathy , 2020, CHI.

[229]  Anja Thieme,et al.  Understanding Client Support Strategies to Improve Clinical Outcomes in an Online Mental Health Intervention , 2020, CHI.

[230]  Chris North,et al.  With respect to what?: simultaneous interaction with dimension reduction and clustering projections , 2020, IUI.

[231]  Jeffrey Heer,et al.  iSeqL: interactive sequence learning , 2020, IUI.

[232]  Chaehan So,et al.  Human-in-the-Loop Design Cycles - A Process Framework that Integrates Design Sprints, Agile Processes, and Machine Learning with Humans , 2020, HCI.

[233]  Ben Shneiderman,et al.  Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthy , 2020, Int. J. Hum. Comput. Interact..

[234]  Peter A. Flach,et al.  One Explanation Does Not Fit All , 2020, KI - Künstliche Intelligenz.

[235]  Justin D. Weisz,et al.  Trust in AutoML: exploring information needs for establishing trust in automated machine learning systems , 2020, IUI.

[236]  N. Marres Co-existence or displacement: Do street trials of intelligent vehicles test society? , 2020, The British journal of sociology.

[237]  P. Burggräf,et al.  Sustainable Interaction of Human and Artificial Intelligence in Cyber Production Management Systems , 2020 .

[238]  R. Chang,et al.  Gaggle: Visual Analytics for Model Space Navigation , 2020, Graphics Interface.

[239]  Junaid Akhtar,et al.  An interactive multi-agent reasoning model for sentiment analysis: a case for computational semiotics , 2019, Artificial Intelligence Review.

[240]  Deirdre K. Mulligan,et al.  Contestability in Algorithmic Systems , 2019, CSCW Companion.

[241]  Ariel D. Procaccia,et al.  WeBuildAI , 2019, Proc. ACM Hum. Comput. Interact..

[242]  Margaret L. Palmsten,et al.  A General Framework for Human-Machine Digitization of Geographic Regions from Remotely Sensed Imagery , 2019, SIGSPATIAL/GIS.

[243]  Truong-Huy D. Nguyen,et al.  Modeling Individual and Team Behavior through Spatio-temporal Analysis , 2019, CHI PLAY.

[244]  Atau Tanaka,et al.  Gesture-Timbre Space: Multidimensional Feature Mapping Using Machine Learning and Concatenative Synthesis , 2019, CMMR.

[245]  Brian Veitch,et al.  On the realization of the recognition-primed decision model for artificial agents , 2019, Hum. centric Comput. Inf. Sci..

[246]  Claudia Müller-Birn,et al.  195 Discovering the Sweet Spot of Human—Computer Configurations: A Case Study in Information Extraction , 2022 .

[247]  Denis Lalanne,et al.  Pedestrians and Visual Signs of Intent , 2019, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[248]  Nancy J. Cooke,et al.  The Evolution of Human-Autonomy Teams in Remotely Piloted Aircraft Systems Operations , 2019, Front. Commun..

[249]  Parikshit Ram,et al.  Human-AI Collaboration in Data Science , 2019, Proc. ACM Hum. Comput. Interact..

[250]  Martin Atzmueller,et al.  Observing and Modeling User Behavior on Socio-Spatial Interaction Networks: Conformance, Exceptions, and Anomalies , 2019, 2019 First International Conference on ​Transdisciplinary AI (TransAI).

[251]  Andreas Holzinger,et al.  KANDINSKY Patterns as IQ-Test for Machine Learning , 2019, CD-MAKE.

[252]  Richard Harper,et al.  The Role of HCI in the Age of AI , 2019, Int. J. Hum. Comput. Interact..

[253]  Margot Brereton,et al.  Co-designing AI Futures: Integrating AI Ethics, Social Computing, and Design , 2019, Conference on Designing Interactive Systems.

[254]  Brian Magerko,et al.  Designing Co-Creative AI for Public Spaces , 2019, Creativity & Cognition.

[255]  Andreas Holzinger,et al.  Kandinsky Patterns , 2019, Artif. Intell..

[256]  Marco Hutter,et al.  Visual‐Interactive Preprocessing of Multivariate Time Series Data , 2019, Comput. Graph. Forum.

[257]  Richard Banks,et al.  Emerging Perspectives in Human-Centered Machine Learning , 2019, CHI Extended Abstracts.

[258]  Steven M. Drucker,et al.  Gamut: A Design Probe to Understand How Data Scientists Understand Machine Learning Models , 2019, CHI.

[259]  Paul N. Bennett,et al.  Guidelines for Human-AI Interaction , 2019, CHI.

[260]  Avi Rosenfeld,et al.  Explainability in human–agent systems , 2019, Autonomous Agents and Multi-Agent Systems.

[261]  Marco Gillies,et al.  Understanding the Role of Interactive Machine Learning in Movement Interaction Design , 2019, ACM Trans. Comput. Hum. Interact..

[262]  Inioluwa Deborah Raji,et al.  Model Cards for Model Reporting , 2018, FAT.

[263]  K. Gummadi,et al.  Human Decision Making with Machine Assistance , 2019, Proc. ACM Hum. Comput. Interact..

[264]  Danielle M. Estrada,et al.  Human Supremacy as Posthuman Risk , 2019 .

[265]  Matthew Lease,et al.  Believe it or not: Designing a Human-AI Partnership for Mixed-Initiative Fact-Checking , 2018, UIST.

[266]  Heather Savoy,et al.  An Integrated View of Complex Landscapes: A Big Data-Model Integration Approach to Transdisciplinary Science , 2018, BioScience.

[267]  Tone Bratteteig,et al.  Does AI make PD obsolete?: exploring challenges from artificial intelligence to participatory design , 2018, PDC.

[268]  Fang Chen,et al.  Dynamic Handwriting Signal Features Predict Domain Expertise , 2018, ACM Trans. Interact. Intell. Syst..

[269]  Paul Mulholland,et al.  Patterns of Design , 2018, EuroPLoP.

[270]  Cecilia R. Aragon,et al.  Using Machine Learning to Support Qualitative Coding in Social Science , 2018, ACM Trans. Interact. Intell. Syst..

[271]  Chris North,et al.  Observation-Level and Parametric Interaction for High-Dimensional Data Analysis , 2018, ACM Trans. Interact. Intell. Syst..

[272]  Jim Smith,et al.  Predicting User’s Confidence During Visual Decision Making , 2018 .

[273]  John Zimmerman,et al.  Investigating How Experienced UX Designers Effectively Work with Machine Learning , 2018, Conference on Designing Interactive Systems.

[274]  Qian Yang,et al.  Grounding Interactive Machine Learning Tool Design in How Non-Experts Actually Build Models , 2018, Conference on Designing Interactive Systems.

[275]  Hissam Tawfik,et al.  An "Awareness" Environment for Clinical Decision Support in e-Health , 2018, IWBBIO.

[276]  Emilee J. Rader,et al.  Explanations as Mechanisms for Supporting Algorithmic Transparency , 2018, CHI.

[277]  Abigail Sellen,et al.  Visualizing Ubiquitously Sensed Measures of Motor Ability in Multiple Sclerosis , 2015, ACM Trans. Interact. Intell. Syst..

[278]  Liya Ding,et al.  Human Knowledge in Constructing AI Systems - Neural Logic Networks Approach towards an Explainable AI , 2018, KES.

[279]  Daniel A. Keim,et al.  What you see is what you can change: Human-centered machine learning by interactive visualization , 2017, Neurocomputing.

[280]  Shrikanth S. Narayanan,et al.  Designing Contestability: Interaction Design, Machine Learning, and Mental Health , 2017, Conference on Designing Interactive Systems.

[281]  Kim Halskov,et al.  UX Design Innovation: Challenges for Working with Machine Learning as a Design Material , 2017, CHI.

[282]  Thecla Schiphorst,et al.  Seeing, Sensing and Recognizing Laban Movement Qualities , 2017, CHI.

[283]  Mohan M. Trivedi,et al.  Are all objects equal? Deep spatio-temporal importance prediction in driving videos , 2017, Pattern Recognit..

[284]  Wendy E. Mackay,et al.  Human-Centred Machine Learning , 2016, CHI Extended Abstracts.

[285]  Jenna Burrell,et al.  How the machine ‘thinks’: Understanding opacity in machine learning algorithms , 2016 .

[286]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[287]  Alan F. Blackwell,et al.  Interacting with an inferred world: the challenge of machine learning for humane computer interaction , 2015, Aarhus Conference on Critical Alternatives.

[288]  Manfred Tscheligi,et al.  Towards Autonomous Cars: The Effect of Autonomy Levels on Acceptance and User Experience , 2014, AutomotiveUI.

[289]  Jesper Simonsen,et al.  Routledge International Handbook of Participatory Design , 2012 .

[290]  Liz Sanders,et al.  ON MODELINGAn evolving map of design practice and design research , 2008, INTR.

[291]  Pelle Ehn,et al.  Participation in design things , 2008, PDC.

[292]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[293]  Phoebe Sengers,et al.  The Three Paradigms of HCI , 2007 .

[294]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[295]  Jerry Alan Fails,et al.  Interactive machine learning , 2003, IUI '03.

[296]  Paul Dourish,et al.  Where the action is , 2001 .

[297]  Lucy A. Suchman,et al.  Plans and Situated Actions: The Problem of Human-Machine Communication (Learning in Doing: Social, , 1987 .

[298]  Samuel B. Williams,et al.  ASSOCIATION FOR COMPUTING MACHINERY , 2000 .

[299]  Daswin De Silva,et al.  Empathic conversational agents for real-time monitoring and co-facilitation of patient-centered healthcare , 2022, Future Gener. Comput. Syst..