Challenges of Human-Aware AI Systems

From its inception, AI has had a rather ambivalent relationship to humans---swinging between their augmentation and replacement. Now, as AI technologies enter our everyday lives at an ever increasing pace, there is a greater need for AI systems to work synergistically with humans. To do this effectively, AI systems must pay more attention to aspects of intelligence that helped humans work with each other---including social intelligence. I will discuss the research challenges in designing such human-aware AI systems, including modeling the mental states of humans in the loop, recognizing their desires and intentions, providing proactive support, exhibiting explicable behavior, giving cogent explanations on demand, and engendering trust. I will survey the progress made so far on these challenges, and highlight some promising directions. I will also touch on the additional ethical quandaries that such systems pose. I will end by arguing that the quest for human-aware AI systems broadens the scope of AI enterprise, necessitates and facilitates true inter-disciplinary collaborations, and can go a long way towards increasing public acceptance of AI technologies.

[1]  Subbarao Kambhampati,et al.  Projection-Aware Task Planning and Execution for Human-in-the-Loop Operation of Robots in a Mixed-Reality Workspace , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[2]  Kurt VanLehn,et al.  The Behavior of Tutoring Systems , 2006, Int. J. Artif. Intell. Educ..

[3]  H. Wimmer,et al.  Beliefs about beliefs: Representation and constraining function of wrong beliefs in young children's understanding of deception , 1983, Cognition.

[4]  Barbara J. Grosz.  AAAI-94 Presidential Address: Collaborative Systems , 1996, AI Mag..

[5]  Subbarao Kambhampati,et al.  A Unified Framework for Planning in Adversarial and Cooperative Environments , 2018, AAAI.

[6]  Yu Zhang,et al.  Plan explicability and predictability for robot task planning , 2015, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Sailik Sengupta,et al.  RADAR - A Proactive Decision Support System for Human-in-the-Loop Planning , 2017, AAAI Fall Symposia.

[8]  Cynthia Breazeal,et al.  Designing sociable robots , 2002 .

[9]  Paul N. Bennett,et al.  Guidelines for Human-AI Interaction , 2019, CHI.

[10]  Cynthia Breazeal,et al.  Toward sociable robots , 2003, Robotics Auton. Syst..

[11]  Subbarao Kambhampati,et al.  Explicable Planning as Minimizing Distance from Expected Behavior , 2019, AAMAS.

[12]  Subbarao Kambhampati,et al.  Handling Model Uncertainty and Multiplicity in Explanations via Model Reconciliation , 2018, ICAPS.

[13]  Nancy J. Cooke,et al.  Teaming With a Synthetic Teammate: Insights into Human-Autonomy Teaming , 2018, Hum. Factors.

[14]  Yu Zhang,et al.  Planning with Resource Conflicts in Human-Robot Cohabitation , 2016, AAMAS.

[15]  Subbarao Kambhampati,et al.  (When) Can AI Bots Lie? , 2019, AIES.

[16]  Yu Zhang,et al.  Plan Explanations as Model Reconciliation: Moving Beyond Explanation as Soliloquy , 2017, IJCAI.

[17]  Barbara J. Grosz,et al.  Collaborative Systems (AAAI-94 Presidential Address) , 1996 .

[18]  Yu Zhang,et al.  Planning for serendipity , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[19]  Brian Scassellati,et al.  Theory of Mind for a Humanoid Robot , 2002, Auton. Robots.

[20]  Matthias Scheutz,et al.  Tell me when and why to do it! Run-time planner model updates via natural language instruction , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[21]  Yu Zhang,et al.  AI Challenges in Human-Robot Cognitive Teaming , 2017, ArXiv.

[22]  Subbarao Kambhampati,et al.  Planning with Explanatory Actions: A Joint Approach to Plan Explicability and Explanations in Human-Aware Planning , 2019, ArXiv.

[23]  Subbarao Kambhampati,et al.  Explicability? Legibility? Predictability? Transparency? Privacy? Security? The Emerging Landscape of Interpretable Agent Behavior , 2018, ICAPS.

[24]  Subbarao Kambhampati,et al.  Model-Free Model Reconciliation , 2019, IJCAI.

[25]  Baoxin Li,et al.  Recognizing Plans by Learning Embeddings from Observed Action Distributions , 2017, AAMAS.

[26]  Subbarao Kambhampati,et al.  Plan Explanations as Model Reconciliation - An Empirical Study , 2018, ArXiv.

[27]  Subbarao Kambhampati,et al.  Discovering Underlying Plans Based on Distributed Representations of Actions , 2016, AAMAS.

[28]  Subbarao Kambhampati,et al.  Hierarchical Expertise Level Modeling for User Specific Contrastive Explanations , 2018, IJCAI.

[29]  Nancy J. Cooke,et al.  Interactive Team Cognition , 2013, Cogn. Sci..

[30]  T. Lombrozo.  The structure and function of explanations , 2006, Trends in Cognitive Sciences.

[31]  Subbarao Kambhampati,et al.  Explicability versus Explanations in Human-Aware Planning , 2018, AAMAS.