Designing Environments Conducive to Interpretable Robot Behavior

Designing robots capable of generating interpretable behavior is a prerequisite for achieving effective human-robot collaboration. This means that the robots need to be capable of generating behavior that aligns with human expectations and, when required, provide explanations to the humans in the loop. However, exhibiting such behavior in arbitrary environments could be quite expensive for robots, and in some cases, the robot may not even be able to exhibit the expected behavior. Given structured environments (like warehouses and restaurants), it may be possible to design the environment so as to boost the interpretability of the robot's behavior or to shape the human's expectations of the robot's behavior. In this paper, we investigate the opportunities and limitations of environment design as a tool to promote a type of interpretable behavior -- known in the literature as explicable behavior. We formulate a novel environment design framework that considers design over multiple tasks and over a time horizon. In addition, we explore the longitudinal aspect of explicable behavior and the trade-off that arises between the cost of design and the cost of generating explicable behavior over a time horizon.

[1]  Ping Hou,et al.  Goal Recognition Design with Stochastic Agent Action Outcomes , 2016, IJCAI.

[2]  Erez Karpas,et al.  Goal Recognition Design , 2014, ICAPS.

[3]  Yu Zhang,et al.  Explicable Robot Planning as Minimizing Distance from Expected Behavior , 2016, ArXiv.

[4]  David C. Parkes,et al.  A General Approach to Environment Design with One Agent , 2009, IJCAI.

[5]  Subbarao Kambhampati,et al.  Explicability? Legibility? Predictability? Transparency? Privacy? Security? The Emerging Landscape of Interpretable Agent Behavior , 2018, ICAPS.

[6]  John Yen,et al.  The influence of agent reliability on trust in human-agent collaboration , 2008, ECCE '08.

[7]  Erez Karpas,et al.  Privacy Preserving Plans in Partially Observable Environments , 2016, IJCAI.

[8]  Erez Karpas,et al.  Equi-Reward Utility Maximizing Design in Stochastic Environments , 2017, IJCAI.

[9]  Nancy M. Amato,et al.  A Roadmap for US Robotics - From Internet to Robotics 2020 Edition , 2021, Found. Trends Robotics.

[10]  Subbarao Kambhampati,et al.  A Unified Framework for Planning in Adversarial and Cooperative Environments , 2018, AAAI.

[11]  Yadati Narahari,et al.  Game Theory and Mechanism Design , 2014 .

[12]  Yu Zhang,et al.  Plan Explanations as Model Reconciliation: Moving Beyond Explanation as Soliloquy , 2017, IJCAI.

[13]  Subbarao Kambhampati,et al.  Planning with Explanatory Actions: A Joint Approach to Plan Explicability and Explanations in Human-Aware Planning , 2019, ArXiv.

[14]  Subbarao Kambhampati,et al.  Hierarchical Expertise Level Modeling for User Specific Contrastive Explanations , 2018, IJCAI.

[15]  Yu Zhang,et al.  Plan explicability and predictability for robot task planning , 2015, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Subbarao Kambhampati,et al.  Balancing Explicability and Explanation in Human-Aware Planning , 2017, AAAI Fall Symposia.

[17]  Erez Karpas,et al.  Strong Stubborn Sets for Efficient Goal Recognition Design , 2018, ICAPS.

[18]  Ping Hou,et al.  New Metrics and Algorithms for Stochastic Goal Recognition Design Problems , 2017, IJCAI.

[19]  Meir Kalech,et al.  Goal and Plan Recognition Design for Plan Libraries , 2019, ACM Trans. Intell. Syst. Technol..

[20]  Blai Bonet,et al.  A Concise Introduction to Models and Methods for Automated Planning , 2013, A Concise Introduction to Models and Methods for Automated Planning.

[21]  Anca D. Dragan,et al.  Generating Plans that Predict Themselves , 2018, WAFR.

[22]  Siddhartha S. Srinivasa,et al.  Legibility and predictability of robot motion , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[23]  Subbarao Kambhampati,et al.  Hierarchical Expertise-Level Modeling for User Specific Robot-Behavior Explanations , 2020, AAAI.

[24]  Malte Helmert,et al.  The Fast Downward Planning System , 2006, J. Artif. Intell. Res..