What Stands-in for a Missing Tool?: A Prototypical Grounded Knowledge-based Approach to Tool Substitution

When a robot is operating in a dynamic environment, it cannot be assumed that a tool required to solve a given task will always be available. In case of a missing tool, an ideal response would be to find a substitute to complete the task. In this paper, we present a proof of concept of a grounded knowledge-based approach to tool substitution. In order to validate the suitability of a substitute, we conducted experiments involving 22 substitution scenarios. The substitutes computed by the proposed approach were validated on the basis of the experts' choices for each scenario. Our evaluation showed, in 20 out of 22 scenarios (91%), the approach identified the same substitutes as experts.

[1]  Christopher Baber,et al.  Working with tools , 2003 .

[2]  Moritz Tenorth,et al.  KNOWROB — knowledge processing for autonomous personal robots , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Christian A. Mueller,et al.  Towards Robot-Centric Conceptual Knowledge Acquisition , 2018, ArXiv.

[4]  Frank Guerin,et al.  Transfer of Tool Affordance and Manipulation Cues with 3D Vision Data , 2017, ArXiv.

[5]  Silvia Coradeschi,et al.  Grounding commonsense knowledge in intelligent systems , 2009, J. Ambient Intell. Smart Environ..

[6]  Dieter Fox,et al.  A large-scale hierarchical multi-view RGB-D object dataset , 2011, 2011 IEEE International Conference on Robotics and Automation.

[7]  Il Hong Suh,et al.  Ontology-based multi-layered robot knowledge framework (OMRKF) for robot intelligence , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Rakesh Gupta,et al.  Common Sense Data Acquisition for Indoor Mobile Robots , 2004, AAAI.

[9]  Christian A. Mueller,et al.  Conceptualization of Object Compositions Using Persistent Homology , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[10]  Il Hong Suh,et al.  Ontology-Based Unified Robot Knowledge for Service Robots in Indoor Environments , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[11]  Michael Beetz,et al.  ORO, a knowledge management platform for cognitive architectures in robotics , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Sebastian Zug,et al.  A Review of Knowledge Bases for Service Robots in Household Environments , 2018, AIC.

[13]  Sonia Chernova,et al.  Towards Robot Adaptability in New Situations , 2015, AAAI Fall Symposia.

[14]  Hema Swetha Koppula,et al.  RoboBrain: Large-Scale Knowledge Engine for Robots , 2014, ArXiv.

[15]  Christian A. Mueller,et al.  Object shape categorization in RGBD images using hierarchical graph constellation models based on unsupervisedly learned shape parts described by a set of shape specificity levels , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Eren Erdal Aksoy,et al.  Using structural bootstrapping for object substitution in robotic executions of human-like manipulation tasks , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[17]  Justus H. Piater,et al.  Knowledge propagation and relation learning for predicting action effects , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Sonia Chernova,et al.  Leveraging Large-Scale Semantic Networks for Adaptive Robot Task Learning and Execution , 2016, Big Data.

[19]  Christian A. Mueller,et al.  Hierarchical graph-based discovery of non-primitive-shaped objects in unstructured environments , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[20]  Frank Guerin,et al.  A model-based approach to finding substitute tools in 3D vision data , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Werner Kuhn,et al.  An Image-Schematic Account of Spatial Categories , 2007, COSIT.

[22]  Beth Preston,et al.  Cognition and Tool Use , 1998 .

[23]  Joachim Hertzberg,et al.  Challenges in finding ways to get the job done , 2014 .

[24]  Vasilios K. Kimiskidis,et al.  Introduction , 2019, Int. J. Neural Syst..

[25]  Peter Gärdenfors,et al.  Cognitive semantics and image schemas with embodied forces , 2007 .

[26]  Iván V. Meza,et al.  A light non-monotonic knowledge-base for service robots , 2017, Intelligent Service Robotics.