Knowledge-based instruction of manipulation tasks for industrial robotics

When robots are working in dynamic environments, close to humans lacking extensive knowledge of robotics, there is a strong need to simplify the user interaction and make the system execute as autonomously as possible, as long as it is feasible. For industrial robots working side-by-side with humans in manufacturing industry, AI systems are necessary to lower the demand on programming time and system integration expertise. Only by building a system with appropriate knowledge and reasoning services can one simplify the robot programming sufficiently to meet those demands while still getting a robust and efficient task execution.In this paper, we present a system we have realized that aims at fulfilling the above demands. The paper focuses on the knowledge put into ontologies created for robotic devices and manufacturing tasks, and presents examples of AI-related services that use the semantic descriptions of skills to help users instruct the robot adequately. HighlightsWe present a system for knowledge-based task specification in assembly.Robotic skills are described in ontologies and used as building blocks for task specification and synthesis.Robotic skills are declarative, compositional, and reusable.An architecture to maintain and use industrial robotics knowledge is provided.

[1]  Pierre Nugues,et al.  A High-Performance Syntactic and Semantic Dependency Parser , 2010, COLING.

[2]  Daniel Gildea,et al.  The Proposition Bank: An Annotated Corpus of Semantic Roles , 2005, CL.

[3]  Riccardo Muradore,et al.  Ontology for robotics: A roadmap , 2009, 2009 International Conference on Advanced Robotics.

[4]  Tarek M. Sobh,et al.  Robotics Middleware: A Comprehensive Literature Survey and Attribute-Based Bibliography , 2012, J. Robotics.

[5]  Klas Nilsson,et al.  Declarative-knowledge-based reconfiguration of automation systems using a blackboard architecture , 2011, SCAI.

[6]  Anders Robertsson,et al.  On the integration of skilled robot motions for productivity in manufacturing , 2011, 2011 IEEE International Symposium on Assembly and Manufacturing (ISAM).

[7]  Herman Bruyninckx,et al.  Coordinating Robotic Tasks and Systems with rFSM Statecharts , 2012 .

[8]  Michael J. Witbrock,et al.  An Introduction to the Syntax and Content of Cyc , 2006, AAAI Spring Symposium: Formalizing and Compiling Background Knowledge and Its Applications to Knowledge Representation and Question Answering.

[9]  Anne-Françoise Cutting-Decelle,et al.  ISO 15531 MANDATE: A Product-process-resource based Approach for Managing Modularity in Production Management , 2007, Concurr. Eng. Res. Appl..

[10]  Michael R. Genesereth,et al.  Knowledge Interchange Format , 1991, KR.

[11]  Moritz Tenorth,et al.  KnowRob: A knowledge processing infrastructure for cognition-enabled robots , 2013, Int. J. Robotics Res..

[12]  Anders Robertsson,et al.  Flexible application development and high-performance motion control based on external sensing and reconfiguration of ABB industrial robot controllers , 2010, ICRA 2010.

[13]  Joris De Schutter,et al.  Constraint-based Task Specification and Estimation for Sensor-Based Robot Systems in the Presence of Geometric Uncertainty , 2007, Int. J. Robotics Res..

[14]  Ricardo G. Sanfelice,et al.  Hybrid Dynamical Systems: Modeling, Stability, and Robustness , 2012 .

[15]  Alfred Theorin.  Adapting Grafchart for Industrial Automation , 2013 .

[16]  Hajo Rijgersberg,et al.  Ontology of units of measure and related concepts , 2013, Semantic Web.

[17]  David Harel,et al.  Statecharts: A Visual Formalism for Complex Systems , 1987, Sci. Comput. Program..

[18]  Paolo Traverso,et al.  Automated Planning: Theory & Practice , 2004 .

[19]  Klas Nilsson,et al.  Knowledge for Intelligent Industrial Robots , 2012, AAAI Spring Symposium: Designing Intelligent Robots.

[20]  R. Kretschmann,et al.  INTERNATIONAL ELECTROTECHNICAL COMMISSION TECHNICAL COMMITTEE No. 65B: INDUSTRIAL-PROCESS MEASUREMENT AND CONTROL WORKING GROUP 7/TASK FORCE 3: PROGRAMMING LANGUAGES FOR PROGRAMMABLE CONTROLLERS (IEC 61131-3, -8) MINUTES OF MEETING , 2007 .

[21]  Nils J. Nilsson,et al.  Shakey the Robot , 1984 .

[22]  Raj Madhavan,et al.  Defining positioning in a core ontology for robotics , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  James G. Schmolze.  Physics for Robots , 1986, AAAI.

[24]  Jacek Malec,et al.  Describing constraint-based assembly tasks in unstructured natural language , 2014 .

[25]  Pierre Nugues,et al.  Natural language programming of industrial robots , 2013, IEEE ISR 2013.

[26]  Stefan Edelkamp,et al.  Automated Planning: Theory and Practice , 2007, Künstliche Intell..

[27]  Takashi Suehiro,et al.  RT-Component Object Model in RT-Middleware - Distributed Component Middleware for RT (Robot Technology) , 2005, CIRA.

[28]  Jameela Al-Jaroodi,et al.  Middleware for Robotics: A Survey , 2008, 2008 IEEE Conference on Robotics, Automation and Mechatronics.

[29]  Klas Nilsson,et al.  Enabling reuse of robot tasks and capabilities by business-related skills grounded in natural language , 2013, ICAS 2013.

[30]  Satyandra K. Gupta,et al.  An industrial robotic knowledge representation for kit building applications , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  George A. Bekey,et al.  On autonomous robots , 1998, The Knowledge Engineering Review.