Learning of assembly constraints by demonstration and active exploration

Purpose In this paper, the authors aim to propose a method for learning robotic assembly sequences, where precedence constraints and object relative size and location constraints can be learned by demonstration and autonomous robot exploration. Design/methodology/approach To successfully plan the operations involved in assembly tasks, the planner needs to know the constraints of the desired task. In this paper, the authors propose a methodology for learning such constraints by demonstration and autonomous exploration. The learning of precedence constraints and object relative size and location constraints, which are needed to construct a planner for automated assembly, were investigated. In the developed system, the learning of symbolic constraints is integrated with low-level control algorithms, which is essential to enable active robot learning. Findings The authors demonstrated that the proposed reasoning algorithms can be used to learn previously unknown assembly constraints that are needed to implement a planner for automated assembly. Cranfield benchmark, which is a standardized benchmark for testing algorithms for robot assembly, was used to evaluate the proposed approaches. The authors evaluated the learning performance both in simulation and on a real robot. Practical implications The authors' approach reduces the amount of programming that is needed to set up new assembly cells and consequently the overall set up time when new products are introduced into the workcell. Originality/value In this paper, the authors propose a new approach for learning assembly constraints based on programming by demonstration and active robot exploration to reduce the computational complexity of the underlying search problems. The authors developed algorithms for success/failure detection of assembly operations based on the comparison of expected signals (forces and torques, positions and orientations of the assembly parts) with the actual signals sensed by a robot. In this manner, all precedence and object size and location constraints can be learned, thereby providing the necessary input for the optimal planning of the entire assembly process.

[1]  Darwin G. Caldwell,et al.  Upper-body kinesthetic teaching of a free-standing humanoid robot , 2011, 2011 IEEE International Conference on Robotics and Automation.

[2]  A.G. Alleyne,et al.  A survey of iterative learning control , 2006, IEEE Control Systems.

[3]  K. Rathmill,et al.  The Development of a European Benchmark for the Comparison of Assembly Robot Programming Systems , 1985 .

[4]  Michael Gelfond,et al.  Knowledge Representation, Reasoning, and the Design of Intelligent Agents: The Answer-Set Programming Approach , 2014 .

[5]  Andrea Lockerd Thomaz,et al.  Using perspective taking to learn from ambiguous demonstrations , 2006, Robotics Auton. Syst..

[6]  Y. Wang,et al.  Chaotic particle swarm optimization for assembly sequence planning , 2010 .

[7]  Robert Bogue The role of artificial intelligence in robotics , 2014, Ind. Robot.

[8]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[9]  Ales Ude,et al.  Solving peg-in-hole tasks by human demonstration and exception strategies , 2014 .

[10]  Carme Torras,et al.  Active learning of manipulation sequences , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Monica N. Nicolescu,et al.  Learning and interacting in human-robot domains , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[12]  Henrik Gordon Petersen,et al.  Technologies for the Fast Set-Up of Automated Assembly Processes , 2014, KI - Künstliche Intelligenz.

[13]  Daniel E. Whitney,et al.  Assembly research , 1980, Autom..

[14]  G. Schreiber,et al.  The Fast Research Interface for the KUKA Lightweight Robot , 2022 .

[15]  Syed H. Masood,et al.  An Intelligent Computer-Aided Assembly Process Planning System , 1999 .

[16]  Jun Morimoto,et al.  Orientation in Cartesian space dynamic movement primitives , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Carme Torras,et al.  A robot learning from demonstration framework to perform force-based manipulation tasks , 2013, Intelligent Service Robotics.

[18]  Henrik Gordon Petersen,et al.  Pose estimation using local structure-specific shape and appearance context , 2013, 2013 IEEE International Conference on Robotics and Automation.

[19]  Bart Selman,et al.  S. Russell, P. Norvig, Artificial Intelligence: A Modern Approach, Third Edition , 2011, Artif. Intell..

[20]  F. Dweiri Fuzzy development of crisp activity relationship charts for facilities layout , 1999 .

[21]  Brett Browning,et al.  A survey of robot learning from demonstration , 2009, Robotics Auton. Syst..

[22]  Jimmy A. Jørgensen,et al.  Adaptation of manipulation skills in physical contact with the environment to reference force profiles , 2015, Auton. Robots.

[23]  Guido Bugmann,et al.  Mobile robot programming using natural language , 2002, Robotics Auton. Syst..

[24]  Zita Vale,et al.  A complete complexity study of one-processor assembly and manufacturing planning tasks , 2001, Proceedings of the 2001 IEEE International Symposium on Assembly and Task Planning (ISATP2001). Assembly and Disassembly in the Twenty-first Century. (Cat. No.01TH8560).

[25]  Yanqiong Fei,et al.  Jamming analyses for dual peg-in-hole insertions in three dimensions , 2005, Robotica.

[26]  Fulvio Mastrogiovanni,et al.  Learning symbolic representations of actions from human demonstrations , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[27]  Carme Torras,et al.  Integrating Task Planning and Interactive Learning for Robots to Work in Human Environments , 2011, IJCAI.

[28]  Tiam-Hock Enga,et al.  Feature-based assembly modeling and sequence generation , 1999 .

[29]  Jun Nakanishi,et al.  Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors , 2013, Neural Computation.

[30]  Pablo Jiménez,et al.  Survey on assembly sequencing: a combinatorial and geometrical perspective , 2013, J. Intell. Manuf..

[31]  Masayuki Inaba,et al.  Learning by watching: extracting reusable task knowledge from visual observation of human performance , 1994, IEEE Trans. Robotics Autom..