Quick Setup of Force-Controlled Industrial Gluing Tasks Using Learning From Demonstration

This paper presents a framework for programming in-contact tasks using learning by demonstration. The framework is demonstrated on an industrial gluing task, showing that a high quality robot behavior can be programmed using a single demonstration. A unified controller structure is proposed for the demonstration and execution of in-contact tasks that eases the transition from admittance controller for demonstration to parallel force/position control for the execution. The proposed controller is adapted according to the geometry of the task constraints, which is estimated online during the demonstration. In addition, the controller gains are adapted to the human behavior during demonstration to improve the quality of the demonstration. The considered gluing task requires the robot to alternate between free motion and in-contact motion; hence, an approach for minimizing contact forces during the switching between the two situations is presented. We evaluate our proposed system in a series of experiments, where we show that we are able to estimate the geometry of a curved surface, that our adaptive controller for demonstration allows users to achieve higher accuracy in a shorter demonstration duration when compared to an off-the-shelf controller for teaching implemented on a collaborative robot, and that our execution controller is able to reduce impact forces and apply a constant process force while adapting to the surface geometry.

[1]  Hermes Giberti,et al.  A Feasibility Study of a Robotic Approach for the Gluing Process in the Footwear Industry , 2021, Robotics.

[2]  Nikos A. Aspragathos,et al.  Reinforcement learning of variable admittance control for human-robot co-manipulation , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  Sandra Hirche,et al.  Learning and generalizing force control policies for sculpting , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Ales Ude,et al.  Synthesis of New Dynamic Movement Primitives Through Search in a Hierarchical Database of Example Movements , 2015 .

[5]  Jochen J. Steil,et al.  Learning movement primitives for force interaction tasks , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Jianwei Zhang,et al.  Learning human compliant behavior from demonstration for force-based robot manipulation , 2016, 2016 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[7]  Manju Rani,et al.  A new hybrid force/position control approach for time-varying constrained reconfigurable manipulators. , 2020, ISA transactions.

[8]  B. Siciliano,et al.  THE ROLE OF EULER PARAMETERS IN ROBOT CONTROL , 1999 .

[9]  Axel Gandy,et al.  Non-restarting cumulative sum charts and control of the false discovery rate , 2012, 1204.4333.

[10]  Luís Santos,et al.  Perceived Stiffness Estimation for Robot Force Control , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Jun Nakanishi,et al.  Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors , 2013, Neural Computation.

[12]  Rodrigo Pérez-Ubeda,et al.  Force Control Improvement in Collaborative Robots through Theory Analysis and Experimental Endorsement , 2020 .

[13]  Henk Nijmeijer,et al.  Robot Programming by Demonstration , 2010, SIMPAR.

[14]  G. Oriolo,et al.  Robotics: Modelling, Planning and Control , 2008 .

[15]  Danica Kragic,et al.  Online contact point estimation for uncalibrated tool use , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Corentin Briat Linear Parameter-Varying and Time-Delay Systems: Analysis, Observation, Filtering & Control , 2014 .

[17]  Ulrike Thomas,et al.  Stability of Nonlinear Time-Delay Systems Describing Human–Robot Interaction , 2019, IEEE/ASME Transactions on Mechatronics.

[18]  Stefan Schaal,et al.  Learning variable impedance control , 2011, Int. J. Robotics Res..

[19]  Christoffer Sloth,et al.  Simultaneous Contact Point and Surface Normal Estimation during Soft Finger Contact , 2021, 2021 20th International Conference on Advanced Robotics (ICAR).

[20]  Ales Ude,et al.  An Efficient PbD Framework for Fast Deployment of Bi-Manual Assembly Tasks , 2018, 2018 IEEE-RAS 18th International Conference on Humanoid Robots (Humanoids).

[21]  Andrej Gams,et al.  Modulation of motor primitives using force feedback: Interaction with the environment and bimanual tasks , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Rubita Sudirman,et al.  Dynamic time warping , 2008 .

[23]  S.M. Nayeem Hasan,et al.  A Luenberger–Sliding Mode Observer for Online Parameter Estimation and Adaptation in High-Performance Induction Motor Drives , 2006, IEEE Transactions on Industry Applications.

[24]  Darwin G. Caldwell,et al.  A Method for Derivation of Robot Task-Frame Control Authority from Repeated Sensory Observations , 2017, IEEE Robotics and Automation Letters.

[25]  Ulrike Thomas,et al.  User Force-Dependent Variable Impedance Control in Human-Robot Interaction , 2018, 2018 IEEE 14th International Conference on Automation Science and Engineering (CASE).

[26]  Ales Ude,et al.  Smart hardware integration with advanced robot programming technologies for efficient reconfiguration of robot workcells , 2020, Robotics Comput. Integr. Manuf..

[27]  Nikos A. Aspragathos,et al.  Fuzzy learning variable admittance control for human-robot cooperation , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Stefan Schaal,et al.  Online movement adaptation based on previous sensor experiences , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[30]  Carme Torras,et al.  A robot learning from demonstration framework to perform force-based manipulation tasks , 2013, Intelligent Service Robotics.

[31]  Francis J. Doyle,et al.  Survey on iterative learning control, repetitive control, and run-to-run control , 2009 .

[32]  Tucker Hermans,et al.  Learning Task Constraints from Demonstration for Hybrid Force/Position Control , 2018, 2019 IEEE-RAS 19th International Conference on Humanoid Robots (Humanoids).

[33]  S. Schaal Dynamic Movement Primitives -A Framework for Motor Control in Humans and Humanoid Robotics , 2006 .

[34]  Darwin G. Caldwell,et al.  Imitation Learning of Positional and Force Skills Demonstrated via Kinesthetic Teaching and Haptic Input , 2011, Adv. Robotics.

[35]  Aude Billard,et al.  Online learning of varying stiffness through physical human-robot interaction , 2012, 2012 IEEE International Conference on Robotics and Automation.

[36]  Aude Billard,et al.  Learning Compliant Manipulation through Kinesthetic and Tactile Human-Robot Interaction , 2014, IEEE Transactions on Haptics.

[37]  H. Harry Asada,et al.  Automatic program generation from teaching data for the hybrid control of robots , 1989, IEEE Trans. Robotics Autom..

[38]  Jun Morimoto,et al.  Orientation in Cartesian space dynamic movement primitives , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[39]  Valerio Ortenzi,et al.  Hybrid motion/force control: a review , 2017, Adv. Robotics.

[40]  Sergey Levine,et al.  Learning from multiple demonstrations using trajectory-aware non-rigid registration with applications to deformable object manipulation , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[41]  Andrej Gams,et al.  Human robot cooperation with compliance adaptation along the motion trajectory , 2018, Auton. Robots.

[42]  John J. Craig,et al.  Hybrid position/force control of manipulators , 1981 .

[43]  Matteo Saveriano,et al.  Variable Impedance Control and Learning—A Review , 2020, Frontiers in Robotics and AI.

[44]  Stefano Stramigioli,et al.  Modeling and IPC Control of Interactive Mechanical Systems - A Coordinate-Free Approach , 2001 .

[45]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[46]  Matteo Parigi Polverini,et al.  Robust set invariance for implicit robot force control in presence of contact model uncertainty , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[47]  Jimmy A. Jørgensen,et al.  Adaptation of manipulation skills in physical contact with the environment to reference force profiles , 2015, Auton. Robots.

[48]  Carlos Canudas de Wit,et al.  Direct adaptive impedance control including transition phases , 1997, Autom..

[49]  Meinard Müller,et al.  Information retrieval for music and motion , 2007 .

[50]  Stefan Schaal,et al.  Robot Programming by Demonstration , 2009, Springer Handbook of Robotics.

[51]  Bruno Siciliano,et al.  Variable Impedance Control of Redundant Manipulators for Intuitive Human–Robot Physical Interaction , 2015, IEEE Transactions on Robotics.

[52]  Jimmy A. Jørgensen,et al.  Transfer of assembly operations to new workpiece poses by adaptation to the desired force profile , 2013, 2013 16th International Conference on Advanced Robotics (ICAR).

[53]  Hsieh-Yu Li,et al.  A Control Scheme for Physical Human-Robot Interaction Coupled with an Environment of Unknown Stiffness , 2020, J. Intell. Robotic Syst..

[54]  Sami Haddadin,et al.  Unified passivity-based Cartesian force/impedance control for rigid and flexible joint robots via task-energy tanks , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[55]  Lorenzo Sabattini,et al.  A variable admittance control strategy for stable physical human–robot interaction , 2019, Int. J. Robotics Res..

[56]  Riccardo Russo,et al.  A vision guided robotic system for flexible gluing process in the footwear industry , 2020, Robotics Comput. Integr. Manuf..

[57]  Aude Billard,et al.  Task Parameterization Using Continuous Constraints Extracted From Human Demonstrations , 2015, IEEE Transactions on Robotics.