Robot learning human stiffness regulation for hybrid manufacture

Purpose Teaching by demonstration (TbD) is a promising way for robot learning skills in human and robot collaborative hybrid manufacturing lines. Traditionally, TbD systems have only concentrated on how to enable robots to learn movement skills from humans. This paper aims to develop an extended TbD system which can also enable learning stiffness regulation strategies from humans. Design/methodology/approach Here, the authors propose an extended dynamical motor primitives (DMP) framework to achieve this goal. In addition to the advantages of the traditional ones, the authors’ framework can enable robots to simultaneously learn stiffness and the movement from human demonstrations. Additionally, Gaussian mixture model (GMM) is used to capture the features of movement and of stiffness from multiple demonstrations of the same skill. Human limb surface electromyography (sEMG) signals are estimated to obtain the reference stiffness profiles. Findings The authors have experimentally demonstrated the effectiveness of the proposed framework. It shows that the authors approach could allow the robot to execute tasks in a variable impedance control mode with the learned movement trajectories and stiffness profiles. Originality/value In robot skill acquisition, DMP is widely used to encode robotic behaviors. So far, however, these DMP modes do not provide the ability to properly represent and generalize stiffness profiles. The authors argue that both movement trajectories and stiffness profiles should be considered equally in robot skill learning. The authors’ approach has great potential of applications in the future hybrid manufacturing lines.

[1]  Pietro G. Morasso,et al.  A novel method for muscle fatigue assessment during robot-based tracking tasks , 2017, 2017 International Conference on Rehabilitation Robotics (ICORR).

[2]  Yun-Hui Liu,et al.  Adaptive Visual Servoing of Contour Features , 2018, IEEE/ASME Transactions on Mechatronics.

[3]  Alexander Verl,et al.  Cooperation of human and machines in assembly lines , 2009 .

[4]  Qijun Chen,et al.  Learning nonlinear dynamical system for movement primitives , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[5]  Darwin G. Caldwell,et al.  A Method for Derivation of Robot Task-Frame Control Authority from Repeated Sensory Observations , 2017, IEEE Robotics and Automation Letters.

[6]  Haoyong Yu,et al.  Composite Learning From Adaptive Dynamic Surface Control , 2016, IEEE Transactions on Automatic Control.

[7]  Alberto Montebelli,et al.  Incrementally assisted kinesthetic teaching for programming by demonstration , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[8]  Bruno Siciliano,et al.  Variable Impedance Control of Redundant Manipulators for Intuitive Human–Robot Physical Interaction , 2015, IEEE Transactions on Robotics.

[9]  Rieko Osu,et al.  The central nervous system stabilizes unstable dynamics by learning optimal impedance , 2001, Nature.

[10]  Haoyong Yu,et al.  Composite learning robot control with guaranteed parameter convergence , 2018, Autom..

[11]  Oliver Kroemer,et al.  Learning to select and generalize striking movements in robot table tennis , 2012, AAAI Fall Symposium: Robots Learning Interactively from Human Teachers.

[12]  Betty J. Mohler,et al.  Learning perceptual coupling for motor primitives , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Arash Ajoudani,et al.  Transferring Human Impedance Regulation Skills to Robots , 2015, Springer Tracts in Advanced Robotics.

[14]  Nikolaos G. Tsagarakis,et al.  A reduced-complexity description of arm endpoint stiffness with applications to teleimpedance control , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[15]  Tao Liu,et al.  Formation Control of Nonholonomic Mobile Robots Without Position and Velocity Measurements , 2018, IEEE Transactions on Robotics.

[16]  Hong Wang,et al.  Cyber-Physical Control for Energy Management of Off-Road Vehicles With Hybrid Energy Storage Systems , 2018, IEEE/ASME Transactions on Mechatronics.

[17]  Stefan Schaal,et al.  Model-Free Reinforcement Learning of Impedance Control in Stochastic Environments , 2012, IEEE Transactions on Autonomous Mental Development.

[18]  Darwin G. Caldwell,et al.  Imitation Learning of Positional and Force Skills Demonstrated via Kinesthetic Teaching and Haptic Input , 2011, Adv. Robotics.

[19]  Jing Na,et al.  Adaptive Parameter Estimation and Control Design for Robot Manipulators With Finite-Time Convergence , 2018, IEEE Transactions on Industrial Electronics.

[20]  Tadej Petric,et al.  Teaching robots to cooperate with humans in dynamic manipulation tasks based on multi-modal human-in-the-loop approach , 2014, Auton. Robots.

[21]  Tairen Sun,et al.  Adaptive Neural Network Control of Serial Variable Stiffness Actuators , 2017, Complex..

[22]  Nikolaos G. Tsagarakis,et al.  Statistical dynamical systems for skills acquisition in humanoids , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[23]  Ruifeng Li,et al.  Interface Design of a Physical Human–Robot Interaction System for Human Impedance Adaptive Skill Transfer , 2018, IEEE Transactions on Automation Science and Engineering.

[24]  Alberto Montebelli,et al.  Simultaneous kinesthetic teaching of positional and force requirements for sequential in-contact tasks , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[25]  Cheng Fang,et al.  A DMPs-Based Framework for Robot Learning and Generalization of Humanlike Variable Impedance Skills , 2018, IEEE/ASME Transactions on Mechatronics.

[26]  Tao Liu,et al.  Eye-in-Hand Tracking Control of a Free-Floating Space Manipulator , 2017, IEEE Transactions on Aerospace and Electronic Systems.

[27]  Jun Morimoto,et al.  Task-Specific Generalization of Discrete and Periodic Dynamic Movement Primitives , 2010, IEEE Transactions on Robotics.

[28]  Nikolaos G. Tsagarakis,et al.  Tele-impedance: Teleoperation with impedance regulation using a body–machine interface , 2012, Int. J. Robotics Res..

[29]  H. Kwatny,et al.  An application of signal processing techniques to the study of myoelectric signals. , 1970, IEEE transactions on bio-medical engineering.