Shared Impedance Control Based on Reinforcement Learning in a Human-Robot Collaboration Task

In this work a shared impedance control scheme for a hybrid human-robot team is designed for transporting a rigid workpiece to a desired position. Within the scope of proposed control structure, both human and robot are regarded as mechanical impedance and their parameters are adapted continuously in real-time. Reinforcement learning is used to find an impedance parameter set for the whole team to optimize a task-orient cost function. Then the learned parameters are further adjusted by taking human’s disagreement into consideration. The proposed method is aimed to reduce human’s control effort during collaboration and be flexible to variation of the task or environment. Experimental results are presented to illustrate the performance.

[1]  Alin Albu-Schäffer,et al.  Human-Like Adaptation of Force and Impedance in Stable and Unstable Interactions , 2011, IEEE Transactions on Robotics.

[2]  Cagatay Basdogan,et al.  The role of roles: Physical cooperation between humans and robots , 2012, Int. J. Robotics Res..

[3]  Keng Peng Tee,et al.  A Framework of Human–Robot Coordination Based on Game Theory and Policy Iteration , 2016, IEEE Transactions on Robotics.

[4]  Frank L. Lewis,et al.  Optimal Control: Lewis/Optimal Control 3e , 2012 .

[5]  Etienne Burdet,et al.  Slaves no longer: review on role assignment for human–robot joint motor action , 2014, Adapt. Behav..

[6]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation: Part II—Implementation , 1985 .

[7]  Klaus Bengler,et al.  Fast or Accurate? -- Performance Measurements for Physical Human-robot Collaborations , 2015 .

[8]  Cagatay Basdogan,et al.  Conveying intentions through haptics in human-computer collaboration , 2011, 2011 IEEE World Haptics Conference.

[9]  Sören Hohmann,et al.  Inverse Reinforcement Learning for Identification in Linear-Quadratic Dynamic Games , 2017 .

[10]  Bruno Siciliano,et al.  Variable Impedance Control of Redundant Manipulators for Intuitive Human–Robot Physical Interaction , 2015, IEEE Transactions on Robotics.

[11]  Zhiwei Luo,et al.  Modeling of Human-Like Reaching Movements in the Manipulation of Flexible Objects , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Kazuhiro Kosuge,et al.  Progress and prospects of the human–robot collaboration , 2017, Autonomous Robots.