Human-Robot Collaboration using Variable Admittance Control and Human Intention Prediction

Due to the difficulty of modeling human limb, it is very challenging to design the controller for human-robot collaboration. In this paper, we present a novel controller combining the variable admittance control and assistant control. In particular, the reinforcement learning is used to obtain the optimal damping value of the admittance controller by minimizing the reward function. In addition, we use the long short-term memory networks (LSTMs) to predict human intention based on the human limb dynamics and then an assistant controller is proposed to help human complete collaboration tasks. We validate the performance of our prediction algorithm and controller on a 7 d.o.f Franka Emika robot equipped with joint torque sensors. The proposed controller can both achieve minimum-jerk trajectory and low-effort cost.

[1]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[2]  Marc D. Killpack,et al.  Analysis of Rigid Extended Object Co-Manipulation by Human Dyads: Lateral Movement Characterization , 2017, Robotics: Science and Systems.

[3]  Yuval Tassa,et al.  Continuous control with deep reinforcement learning , 2015, ICLR.

[4]  E. Bizzi,et al.  Neural, mechanical, and geometric factors subserving arm posture in humans , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[5]  Bruno Siciliano,et al.  Variable Impedance Control of Redundant Manipulators for Intuitive Human–Robot Physical Interaction , 2015, IEEE Transactions on Robotics.

[6]  Ryojun Ikeura,et al.  Investigation of the Impedance Characteristic of Human Arm for Development of Robots to Cooperate with Humans , 2002 .

[7]  Shuzhi Sam Ge,et al.  Human–Robot Collaboration Based on Motion Intention Estimation , 2014, IEEE/ASME Transactions on Mechatronics.

[8]  Frank L. Lewis,et al.  Optimized Assistive Human–Robot Interaction Using Reinforcement Learning , 2016, IEEE Transactions on Cybernetics.

[9]  Sylvain Miossec,et al.  Human motion in cooperative tasks: Moving object case study , 2009, 2008 IEEE International Conference on Robotics and Biomimetics.

[10]  Weihua Sheng,et al.  Using human motion estimation for human-robot cooperative manipulation , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Hendrik Van Brussel,et al.  Human-inspired robot assistant for fast point-to-point movements , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[12]  Ehsan Noohi,et al.  A Model for Human–Human Collaborative Object Manipulation and Its Application to Human–Robot Interaction , 2016, IEEE Transactions on Robotics.

[13]  Siddhartha S. Srinivasa,et al.  A policy-blending formalism for shared control , 2013, Int. J. Robotics Res..

[14]  Ryojun Ikeura,et al.  Cooperative motion control of a robot and a human , 1994, Proceedings of 1994 3rd IEEE International Workshop on Robot and Human Communication.

[15]  Clément Gosselin,et al.  Variable admittance control of a four-degree-of-freedom intelligent assist device , 2012, 2012 IEEE International Conference on Robotics and Automation.

[16]  Toru Tsumugiwa,et al.  Stability analysis for impedance control of robot for human-robot cooperative task system , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[17]  Davide Nicolis,et al.  Human Intention Estimation based on Neural Networks for Enhanced Collaboration with Robots , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  Nikos A. Aspragathos,et al.  Reinforcement learning of variable admittance control for human-robot co-manipulation , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[19]  Stefan Schaal,et al.  Learning variable impedance control , 2011, Int. J. Robotics Res..