Learning and adaptation of periodic motion primitives based on force feedback and human coaching interaction

Dynamic movement primitives (DMP) allow efficient learning and control of complex robot behaviors for both periodic and discrete point-to-point movements either in joint or Cartesian space. They also allow efficient modulation by changing of parameters. In this paper we introduce and evaluate the means of adapting periodic DMP trajectories with respect to force feedback. We simultaneously consider two aspects: 1) adaptation of whole trajectories to comply with the constraints set by the environment; and 2) partially modifying the trajectories during the execution based on human intervention to improve the task performance. The latter can either be force-based, i. e. through physical contact, or through predefined gestures. By intervening when necessary the human acts as a tutor, instructing the robot how to modify the trajectory and bypassing the need to learn new trajectories by autonomous exploration. We introduce the approach in the context of wiping a surface, where the robot first has to acquire and maintain contact, and where later the human tutor modifies the originally learned trajectory in order to achieve the desired robot behavior. We present simulation and real world results of wiping a surface with a Kuka 7 degree-of-freedom LWR robot.

[1]  Luigi Villani,et al.  Force Control , 2016, Springer Handbook of Robotics, 2nd Ed..

[2]  Aude Billard,et al.  Learning Stable Nonlinear Dynamical Systems With Gaussian Mixture Models , 2011, IEEE Transactions on Robotics.

[3]  Stefan Schaal,et al.  Online movement adaptation based on previous sensor experiences , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Andrej Gams,et al.  On-line frequency adaptation and movement imitation for rhythmic robotic tasks , 2011, Int. J. Robotics Res..

[5]  Jun Morimoto,et al.  Online approach for altering robot behaviors based on human in the loop coaching gestures , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Gordon Cheng,et al.  Synthesizing goal-directed actions from a library of example movements , 2007, 2007 7th IEEE-RAS International Conference on Humanoid Robots.

[7]  Nikolaos G. Tsagarakis,et al.  Statistical dynamical systems for skills acquisition in humanoids , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[8]  Andrej Gams,et al.  Coupling Movement Primitives: Interaction With the Environment and Bimanual Tasks , 2014, IEEE Transactions on Robotics.

[9]  Tamim Asfour,et al.  Learn to wipe: A case study of structural bootstrapping from sensorimotor experience , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Kenji Suzuki,et al.  Coaching robot behavior using continuous physiological affective feedback , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[11]  Andrej Gams,et al.  On-line periodic movement and force-profile learning for adaptation to new surfaces , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[12]  Andrej Gams,et al.  On-line learning and modulation of periodic movements with nonlinear dynamical systems , 2009, Auton. Robots.

[13]  Dongheui Lee,et al.  Incremental kinesthetic teaching of motion primitives using the motion refinement tube , 2011, Auton. Robots.

[14]  Gordon Cheng,et al.  Coaching: An Approach to Efficiently and Intuitively Create Humanoid Robot Behaviors , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[15]  Andrej Gams,et al.  Rich periodic motor skills on humanoid robots: Riding the pedal racer , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Jun Nakanishi,et al.  Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors , 2013, Neural Computation.

[17]  Minija Tamosiunaite,et al.  Interaction learning for dynamic movement primitives used in cooperative robotic tasks , 2013, Robotics Auton. Syst..

[18]  Stefan Schaal,et al.  Encoding of periodic and their transient motions by a single dynamic movement primitive , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[19]  Jun Morimoto,et al.  Task-Specific Generalization of Discrete and Periodic Dynamic Movement Primitives , 2010, IEEE Transactions on Robotics.