Demonstration learning of robotic skills using repeated suggestions learning algorithm

Abstract In this paper a new model of nonlinear dynamical system based on adaptive frequency oscillators for learning rhythmic signals is implemented by demonstration. This model uses coupled Hopf oscillators to encode and learn any periodic input signal. Learning process is completely implemented in the dynamics of adaptive oscillators. One of the issues in learning in such systems is constant number of oscillators in the feedback loop. In other words, the number of adaptive frequency oscillators is one of the design factors. In this contribution, it is shown that using enough number of oscillators can help the learning process. In this paper, we address this challenge and try to solve it in order to learn the rhythmic movements with greater accuracy, lower error and avoid missing fundamental frequency. To reach this aim, a method for generating drumming patterns is proposed which is able to generate rhythmic and periodic trajectories for a NAO humanoid robot. To do so, a programmable central pattern generator is used which is inspired from animal’s neural systems and these programmable central pattern generators are extended to learn patterns with more accuracy for NAO humanoid robots. Successful experiments of demonstration learning are done using simulation and a NAO Real robot.

[1]  Aude Billard,et al.  Dynamical System Modulation for Robot Learning via Kinesthetic Demonstrations , 2008, IEEE Transactions on Robotics.

[2]  A. Ijspeert,et al.  Dynamic hebbian learning in adaptive frequency oscillators , 2006 .

[3]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[4]  Jan Peters,et al.  Imitation and Reinforcement Learning , 2010, IEEE Robotics & Automation Magazine.

[5]  Qinghai Bai,et al.  Analysis of Particle Swarm Optimization Algorithm , 2010, Comput. Inf. Sci..

[6]  Tamim Asfour,et al.  Imitation Learning of Dual-Arm Manipulation Tasks in Humanoid Robots , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[7]  A. Ijspeert,et al.  From Dynamic Hebbian Learning for Oscillators to Adaptive Central Pattern Generators , 2005 .

[8]  Teresa Zielińska,et al.  Biological inspiration used for robots motion synthesis , 2009, Journal of Physiology-Paris.

[9]  Katsushi Ikeuchi,et al.  Humanoid robot motion generation with sequential physical constraints , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[10]  Andrej Gams,et al.  On-line learning and modulation of periodic movements with nonlinear dynamical systems , 2009, Auton. Robots.

[11]  Ludovic Righetti,et al.  Programmable central pattern generators: an application to biped locomotion control , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[12]  Jun Nakanishi,et al.  Learning rhythmic movements by demonstration using nonlinear oscillators , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Jun Morimoto,et al.  Task-Specific Generalization of Discrete and Periodic Dynamic Movement Primitives , 2010, IEEE Transactions on Robotics.

[14]  A. Ijspeert,et al.  Adaptive Frequency Oscillators and Applications , 2009 .

[15]  Brett Browning,et al.  A survey of robot learning from demonstration , 2009, Robotics Auton. Syst..

[16]  P. Guertin The mammalian central pattern generator for locomotion , 2009, Brain Research Reviews.

[17]  Ludovic Righetti,et al.  A Dynamical Systems Approach to Learning: A Frequency-Adaptive Hopper Robot , 2005, ECAL.

[18]  Yasuharu Koike,et al.  PII: S0893-6080(96)00043-3 , 1997 .