Using echo state networks for robot navigation behavior acquisition

Robot behavior learning by demonstration deals with the ability for a robot to learn a behavior from one or several demonstrations provided by a human teacher, possibly through tele-operation or imitation. This implies controllers that can address both (1) the feature selection problem related to a great amount of mostly irrelevant sensory data and (2) dealing with temporal sequences of demonstrations. Echo state networks (H. Jaeger, 2001) have been proposed recently for time series prediction and have been shown to perform remarkably well on this kind of data. In this paper, we introduce ESN to robot behavior acquisition in the scope of a mobile robot performing navigation tasks. ESN actually show comparable and even better performance with that of other algorithms from the literature in similar experimental conditions. Moreover, some properties regarding dynamics of ESN in the context of learning by demonstration are investigated.

[1]  Roland Siegwart,et al.  Robot learning from demonstration , 2004, Robotics Auton. Syst..

[2]  Seiji Yamada,et al.  Real Robot Learning with Human Teaching , 2002 .

[3]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 2005, IEEE Transactions on Neural Networks.

[4]  Nicolas Bredèche,et al.  Simbad: An Autonomous Robot Simulation Package for Education and Research , 2006, SAB.

[5]  Robert E. Schapire,et al.  A Brief Introduction to Boosting , 1999, IJCAI.

[6]  Aude Billard,et al.  Learning of Gestures by Imitation in a Humanoid Robot , 2007 .

[7]  Jeffrey L. Krichmar,et al.  Evolutionary robotics: The biology, intelligence, and technology of self-organizing machines , 2001, Complex..

[8]  Chrystopher L. Nehaniv,et al.  Teaching robots by moulding behavior and scaffolding the environment , 2006, HRI '06.

[9]  Stefan Schaal,et al.  Robot Learning From Demonstration , 1997, ICML.

[10]  Herbert Jaeger,et al.  The''echo state''approach to analysing and training recurrent neural networks , 2001 .

[11]  T. Belpraeme,et al.  Imitation and Social Learning in Robots, Humans and Animals: Behavioural, Social and Communicative Dimensions , 2006 .

[12]  Gordon Cheng,et al.  Discovering optimal imitation strategies , 2004, Robotics Auton. Syst..

[13]  Monica N. Nicolescu,et al.  Natural methods for robot task learning: instructive demonstrations, generalization and practice , 2003, AAMAS '03.

[14]  Paul-Gerhard Plöger,et al.  Echo State Networks used for Motor Control , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[15]  José Carlos Príncipe,et al.  Analysis and Design of Echo State Networks , 2007, Neural Computation.

[16]  Aude Billard,et al.  Experiments on human-robot communication with Robota, an imitative learning and communicating doll robot , 1998 .

[17]  Herbert Jaeger,et al.  A tutorial on training recurrent neural networks , covering BPPT , RTRL , EKF and the " echo state network " approach - Semantic Scholar , 2005 .

[18]  Kerstin Dautenhahn,et al.  The Art of Designing Socially Intelligent Agents: Science, Fiction, and the Human in the Loop , 1998, Appl. Artif. Intell..

[19]  Alexis Drogoul,et al.  Synthesis of robot's behaviors from few examples , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.