Autonomous Skills Creation and Integration in Robotics

The fragmentation of research in AI and robotics has created a vast repertoire of skills a robot could be equipped with but that must be manually integrated to form a complex action. We propose a novel evolutionary algorithm that aims at autonomously integrating, adapting and creating new actions by re-using skills that are either externally provided or previously generated. Complex actions are created by instantiating a Finite State Automaton and new skills are created using fully recurrent neural networks. We validated our approach in two scenarios, i.e. exploration and moving to pre-grasp positions. Our experiments show that complex actions can be created by composing independently developed skills. The results have been applied and tested with a real robot in a variety of scenarios.

[1]  Maxim Likhachev,et al.  Search-based planning for manipulation with motion primitives , 2010, 2010 IEEE International Conference on Robotics and Automation.

[2]  Andrew G. Barto,et al.  Skill Discovery in Continuous Reinforcement Learning Domains using Skill Chaining , 2009, NIPS.

[3]  Scott Kuindersma,et al.  Autonomous Skill Acquisition on a Mobile Manipulator , 2011, AAAI.

[4]  Christian S. Perone,et al.  Pyevolve: a Python open-source framework for genetic algorithms , 2009, SEVO.

[5]  F. Girosi,et al.  Networks for approximation and learning , 1990, Proc. IEEE.

[6]  D. Fogel Evolutionary algorithms in theory and practice , 1997, Complex..

[7]  Nick Jakobi,et al.  Half-baked, Ad-hoc and Noisy: Minimal Simulations for Evolutionary Robotics , 1993 .

[8]  Michael Beetz,et al.  Action-related place-based mobile manipulation , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Leslie Pack Kaelbling,et al.  Hierarchical task and motion planning in the now , 2011, 2011 IEEE International Conference on Robotics and Automation.

[10]  Moritz Tenorth,et al.  Towards performing everyday manipulation activities , 2010, Robotics Auton. Syst..

[11]  T. Martin McGinnity,et al.  Automatically composing and parameterizing skills by evolving Finite State Automata , 2012, Robotics Auton. Syst..

[12]  Matei T. Ciocarlie,et al.  Contact-reactive grasping of objects with partial shape information , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Dmitry Berenson,et al.  An optimization approach to planning for mobile manipulation , 2008, 2008 IEEE International Conference on Robotics and Automation.

[14]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[15]  Stephen Hart,et al.  Learning Generalizable Control Programs , 2011, IEEE Transactions on Autonomous Mental Development.

[16]  Randall D. Beer,et al.  Evolving Dynamical Neural Networks for Adaptive Behavior , 1992, Adapt. Behav..

[17]  Michael Beetz,et al.  Refining the Execution of Abstract Actions with Learned Action Models , 2008, J. Artif. Intell. Res..

[18]  Kurt Konolige,et al.  The Office Marathon: Robust navigation in an indoor office environment , 2010, 2010 IEEE International Conference on Robotics and Automation.

[19]  Josh C. Bongard,et al.  Behavior Chaining - Incremental Behavior Integration for Evolutionary Robotics , 2008, ALIFE.

[20]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .