Improving CGDA execution through Genetic Algorithms incorporating Spatial and Velocity constraints

In the Continuous Goal Directed Actions (CGDA) framework, actions are modelled as time series which contain the variations of object and environment features. As robot joint trajectories are not explicitly encoded in CGDA, Evolutionary Algorithms (EA) are used for the execution of these actions. These computations usually require a large number of evaluations. As a consequence of this, these evaluations are performed in a simulated environment, and the computed trajectory is then transferred to the physical robot. In this paper, constraints are introduced in the CGDA framework, as a way to reduce the number of evaluations needed by the system to converge to the optimal robot joint trajectory. Specifically, spatial and velocity constraints are introduced in the framework. Their effects in two different CGDA commonly studied use cases (the “wax” and “paint” actions) are analyzed and compared. The experimental results obtained using these constraints are compared with those obtained with the Steady State Tournament (SST) algorithm used in the original proposal of CGDA. Conclusions extracted from this study depict a high reduction in the required number of evaluations when incorporating spatial constraints. Velocity constraints provide however less promising results, which will be discussed within the context of previous CGDA works.

[1]  Kusum Deep,et al.  A self-organizing migrating genetic algorithm for constrained optimization , 2008, Appl. Math. Comput..

[2]  Anthony Chen,et al.  Constraint handling in genetic algorithms using a gradient-based repair method , 2006, Comput. Oper. Res..

[3]  Carlos Balaguer,et al.  Action effect generalization, recognition and execution through Continuous Goal-Directed Actions , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Carlos Balaguer,et al.  Humanoid robot imitation through continuous goal-directed actions: an evolutionary approach , 2015, Adv. Robotics.

[5]  Aude Billard,et al.  On Learning, Representing, and Generalizing a Task in a Humanoid Robot , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Aude Billard,et al.  Recognition and reproduction of gestures using a probabilistic framework combining PCA, ICA and HMM , 2005, ICML.

[7]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[8]  Carlos Balaguer,et al.  Automatic demonstration and feature selection for robot learning , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[9]  James C. Bean,et al.  A Genetic Algorithm for the Multiple-Choice Integer Program , 1997, Oper. Res..

[10]  Jun Nakanishi,et al.  Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors , 2013, Neural Computation.

[11]  Carlos Balaguer,et al.  On using guided motor primitives to execute Continuous Goal-Directed Actions , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[12]  Alan Bundy,et al.  Dynamic Time Warping , 1984 .

[13]  Meinard Müller,et al.  Dynamic Time Warping , 2008 .

[14]  Carlos Balaguer,et al.  TEO: FULL-SIZE HUMANOID ROBOT DESIGN POWERED BY A FUEL CELL SYSTEM , 2012, Cybern. Syst..

[15]  Zbigniew Michalewicz,et al.  Evolutionary optimization of constrained problems , 1994 .

[16]  Nobuo Sannomiya,et al.  An Improvement of Genetic Algorithms by Search Space Reductions in Solving Large-Scale Flowshop Problems (特集 メタヒューリスティクスの理論と応用) , 2001 .

[17]  Keigo Watanabe,et al.  Evolutionary Optimization of Constrained Problems , 2004 .