Autonomous online learning of velocity kinematics on the iCub: A comparative study

In the last years, several regression algorithms have been proposed to learn accurate mechanical models of robots. Comparisons are proposed at the conceptual level or through the use of recorded databases, but they deliver limited conclusions with respect to the real performance of these algorithms in their true context of use, i.e. online learning on the real robot interacting with its environment, within a feedback control loop. In this paper, we provide an empirical study of three state-of-the-art regression methods through online learning on the iCub robot holding a tool. We show that they can effectively learn a visuo-motor kinematic model for a simple visual servoing task in a very limited time (few minutes), without making any a priori hypothesis on the geometry of the robot and its tool. Furthermore, we can draw from the results some stronger conclusions about the comparison of the algorithms than previous studies based on databases.

[1]  Giorgio Metta,et al.  Incremental learning of robot dynamics using random features , 2011, 2011 IEEE International Conference on Robotics and Automation.

[2]  Jan Peters,et al.  Using model knowledge for learning inverse dynamics , 2010, 2010 IEEE International Conference on Robotics and Automation.

[3]  Jun Nakanishi,et al.  Operational Space Control: A Theoretical and Empirical Comparison , 2008, Int. J. Robotics Res..

[4]  Olivier Sigaud,et al.  From Motor Learning to Interaction Learning in Robots , 2010, From Motor Learning to Interaction Learning in Robots.

[5]  Giulio Sandini,et al.  The iCub Platform: A Tool for Studying Intrinsically Motivated Learning , 2013, Intrinsically Motivated Learning in Natural and Artificial Systems.

[6]  Giulio Sandini,et al.  Stochastic optimal control with variable impedance manipulators in presence of uncertainties and delayed feedback , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Olivier Sigaud,et al.  On-line regression algorithms for learning mechanical models of robots: A survey , 2011, Robotics Auton. Syst..

[8]  Olivier Sigaud,et al.  Learning the velocity kinematics of ICUB for model-based control: XCSF versus LWPR , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[9]  Jon Rigelsford,et al.  Modelling and Control of Robot Manipulators , 2000 .

[10]  S. Chiaverini,et al.  Achieving user-defined accuracy with damped least-squares inverse kinematics , 1991, Fifth International Conference on Advanced Robotics 'Robots in Unstructured Environments.

[11]  Stewart W. Wilson Function approximation with a classifier system , 2001 .

[12]  Giulio Sandini,et al.  Computing robot internal/external wrenches by means of inertial, tactile and F/T sensors: Theory and implementation on the iCub , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[13]  Martin V. Butz,et al.  Function Approximation With XCS: Hyperellipsoidal Conditions, Recursive Least Squares, and Compaction , 2008, IEEE Transactions on Evolutionary Computation.

[14]  Marco Mirolli,et al.  Intrinsically Motivated Learning in Natural and Artificial Systems , 2013 .

[15]  Alejandro Hernández Arieta,et al.  Body Schema in Robotics: A Review , 2010, IEEE Transactions on Autonomous Mental Development.

[16]  Dana Kulic,et al.  Online Incremental Learning of Inverse Dynamics Incorporating Prior Knowledge , 2011, AIS.

[17]  N. Berthier,et al.  Proximodistal structure of early reaching in human infants , 1999, Experimental Brain Research.

[18]  H. Wold Soft Modelling by Latent Variables: The Non-Linear Iterative Partial Least Squares (NIPALS) Approach , 1975, Journal of Applied Probability.

[19]  Pierre-Yves Oudeyer,et al.  Intrinsically motivated goal exploration for active motor learning in robots: A case study , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  G. Metta,et al.  Learning precise 3D reaching in a humanoid robot , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[21]  Jan Peters,et al.  Model learning for robot control: a survey , 2011, Cognitive Processing.

[22]  Stefan Schaal,et al.  Locally Weighted Projection Regression : An O(n) Algorithm for Incremental Real Time Learning in High Dimensional Space , 2000 .

[23]  Jan Peters,et al.  Learning tracking control with forward models , 2012, 2012 IEEE International Conference on Robotics and Automation.

[24]  Martin V. Butz,et al.  Learning velocity kinematics: Experimental comparison of on-line regression algorithms , 2012 .