Learning to Use Toes in a Humanoid Robot

In this paper we show that a model-free approach to learn behaviors in joint space can be successfully used to utilize toes of a humanoid robot. Keeping the approach model-free makes it applicable to any kind of humanoid robot, or robot in general. Here we focus on the benefit on robots with toes which is otherwise more difficult to exploit. The task has been to learn different kick behaviors on simulated Nao robots with toes in the RoboCup 3D soccer simulator. As a result, the robot learned to step on its toe for a kick that performs 30% better than learning the same kick without toes.

[1]  Sven Behnke,et al.  Human-Like Walking using Toes Joint and Straight Stance Leg , 2005 .

[2]  Markus Rollmann.  Spark-a generic simulator , 2004 .

[3]  Petros Koumoutsakos,et al.  Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES) , 2003, Evolutionary Computation.

[4]  Heinz Ulbrich,et al.  The Biped Walking Robot Lola -- Hardware Design and Walking Control -- , 2012 .

[5]  Atsuo Takanishi,et al.  Human-like walking with knee stretched, heel-contact and toe-off motion by a humanoid robot , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Masayuki Inaba,et al.  Toe joints that enhance bipedal and fullbody motion of humanoid robots , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[7]  Nicolas Jouandeau,et al.  Optimization of parametrised kicking motion for humanoid soccer player , 2014, 2014 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC).

[8]  Aaron D. Ames,et al.  Realizing dynamic and efficient bipedal locomotion on the humanoid robot DURUS , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Luís Paulo Reis,et al.  Learning a Humanoid Kick with Controlled Distance , 2016, RoboCup.

[10]  M. Kumagai,et al.  Sensor-based walking of human type biped robot that has 14 degree of freedoms , 1997, Proceedings Fourth Annual Conference on Mechatronics and Machine Vision in Practice.

[11]  Thomas Buschmann,et al.  Simulation and Control of Biped Walking Robots , 2010 .

[12]  Pierre-Yves Oudeyer,et al.  The poppy humanoid robot: Leg design for biped locomotion , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Olivier Stasse,et al.  Faster and Smoother Walking of Humanoid HRP-2 with Passive Toe Joints , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Heinz Ulbrich,et al.  The Biped Walking Robot Lola , 2012 .

[15]  Patrick MacAlpine,et al.  UT Austin Villa 2014: RoboCup 3D Simulation League Champion via Overlapping Layered Learning , 2015, AAAI.

[16]  Ryosuke Tajima,et al.  Fast running experiments involving a humanoid robot , 2009, 2009 IEEE International Conference on Robotics and Automation.