Gait balance of biped robot based on reinforcement learning

The study on biped walking control using reinforcement learning is presented in this paper. The Q-learning algorithm makes a robot learn to walk without any previous knowledge of dynamics model. The research topic is mainly focused on how the robot keeps balance with one leg. This balance control way that utilized the motion of robot arm and leg to transfer the Zero Moment Point (ZMP) of the robot would maintain the ZMP in a stable state. Hence, the proposed method which integrated this balanced algorithm with the balance control way applied on biped walking on the plain or seesaw, it makes the biped walk more stable. Finally, there are several simulations that demonstrate the feasibility and effectiveness of the proposed learning scheme.

[1]  Tzuu-Hseng S. Li,et al.  Dynamic Balance Control for Biped Robot Walking Using Sensor Fusion, Kalman Filter, and Fuzzy Logic , 2012, IEEE Transactions on Industrial Electronics.

[2]  D Tlalolini,et al.  Human-Like Walking: Optimal Motion of a Bipedal Robot With Toe-Rotation Motion , 2011, IEEE/ASME Transactions on Mechatronics.

[3]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[4]  Jun-Ho Oh,et al.  Biped walking pattern generation using reinforcement learning , 2007, Humanoids.

[5]  S. Nakaura,et al.  Balance control analysis of humanoid robot based on ZMP feedback control , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Shuji Hashimoto,et al.  Balance control of robot and human-robot interaction with haptic sensing foots , 2009, 2009 2nd Conference on Human System Interactions.

[7]  Yuan F. Zheng,et al.  Reinforcement learning for a biped robot to climb sloping surfaces , 1997 .