Gait Synthesis and Sensory Control of Stair Climbing for a Humanoid Robot

Stable and robust walking in various environments is one of the most important abilities for a humanoid robot. This paper addresses walking pattern synthesis and sensory feedback control for humanoid stair climbing. The proposed stair-climbing gait is formulated to satisfy the environmental constraint, the kinematic constraint, and the stability constraint; the selection of the gait parameters is formulated as a constrained nonlinear optimization problem. The sensory feedback controller is phase dependent and consists of the torso attitude controller, zero moment point compensator, and impact reducer. The online learning scheme of the proposed feedback controller is based on a policy gradient reinforcement learning method, and the learned controller is robust against external disturbance. The effectiveness of our proposed method was confirmed by walking experiments on a 32-degree-of-freedom humanoid robot.

[1]  M. Vukobratovic,et al.  Contribution to the Synthesis of Biped Gait , 1968 .

[2]  G. Jones,et al.  Observations on the control of stepping and hopping movements in man , 1971, The Journal of physiology.

[3]  G. Jones,et al.  Muscular control of landing from unexpected falls in man , 1971, The Journal of physiology.

[4]  Andrew L. Kun,et al.  Adaptive dynamic balance of a biped robot using neural networks , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[5]  Shigenobu Kobayashi,et al.  Reinforcement learning for continuous action using stochastic gradient ascent , 1998 .

[6]  Jerry E. Pratt,et al.  Adaptive dynamic control of a bipedal walking robot with radial basis function neural networks , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[7]  T. Takenaka,et al.  The development of Honda humanoid robot , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[8]  Shin Ishii,et al.  Reinforcement Learning Based on On-Line EM Algorithm , 1998, NIPS.

[9]  Ching-Long Shih,et al.  Ascending and descending stairs for a biped robot , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[10]  Kazuhito Yokoi,et al.  Planning walking patterns for a biped robot , 2001, IEEE Trans. Robotics Autom..

[11]  K. Newell,et al.  Dimensional change in motor learning. , 2001, Human movement science.

[12]  Kazuhito Yokoi,et al.  The 3D linear inverted pendulum mode: a simple modeling for a biped walking pattern generation , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[13]  Control system design of THBIP-I humanoid robot , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[14]  M. Ceccarelli,et al.  Descending stairs with EP-WAR3 biped robot , 2003, Proceedings 2003 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM 2003).

[15]  Leonard Barolli,et al.  Real time gait generation for autonomous humanoid robots: A case study for walking , 2003, Robotics Auton. Syst..

[16]  Friedrich Pfeiffer,et al.  Sensors and control concept of a biped robot , 2004, IEEE Transactions on Industrial Electronics.

[17]  Kouhei Ohnishi,et al.  Collision Avoidance Method of Humanoid Robot With Arm Force , 2004, IEEE Transactions on Industrial Electronics.

[18]  Fumio Kanehiro,et al.  Humanoid robot HRP-2 , 2008, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[19]  Atsuo Takanishi,et al.  Walking up and down stairs carrying a human by a biped locomotor with parallel mechanism , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  K. Ohnishi,et al.  Real-time gait planning for pushing motion of humanoid robot , 2005, 31st Annual Conference of IEEE Industrial Electronics Society, 2005. IECON 2005..

[21]  Kok Kiong Tan,et al.  Task-oriented developmental learning for humanoid robots , 2005, IEEE Transactions on Industrial Electronics.

[22]  Qiang Huang,et al.  Sensory reflex control for humanoid walking , 2005, IEEE Transactions on Robotics.

[23]  Shin Ishii,et al.  Reinforcement learning for quasi-passive dynamic walking of an unstable biped robot , 2006, Robotics Auton. Syst..

[24]  Ken Chen,et al.  Planning and Control for THBIP-I Humanoid Robot , 2006, 2006 International Conference on Mechatronics and Automation.