Gait synthesis for a biped robot climbing sloping surfaces using neural networks. II. Dynamic learning

For pt.I see ibid., p.2601-6 (1992). A neural network mechanism is proposed to modify the rhythmic motion (gait) of a two-legged robot when walking on sloping surfaces using a sensory input. The robot starts walking on a terrain with no previous knowledge, but accumulates walking experience during walking, thus, constantly improving its walking gait. The proposed network consists of 20 reciprocally inhibited and excited neurons. An unsupervised learning rule was implemented using reinforcement signals. A dynamic learning approach is proposed where the network learns constantly during the walking process. The training is conducted while the robot is in motion. The algorithm was verified by simulation.<<ETX>>

[1]  A. A. Mullin,et al.  Principles of neurodynamics , 1962 .

[2]  Bernard Widrow,et al.  Punish/Reward: Learning with a Critic in Adaptive Threshold Systems , 1973, IEEE Trans. Syst. Man Cybern..

[3]  Richard S. Sutton,et al.  Neuronlike adaptive elements that can solve difficult learning control problems , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[4]  Allen I. Selverston,et al.  Neural mechanisms for the production of cyclic motor patterns , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[5]  M. Mori,et al.  Control method of biped locomotion giving asymptotic stability of trajectory , 1984, at - Automatisierungstechnik.

[6]  H. Hemami,et al.  Modeling of a Neural Pattern Generator with Coupled nonlinear Oscillators , 1987, IEEE Transactions on Biomedical Engineering.

[7]  Yuan F. Zheng.  A neural gait synthesizer for autonomous biped robots , 1990, EEE International Workshop on Intelligent Robots and Systems, Towards a New Frontier of Applications.

[8]  Yuan F. Zheng,et al.  Gait synthesis for the SD-2 biped robot to climb sloping surface , 1990, IEEE Trans. Robotics Autom..

[9]  W. Thomas Miller,et al.  Real-time dynamic control of an industrial manipulator using a neural network-based learning controller , 1990, IEEE Trans. Robotics Autom..