论文信息 - Neural Networks with Adaptive Learning Rate and Momentum Terms

Neural Networks with Adaptive Learning Rate and Momentum Terms

Keywords: neuron ; learning Reference EPFL-REPORT-82307 URL: http://publications.idiap.ch/downloads/reports/1995/95-04.pdf Record created on 2006-03-10, modified on 2016-08-08

Emile Fiesler | Miguel Moreira | M. Moreira | E. Fiesler

[1] Geoffrey E. Hinton,et al. Learning internal representations by error propagation , 1986 .

[2] D. R. Hush,et al. Improving the learning rate of back-propagation with the gradient reuse algorithm , 1988, IEEE 1988 International Conference on Neural Networks.

[3] Raymond L. Watrous. Learning Algorithms for Connectionist Networks: Applied Gradient Methods of Nonlinear Optimization , 1988 .

[4] L. Steels,et al. Accelerated Learning in Back-propagation Nets , 1989 .

[5] Mark A. Kramer,et al. Improvement of the backpropagation algorithm for training neural networks , 1990 .

[6] Luís B. Almeida,et al. Speeding up Backpropagation , 1990 .

[7] Luís B. Almeida,et al. Acceleration Techniques for the Backpropagation Algorithm , 1990, EURASIP Workshop.

[8] John Moody,et al. Learning rate schedules for faster stochastic gradient search , 1992, Neural Networks for Signal Processing II Proceedings of the 1992 IEEE Workshop.

[9] Ralf Salomon,et al. A new learning scheme for dynamic self-adaptation of learning-relevant parameters , 1992 .

[10] Martin A. Riedmiller,et al. A direct adaptive method for faster backpropagation learning: the RPROP algorithm , 1993, IEEE International Conference on Neural Networks.

[11] Todd K. Leen,et al. Optimal Stochastic Search and Adaptive Momentum , 1993, NIPS.

[12] Shixin Cheng,et al. Dynamic learning rate optimization of the backpropagation algorithm , 1995, IEEE Trans. Neural Networks.