论文信息 - Noise robustness in multilayer neural networks

Noise robustness in multilayer neural networks

The training of multilayered neural networks in the presence of different types of noise is studied. We consider the learning of realizable rules in nonoverlapping architectures. Achieving optimal generalization depends on the knowledge of the noise level, however its misestimation may lead to partial or complete loss of the generalization ability. We demonstrate this effect in the framework of online learning and present the results in terms of noise robustness phase diagrams. While for additive (weight) noise the robustness properties depend on the architecture and size of the networks, this is not so for multiplicative (output) noise. In this case we find a universal behaviour independent of the machine size for both the tree parity and committee machines.

[1] Anders Krogh,et al. Introduction to the theory of neural computation , 1994, The advanced book program.

[2] Richard A. Askey,et al. The q-harmonic oscillator and an analogue of the Charlier polynomials , 1993 .

[3] R. Palmer,et al. Introduction to the theory of neural computation , 1994, The advanced book program.

[4] David Haussler,et al. Proceedings of the fifth annual workshop on Computational learning theory , 1992, COLT 1992.

[5] Umesh V. Vazirani,et al. An Introduction to Computational Learning Theory , 1994 .

[6] Leslie Valiant,et al. Proceedings of the Fourth Annual Workshop on Computational Learning Theory, University of California, Santa Cruz, August 5-7, 1991 , 1991 .