Improving a Network Generalization Ability by Selecting Examples

We show that the generalization ability of simple Perceptron-like devices is strongly enhanced by allowing the network itself to select the training examples. Analytic and numerical results are obtained for the Hebb and for the optimal Perceptron learning rule, respectively.