A constructive algorithm for binary neural networks: the oil-spot algorithm

This paper presents a constructive training algorithm for supervised neural networks. The algorithm relies on a topological approach, based on the representation of the mapping of interest onto the binary hypercube of the input space. It dynamically constructs a two-layer neural network by involving successively binary examples. A convenient treatment of real-valued data is possible by means of a suitable real-to-binary codification. In the case of target functions that have efficient halfspace union representations, simulations show the constructed networks result optimized in terms of number of neurons.

[1]  M. Reza Emamy-Khansary.  On the cuts and cut number of the 4-cube , 1986, J. Comb. Theory, Ser. A.

[2]  K. Lang,et al.  Learning to tell two spirals apart , 1988 .

[3]  Jean-Pierre Nadal,et al.  Study of a Growth Algorithm for a Feedforward Network , 1989, Int. J. Neural Syst..

[4]  J. Nadal,et al.  Learning in feedforward layered networks: the tiling algorithm , 1989 .

[5]  M. Golea,et al.  A Convergence Theorem for Sequential Learning in Two-Layer Perceptrons , 1990 .

[6]  Eric B. Baum,et al.  Constructing Hidden Units Using Examples and Queries , 1990, NIPS.

[7]  ERIC B. BAUM,et al.  On learning a union of half spaces , 1990, J. Complex..

[8]  G. J. Gibson,et al.  On the decision regions of multilayer perceptrons , 1990, Proc. IEEE.

[9]  M. Golea,et al.  A Growth Algorithm for Neural Network Decision Trees , 1990 .

[10]  L. P. Ricotti,et al.  A pyramidal delayed perceptron , 1990 .

[11]  Marcus Frean,et al.  The Upstart Algorithm: A Method for Constructing and Training Feedforward Neural Networks , 1990, Neural Computation.

[12]  G. Barkema,et al.  A Fast Partitioning Algorithm and a Comparison of Binary Feedforward Neural Networks , 1992 .

[13]  Anthony N. Michel,et al.  A training algorithm for binary feedforward neural networks , 1992, IEEE Trans. Neural Networks.

[14]  Mario Marchand,et al.  On learning simple neural concepts: from halfspace intersections to neural decision lists , 1993 .

[15]  Fabio Massimo Frattale Mascioli,et al.  Cascade neural network for binary mapping , 1993, IEEE Trans. Neural Networks.