Generating-shrinking algorithm for learning arbitrary classification

Abstract This paper proposes a novel generating-shrinking algorithm that builds and then shrinks a three-layer feedforward neural network to achieve arbitrary classification in n-dimensional Euclidean space. The algorithm offers guaranteed convergence to a 100% correct classification rate on training patterns. Decision regions resulting from the algorithm are analytically described, so the generalisation behaviour of the trained network is analytically known. By altering the value of a reference number, the trained neural classifier can achieve scale-invariant generalisation as well as equal-distance generalisation to accommodate different requirements.

[1]  Josef Kittler,et al.  Pattern recognition : a statistical approach , 1982 .

[2]  Rui J. P. de Figueiredo,et al.  Efficient learning procedures for optimal interpolative nets , 1993, Neural Networks.

[3]  A.K. Krishnamurthy,et al.  A comparison of radar signal classifiers , 1990, 1990 IEEE International Conference on Systems Engineering.

[4]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[5]  R. Lippmann,et al.  An introduction to computing with neural nets , 1987, IEEE ASSP Magazine.

[6]  Uwe Krey,et al.  Fast generating algorithm for a general three-layer perceptron , 1992, Neural Networks.

[7]  Thierry Denoeux,et al.  Initializing back propagation networks with prototypes , 1993, Neural Networks.

[8]  John F. Kolen,et al.  Backpropagation is Sensitive to Initial Conditions , 1990, Complex Syst..

[9]  Mario Vento,et al.  Improving character recognition rate by a multi-net neural classifier , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol.II. Conference B: Pattern Recognition Methodology and Systems.

[10]  J. Nadal,et al.  Learning in feedforward layered networks: the tiling algorithm , 1989 .

[11]  Akademii︠a︡ medit︠s︡inskikh nauk Sssr Journal of physics , 1939 .

[12]  X Yang,et al.  Optical implementation of the Hamming net. , 1992, Applied optics.

[13]  C. Hall,et al.  Pitfalls in the application of neural networks for process control , 1992 .

[14]  Zhen-Ping Lo,et al.  Comparison of a neural network and a piecewise linear classifier , 1991, Pattern Recognit. Lett..