Solving two-spiral problem through input data representation

This paper studies the effect of input data representation on the performance of backpropagation neural network in solving a highly nonlinear two-spiral problem. Several popularly used data encoding schemes and a proposed encoding scheme were examined. It was found that input data encoding affects a neural network's ability in extracting features from the raw data and therefore the network training time and generalisation property. Using a proper input encoding approach, the two-spiral problem can be solved with a standard backpropagation neural network.

[1]  Jiancheng Jia,et al.  Neural network encoding approach comparison: an empirical study , 1993, Proceedings 1993 The First New Zealand International Two-Stream Conference on Artificial Neural Networks and Expert Systems.

[2]  Eric B. Baum,et al.  Constructing Hidden Units Using Examples and Queries , 1990, NIPS.

[3]  K. Lang,et al.  Learning to tell two spirals apart , 1988 .

[4]  Thierry Denoeux,et al.  Initializing back propagation networks with prototypes , 1993, Neural Networks.

[5]  Christian Lebiere,et al.  The Cascade-Correlation Learning Architecture , 1989, NIPS.

[6]  J. C. Jia,et al.  Distributed normalisation input coding to speed up training process of BP-neural network classifier , 1995 .