Investigating redundancy in feed-forward neural classifiers

Abstract In this article we will focus on how we can investigate (read visualise) the clustering behaviour of neurons during training. This clustering property has already been investigated before, by Annema, Vogtlander and Schmidt. However, we will present a different approach in visualisation illustrated by experiments performed on two-class problems.

[1]  Robert P. W. Duin,et al.  On the nonlinearity of pattern classifiers , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[2]  Anil K. Jain,et al.  A non-linear projection method based on Kohonen's topology preserving maps , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol.II. Conference B: Pattern Recognition Methodology and Systems.

[3]  Anne-Johan Annema,et al.  Precision requirements for single-layer feedforward neural networks , 1994, Proceedings of the Fourth International Conference on Microelectronics for Neural Networks and Fuzzy Systems.

[4]  Teuvo Kohonen,et al.  Self-organization and associative memory: 3rd edition , 1989 .

[5]  Anne J. Annema Analysis, Modelling and Implementation of Analog Integrated Neural Networks , 1994 .