A geometrical representation of McCulloch-Pitts neural model and its applications

In this paper, a geometrical representation of McCulloch-Pitts neural model is presented. From the representation, a clear visual picture and interpretation of the model can be seen. Two interesting applications based on the interpretation are discussed. They are 1) a new design principle of feedforward neural networks and 2) a new proof of mapping abilities of three-layer feedforward neural networks.

[1]  Sukhan Lee,et al.  Multilayer feedforward potential function network , 1988, IEEE 1988 International Conference on Neural Networks.

[2]  Christian Lebiere,et al.  The Cascade-Correlation Learning Architecture , 1989, NIPS.

[3]  Paul W. Cooper,et al.  A Note on an Adaptive Hypersphere Decision Boundary , 1966, IEEE Trans. Electron. Comput..

[4]  Ken-ichi Funahashi,et al.  On the approximate realization of continuous mappings by neural networks , 1989, Neural Networks.

[5]  Eric B. Baum,et al.  Constructing Hidden Units Using Examples and Queries , 1990, NIPS.

[6]  Fred S. Roberts,et al.  Applied Combinatorics , 1984 .

[7]  U. Ramacher,et al.  A geometrical approach to neural network design , 1989, International 1989 Joint Conference on Neural Networks.

[8]  Hecht-Nielsen.  Theory of the backpropagation neural network , 1989 .

[9]  Mark S. Nixon,et al.  Generating-shrinking algorithm for learning arbitrary classification , 1994, Neural Networks.

[10]  Shigeo Abe,et al.  A method for fuzzy rules extraction directly from numerical data and its application to pattern classification , 1995, IEEE Trans. Fuzzy Syst..

[11]  Leon N. Cooper,et al.  An overview of neural networks: early models to real world systems , 1990 .

[12]  Shigeo Abe,et al.  A fuzzy classifier with ellipsoidal regions , 1997, IEEE Trans. Fuzzy Syst..

[13]  Tomaso A. Poggio,et al.  Extensions of a Theory of Networks for Approximation and Learning , 1990, NIPS.

[14]  Somnath Mukhopadhyay,et al.  A Polynomial Time Algorithm for Generating Neural Networks for Pattern Classification: Its Stability Properties and Some Test Results , 1993, Neural Computation.

[15]  Bo Zhang,et al.  Neural Network Based Classifers for a Vast Amount of Data , 1999, PAKDD.

[16]  Yehoshua Y. Zeevi,et al.  Neural networks: theory and applications , 1992 .

[17]  M. Arai.  Mapping abilities of three-layer neural networks , 1989, International 1989 Joint Conference on Neural Networks.

[18]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[19]  M.H. Hassoun,et al.  Fundamentals of Artificial Neural Networks , 1996, Proceedings of the IEEE.

[20]  D. Broomhead,et al.  Radial Basis Functions, Multi-Variable Functional Interpolation and Adaptive Networks , 1988 .

[21]  K. Lang,et al.  Learning to tell two spirals apart , 1988 .

[22]  P. Rujan,et al.  A geometric approach to learning in neural networks , 1989, International 1989 Joint Conference on Neural Networks.

[23]  Mohamad T. Musavi,et al.  On the training of radial basis function classifiers , 1992, Neural Networks.