Morphogenic neural networks encode abstract rules by data

The classical McCulloch and Pitts neural unit is widely used today in artificial neural networks (NNs) and essentially acts as a non-linear filter. Classical NN are only capable of approximating a mapping between inputs and outputs in the form of a lookup table or "black box" and the underlying abstract relationships between inputs and outputs remain hidden. Motivated by the need in the study on neural and neurofuzzy architectures, for a more general concept than that of the neural unit, or node, originally introduced by McCulloch and Pitts, we developed in our previous work the concept of themorphogenetic neural (MN) network. In this paper we show that in contrast to the classical NN, the MN network can encode abstract, symbolic expressions that characterize the mapping between inputs and outputs, and thus show the internal structure hidden in the data. Because of the more general nature of the MN, the MN networks are capable of abstraction, data reduction and discovering, often implicit, relationships. Uncertainty can be expressed by a combination of evidence theory, concepts of quantum mechanics and a morphogenetic neural network. With the proposed morphogenetic neural network it is possible to perform both rigorous and approximate computations (i.e. including semantic uncertainty). The internal structure in data can be discovered by identifying "invariants", i.e. by finding (generally implicit) dependencies between variables and parameters in the model.

[1]  Christof Koch,et al.  Computation and the single neuron , 1997, Nature.

[2]  George J. Klir,et al.  Conceptual Foundations Of Quantum Mechanics: The Role Of Evidence Theory, Quantum Sets, And Modal Logic , 1999 .

[3]  Peter L. Balise,et al.  Vector and Tensor Analysis with Applications , 1969 .

[4]  L. Abbott,et al.  A model of multiplicative neural responses in parietal cortex. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[5]  Germano Resconi,et al.  SINGLE NEURON AS A QUANTUM COMPUTER – MORPHOGENETIC NEURON , 2000 .

[6]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[7]  G Brassard,et al.  Quantum computing. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[8]  Gerald M. Edelman,et al.  Dynamic aspects of neocortical function , 1984 .

[9]  Tomaso Poggio,et al.  Models of object recognition , 2000, Nature Neuroscience.

[10]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[11]  Jacob M.J. Murre,et al.  Learning and Categorization in Modular Neural Networks , 1992 .

[12]  Alexandre Pouget,et al.  Computational approaches to sensorimotor transformations , 2000, Nature Neuroscience.

[13]  Shor,et al.  Scheme for reducing decoherence in quantum computer memory. , 1995, Physical review. A, Atomic, molecular, and optical physics.

[14]  K. C. Anderson,et al.  Single neurons in prefrontal cortex encode abstract rules , 2001, Nature.

[15]  G. RESCONP,et al.  A DATA MODEL FOR THE MORPHOGENETIC NEURON , 2000 .

[16]  D. Aharonov Quantum Computation , 1998, quant-ph/9812037.

[17]  L. Abbott,et al.  Invariant visual responses from attentional gain fields. , 1997, Journal of neurophysiology.