A Neural Network with Evolutionary Neurons

A neural network, combining evolution and learning is introduced. The novel feature of the proposed network is the evolutionary character of its neurons. The argument of the transfer function performed by the neurons in the network is neither a linear nor polynomial function of the inputs to the neuron, but an unknown general function P(·). The adequate functional form P(·) for each neuron, is achieved during the learning period by means of genetic programming. The proposed neural network is applied to the problem domain of time series prediction of the Mackey-Glass delay differential equation. Simulation results indicate that the new neural network is effective.

[1]  David J. Chalmers,et al.  The Evolution of Learning: An Experiment in Genetic Connectionism , 1991 .

[2]  Vidroha Debroy,et al.  Genetic Programming , 1998, Lecture Notes in Computer Science.

[3]  Seong-Whan Lee Off-Line Recognition of Totally Unconstrained Handwritten Numerals Using Multilayer Cluster Neural Network , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Xin Yao,et al.  Evolving artificial neural networks , 1999, Proc. IEEE.

[5]  R. Scott Crowder,et al.  Predicting the Mackey-Glass Timeseries With Cascade-Correlation Learning , 1990 .

[6]  Marcus Frean,et al.  The Upstart Algorithm: A Method for Constructing and Training Feedforward Neural Networks , 1990, Neural Computation.

[7]  H. Kantz,et al.  Nonlinear time series analysis , 1997 .

[8]  L. Glass,et al.  Oscillation and chaos in physiological control systems. , 1977, Science.

[9]  L. Darrell Whitley,et al.  Genetic algorithms and neural networks: optimizing connections and connectivity , 1990, Parallel Comput..

[10]  Larry R. Medsker,et al.  Genetic Algorithms and Neural Networks , 1995 .

[11]  Ron Meir,et al.  Evolving a learning algorithm for the binary perceptron , 1991 .

[12]  Young-Joon Kim,et al.  Off-line recognition of totally unconstrained handwritten numerals using multilayer cluster neural network , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[13]  John E. Moody,et al.  Fast Learning in Multi-Resolution Hierarchies , 1988, NIPS.

[14]  Peter J. Angeline,et al.  An evolutionary algorithm that constructs recurrent neural networks , 1994, IEEE Trans. Neural Networks.

[15]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..