Automatic Design of Artificial Neural Networks and Associative Memories for Pattern Classification and Pattern Restoration

In this note we present our most recent advances in the automatic design of artificial neural networks (ANNs) and associative memories (AMs) for pattern classification and pattern recall. Particle Swarm Optimization (PSO), Differential Evolution (DE), and Artificial Bee Colony (ABC) algorithms are used for ANNs; Genetic Programming is adopted for AMs. The derived ANNs and AMs are tested with several examples of well-known databases. As we will show, results are very promising.

[1]  P. Nordin.  Genetic Programming III - Darwinian Invention and Problem Solving , 1999 .

[2]  Xin Yao,et al.  Evolutionary Artificial Neural Networks , 1993, Int. J. Neural Syst..

[3]  Juan Humberto Sossa Azuela,et al.  Automatic Synthesis of Associative Memories through Genetic Programming: A First Co-evolutionary Approach , 2010, EvoApplications.

[4]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[5]  Jack Belzer,et al.  Encyclopedia of Computer Science and Technology , 2002 .

[6]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[7]  John R. Koza,et al.  Genetic Programming III: Darwinian Invention & Problem Solving , 1999 .

[8]  Beatriz A. Garro,et al.  Back-Propagation vs Particle Swarm Optimization Algorithm: which Algorithm is better to adjust the Synaptic Weights of a Feed-Forward ANN? , 2011 .

[9]  Raúl Rojas,et al.  Neural Networks - A Systematic Introduction , 1996 .

[10]  Peter Sussner,et al.  Morphological associative memories , 1998, IEEE Trans. Neural Networks.

[11]  Teuvo Kohonen,et al.  Correlation Matrix Memories , 1972, IEEE Transactions on Computers.

[12]  G. Isac.  Models and applications , 1992 .

[13]  Juan Humberto Sossa Azuela,et al.  Artificial neural network synthesis by means of artificial bee colony (ABC) algorithm , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[14]  Karl Steinbuch,et al.  Die Lernmatrix , 2004, Kybernetik.

[15]  Patrick van der Smagt,et al.  Introduction to neural networks , 1995, The Lancet.

[16]  Juan Humberto Sossa Azuela,et al.  Evolutionary Associative Memories through Genetic Programming , 2011, Parallel Architectures and Bioinspired Algorithms.

[17]  John R. Koza,et al.  Genetic programming: a paradigm for genetically breeding populations of computer programs to solve problems , 1990 .

[18]  Xin Yao,et al.  A review of evolutionary artificial neural networks , 1993, Int. J. Intell. Syst..

[19]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[20]  John R. Koza,et al.  Genetic programming 2 - automatic discovery of reusable programs , 1994, Complex Adaptive Systems.

[21]  Juan Humberto Sossa Azuela,et al.  Evolving Neural Networks: A Comparison between Differential Evolution and Particle Swarm Optimization , 2011, ICSI.

[22]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[23]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[24]  N. Rashevsky.  The mathematical biophysics of some mental phenomena , 1945 .

[25]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[26]  Juan Humberto Sossa Azuela,et al.  Design of Artificial Neural Networks Using Differential Evolution Algorithm , 2010, ICONIP.

[27]  Juan Humberto Sossa Azuela,et al.  Design of artificial neural networks using a modified Particle Swarm Optimization algorithm , 2009, 2009 International Joint Conference on Neural Networks.

[28]  John R. Koza,et al.  Genetic Programming III - Darwinian Invention and Problem Solving , 1999, Evolutionary Computation.

[29]  James A. Anderson,et al.  A simple neural network generating an interactive memory , 1972 .

[30]  Raúl Rojas,et al.  The Backpropagation Algorithm , 1996 .