Multilayer perceptron and neural networks

The attempts for solving linear inseparable problems have led to different variations on the number of layers of neurons and activation functions used. The backpropagation algorithm is the most known and used supervised learning algorithm. Also called the generalized delta algorithm because it expands the training way of the adaline network, it is based on minimizing the difference between the desired output and the actual output, through the downward gradient method (the gradient tells us how a function varies in different directions). Training a multilayer perceptron is often quite slow, requiring thousands or tens of thousands of epochs for complex problems. The best known methods to accelerate learning are: the momentum method and applying a variable learning rate. The paper presents the possibility to control the induction driving using neural systems.

[1]  Michael Negnevitsky,et al.  Artificial Intelligence: A Guide to Intelligent Systems , 2001 .

[2]  Mihai Horia Zaharia,et al.  Load Balancing in Distributed Systems using Cognitive Behavioral Models , 2004 .

[3]  Nikos E. Mastorakis,et al.  Equilibrium dynamic systems intelligence , 2009 .

[4]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1989, Math. Control. Signals Syst..

[5]  Nikos E. Mastorakis,et al.  Equilibrium dynamic systems integration , 2009 .

[6]  Arthur E. Bryson,et al.  Applied Optimal Control , 1969 .

[7]  Jose C. Principe,et al.  Neural and Adaptive Systems: Fundamentals through Simulations with CD-ROM , 1999 .

[8]  V. Kvasnicka,et al.  Neural and Adaptive Systems: Fundamentals Through Simulations , 2001, IEEE Trans. Neural Networks.

[9]  Marius-Constantin Popescu,et al.  Fuzzy control algorithm implementation using LabWindows , 2009 .

[10]  Luís B. Almeida,et al.  Acceleration Techniques for the Backpropagation Algorithm , 1990, EURASIP Workshop.

[11]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[12]  Silvia Curteanu,et al.  GENETIC ALGORITHMS AND NEURAL NETWORKS USED IN OPTIMIZATION OF A RADICAL POLYMERIZATION PROCESS , 2003 .

[13]  NIKOS MASTORAKIS,et al.  The Backpropagation Algorithm Functions for the Multilayer Perceptron , 2009 .

[14]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[15]  Jose C. Principe,et al.  Neural and adaptive systems , 2000 .

[16]  Paul J. Werbos,et al.  The roots of backpropagation , 1994 .

[17]  Geoffrey E. Hinton,et al.  Learning representations by back-propagation errors, nature , 1986 .