Speeding-up adaptive heuristic critic learning with FPGA-based unsupervised clustering

Neurocontrol is a crucial area of fundamental research within the neural network field. Adaptive heuristic critic learning is a key algorithm for real-time adaptation in neurocontrollers. In this paper, we show how an unsupervised neural network model with an adaptable structure can be used to speed-up adaptive heuristic critic learning, present its FPGA design, and show how it adapts the neurocontroller to the state space of the system being controlled.

[1]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[2]  Bernd Fritzke.  Growing Cell Structures – a Self-organizing Network in k Dimensions , 1992 .

[3]  Chin-Teng Lin,et al.  Reinforcement learning for an ART-based fuzzy adaptive learning control network , 1996, IEEE Trans. Neural Networks.

[4]  Marco Tomassini,et al.  Phylogeny, Ontogeny, and Epigenesis: Three Sources of Biological Inspiration for Softening Hardware , 1996, ICES.

[5]  J. M. Aróstegui.  Vlsi architectures for evolutive neural models , 1995 .

[6]  E. Sanchez,et al.  Neural Network Structure Optimization through On-line Hardware Evolution , 1996 .

[7]  Andrés Pérez-Uribe,et al.  FPGA Implementation of an Adaptable-Size Neural Network , 1996, ICANN.

[8]  Paul J. Werbos,et al.  The Roots of Backpropagation: From Ordered Derivatives to Neural Networks and Political Forecasting , 1994 .

[9]  A. I. Ethem Alpaydin.  Neural models of incremental supervised and unsupervised learning , 1990 .

[10]  Marcus Frean,et al.  The Upstart Algorithm: A Method for Constructing and Training Feedforward Neural Networks , 1990, Neural Computation.

[11]  Eduardo Sanchez,et al.  A platform for co-design and co-synthesis based on FPGA , 1996, Proceedings Seventh IEEE International Workshop on Rapid System Prototyping. Shortening the Path from Specification to Prototype.

[12]  Vasant Honavar,et al.  Evolutionary Design of Neural Architectures -- A Preliminary Taxonomy and Guide to Literature , 1995 .

[13]  Richard S. Sutton,et al.  Neuronlike adaptive elements that can solve difficult learning control problems , 1983, IEEE Transactions on Systems, Man, and Cybernetics.