Searching for a solution to the automatic RBF network design problem

While amazing applications have been demonstrated in di+erent science and engineering ,elds using neural networks and evolutionary approaches, one of the key elements of their further acceptance and proliferation is the study and provision of procedures for the automatic design of neural architectures and associated learning methods, i.e., in general, the study of the systematic and automatic design of arti,cial brains. In this contribution, connections between conventional techniques of pattern recognition, evolutionary approaches, and newer results from computational and statistical learning theory are brought together in the context of the automatic design of RBF regression networks. c 2002 Elsevier Science B.V. All rights reserved.

[1]  Carl G. Looney,et al.  Pattern recognition using neural networks: theory and algorithms for engineers and scientists , 1997 .

[2]  Bruce A. Whitehead,et al.  Cooperative-competitive genetic evolution of radial basis function centers and widths for time series prediction , 1996, IEEE Trans. Neural Networks.

[3]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[4]  F. Girosi,et al.  Networks for approximation and learning , 1990, Proc. IEEE.

[5]  Sankar K. Pal,et al.  Neuro-Fuzzy Pattern Recognition , 1999 .

[6]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[7]  Federico Girosi,et al.  Regularization Theory, Radial Basis Functions and Networks , 1994 .

[8]  Robert J. Schalkoff,et al.  Pattern recognition - statistical, structural and neural approaches , 1991 .

[9]  Xin Yao,et al.  Evolving artificial neural networks , 1999, Proc. IEEE.

[10]  Brian D. Ripley,et al.  Pattern Recognition and Neural Networks , 1996 .

[11]  Hugo de Garis.  Special issue on Evolutionary Neural Systems , 2002, Neurocomputing.

[12]  Bernhard Schölkopf,et al.  Shrinking the Tube: A New Support Vector Regression Algorithm , 1998, NIPS.

[13]  Byoung-Tak Zhang,et al.  Synthesis of sigma-pi neural networks by the breeder genetic programming , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[14]  Albert Nigrin,et al.  Neural networks for pattern recognition , 1993 .

[15]  I. Guyon,et al.  Advances in pattern recognition systems using neural network technologies , 1994 .

[16]  Leslie G. Valiant,et al.  A theory of the learnable , 1984, STOC '84.

[17]  Harry Wechsler,et al.  From Statistics to Neural Networks: Theory and Pattern Recognition Applications , 1996 .

[18]  F. Girosi.  Some extensions of radial basis functions and their applications in artificial intelligence , 1992 .

[19]  Frédéric Gruau,et al.  Genetic synthesis of Boolean neural networks with a cell rewriting developmental process , 1992, [Proceedings] COGANN-92: International Workshop on Combinations of Genetic Algorithms and Neural Networks.

[20]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[21]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[22]  H. de Garis.  Implementation and performance-scaling issues concerning the genetic programming of a cellular automata based artificial brain , 1994 .

[23]  Colin Campbell,et al.  An introduction to kernel methods , 2001 .

[24]  Petri A. Jokinen,et al.  A nonlinear learning network model for continuous , 2003 .

[25]  I C G Campbell,et al.  Radial Basis Function Networks: Design and Applications , 2000 .

[26]  Hans-Paul Schwefel,et al.  Evolution and optimum seeking , 1995, Sixth-generation computer technology series.

[27]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[28]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[29]  Ludmila I. Kuncheva,et al.  Initializing of an RBF network by a genetic algorithm , 1997, Neurocomputing.

[30]  David B. Fogel,et al.  Evolutionary Computation: Towards a New Philosophy of Machine Intelligence , 1995 .

[31]  Stephen A. Billings,et al.  Radial basis function network configuration using genetic algorithms , 1995, Neural Networks.

[32]  Alexander J. Smola,et al.  Support Vector Regression Machines , 1996, NIPS.

[33]  David Haussler,et al.  Decision Theoretic Generalizations of the PAC Model for Neural Net and Other Learning Applications , 1992, Inf. Comput..

[34]  Yoh-Han Pao,et al.  Adaptive pattern recognition and neural networks , 1989 .

[35]  Sankar K. Pal,et al.  Neuro-Fuzzy Pattern Recognition: Methods in Soft Computing , 1999 .

[36]  Anna Esposito,et al.  Approximation of continuous and discontinuous mappings by a growing neural RBF-based algorithm , 2000, Neural Networks.

[37]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[39]  Jooyoung Park,et al.  Approximation and Radial-Basis-Function Networks , 1993, Neural Computation.

[40]  Thomas Bäck,et al.  Evolutionary computation: comments on the history and current state , 1997, IEEE Trans. Evol. Comput..

[41]  V A David Sánchez.  On the design of a class of neural networks , 1996 .

[42]  N. Sundararajan,et al.  Radial Basis Function Neural Networks with Sequential Learning , 1999 .

[43]  Alexander J. Smola,et al.  Support Vector Method for Function Approximation, Regression Estimation and Signal Processing , 1996, NIPS.

[44]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[45]  John R. Koza,et al.  Genetic generation of both the weights and architecture for a neural network , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[46]  Richard J. Mammone,et al.  Artificial neural networks for speech and vision , 1994 .

[47]  Sankar K. Pal,et al.  Genetic Algorithms for Pattern Recognition , 2017 .

[48]  Seongwon Cho,et al.  Self-organizing map with time-invariant learning rate and its exponential stability analysis , 1998, Neurocomputing.

[49]  Bruce A. Whitehead,et al.  Genetic evolution of radial basis function coverage using orthogonal niches , 1996, IEEE Trans. Neural Networks.

[50]  James M. Keller,et al.  Fuzzy Models and Algorithms for Pattern Recognition and Image Processing , 1999 .

[51]  John C. Platt.  A Resource-Allocating Network for Function Interpolation , 1991, Neural Computation.

[52]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[53]  Sankar K. Pal,et al.  Pattern Recognition: From Classical to Modern Approaches , 2001 .

[54]  Vladimir Vapnik,et al.  The Nature of Statistical Learning , 1995 .

[55]  Jacek M. Zurada,et al.  Introduction to artificial neural systems , 1992 .

[56]  Federico Girosi,et al.  On the Relationship between Generalization Error, Hypothesis Complexity, and Sample Complexity for Radial Basis Functions , 1996, Neural Computation.

[57]  David S. Broomhead,et al.  Multivariable Functional Interpolation and Adaptive Networks , 1988, Complex Syst..

[58]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[59]  Abraham Kandel,et al.  Introduction to Pattern Recognition: Statistical, Structural, Neural and Fuzzy Logic Approaches , 1999 .