Adaptive receptive fields for radial basis functions

We propose a network architecture based on adaptive receptive fields and a learning algorithm that combines both supervised learning of centers and unsupervised learning of output layer weights. This algorithm causes each group of radial basis functions to adapt to regions of the clustered input space. Networks produced by this algorithm appear to have better generalization performance on prediction of non-linear input-output mappings than corresponding backpropagation algorithms and requires a fraction of the number of connection weights required by fixed center radial basis. For a test problem of predicting product quality of a reverse osmosis desalination plant, the network learns much faster than a three-layer perceptron trained with back-propagation, but requires additional computational burden.

[1]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[2]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[3]  M. V. Rossum,et al.  In Neural Computation , 2022 .

[4]  Rajesh N. Davé,et al.  Robust clustering methods: a unified view , 1997, IEEE Trans. Fuzzy Syst..

[5]  Richard P. Lippmann,et al.  An introduction to computing with neural nets , 1987 .

[6]  A. Zilouchian,et al.  Intelligent Control Using Artificial Neural Networks and Fuzzy Logic: Recent Trends and Industrial Applications , 1997 .

[7]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[8]  Sanjeev S. Tambe,et al.  Neural networks for the identification of MSF desalination plants , 1995 .

[9]  Thomas G. Dietterich,et al.  Improving the Performance of Radial Basis Function Networks by Learning Center Locations , 1991, NIPS.

[10]  Philip D. Wasserman,et al.  Advanced methods in neural computing , 1993, VNR computer library.

[11]  Petre Stoica,et al.  Decentralized Control , 2018, The Control Systems Handbook.

[12]  A. Zilouchian,et al.  Prediction of products quality parameters of a crude fractionation section of an oil refinery using neural networks , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[13]  Steven J. Nowlan,et al.  Maximum Likelihood Competitive Learning , 1989, NIPS.

[14]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[15]  Donald F. Specht,et al.  A general regression neural network , 1991, IEEE Trans. Neural Networks.

[16]  Bruce A. Whitehead,et al.  Evolving space-filling curves to distribute radial basis functions over an input space , 1994, IEEE Trans. Neural Networks.

[17]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[18]  R. Lippmann,et al.  An introduction to computing with neural nets , 1987, IEEE ASSP Magazine.

[19]  松本 俊之,et al.  Industrial Engineering 実験 , 2004 .

[20]  M. E. El-Hawary Artificial neural networks and possible applications to desalination , 1993 .

[21]  D. Lowe,et al.  Adaptive radial basis function nonlinearities, and the problem of generalisation , 1989 .

[22]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[23]  Azriel Rosenfeld,et al.  Computer vision and image processing , 1992 .