Modelling of river discharges and rainfall using radial basis function networks based on support vector regression

Associative memory networks (AMNs) based on radial basis functions (RBFs) are often used to model complex and nonlinear systems, as they can approximate nonlinear systems with arbitrary accuracy and can be trained from data. However, good generalization results can only be obtained if the structure of the RBF network is suitably chosen. An approach to select the structure of the RBF networks based on the support vectors (SVs) of the support vector machine (SVM) has been proposed. The main advantage of this approach is that the structure of the network can be obtained objectively, as the SVs of the SVM are obtained from a constrained optimization for a given error bound. For convenience, this class of AMNs is referred to as support vector radial basis function networks (SVRBFNs). In this paper, the modelling of the relationship between rainfall and river discharges of the Fuji river using the SVRBFN is presented. As there are large outliers in the modelling errors arising from the data collection process, they are removed first before retraining the SVRBFN using the adjusted data, in order to obtain a better approximation of the relationship between rainfall and river discharges. The generalization ability of the SVRBFN is verified using the test data that are the most recent not used in the training of the network. The prediction of river discharges for given rainfalls can be computed from the SVRBFN, which can provide early warning of severe river discharges when there is heavy and prolonged rainfall.

[1]  R. Ibbitt,et al.  Catalogue of rivers for Southeast Asia and the Pacific , 1995 .

[2]  Sheng Chen,et al.  Non-linear systems identification using radial basis functions , 1990 .

[3]  Kevin Warwick,et al.  Mean-tracking clustering algorithm for radial basis function centre selection , 1997 .

[4]  Xia Hong,et al.  Adaptive Modelling, Estimation and Fusion from Data , 2002, Advanced Information Processing.

[5]  Martin Brown,et al.  Neurofuzzy adaptive modelling and control , 1994 .

[6]  E. Mizutani,et al.  Neuro-Fuzzy and Soft Computing-A Computational Approach to Learning and Machine Intelligence [Book Review] , 1997, IEEE Transactions on Automatic Control.

[7]  W. Light,et al.  Wavelets, subdivision algorithms, and radial basis functions , 1992 .

[8]  S. Billings,et al.  Givens rotation based fast backward elimination algorithm for RBF neural network pruning , 1997 .

[9]  Christopher J. Harris,et al.  Structure selection of neurofuzzy networks based on support vector regression , 2002, Int. J. Syst. Sci..

[10]  M. G. Anderson,et al.  DATA-BASED MECHANISTIC MODELLING AND VALIDATION OF RAINFALL-FLOW PROCESSES , 2001 .

[11]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[12]  C.J.H. Mann,et al.  Adaptive Modelling Estimation and Fusion from Data: A Neurofuzzy Approach , 2003 .

[13]  Peter Young,et al.  Data-based Mechanistic Modelling and Validation of Rainfall-flow Processes , 2001 .

[14]  Stephen A. Billings,et al.  International Journal of Control , 2004 .

[15]  Vladimir Naumovich Vapni The Nature of Statistical Learning Theory , 1995 .

[16]  P. Caines Linear Stochastic Systems , 1988 .

[17]  Alan Solon Ivor Zinober,et al.  Sliding mode state observers for discrete-time linear systems , 2002, Int. J. Syst. Sci..

[18]  Dimitri P. Bertsekas,et al.  Constrained Optimization and Lagrange Multiplier Methods , 1982 .

[19]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[20]  Bernhard Schölkopf,et al.  Comparing support vector machines with Gaussian kernels to radial basis function classifiers , 1997, IEEE Trans. Signal Process..

[21]  P. Young,et al.  Recent advances in the data-based modelling and analysis of hydrological systems , 1997 .

[22]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[23]  Chris J. Harris,et al.  On the modelling of nonlinear dynamic systems using support vector neural networks , 2001 .

[24]  D. P. Gregg,et al.  Forecasting.@@@Practical Experiences with Modelling and Forecasting Time Series. , 1981 .

[25]  G. M. Jenkins,et al.  Practical Experiences with Modelling and Forecasting Time Series. , 1980 .

[26]  Xia Hong,et al.  Adaptive Modelling, Estimation and Fusion from Data: A Neurofuzzy Approach , 2002, Advanced information processing.

[27]  Stephen A. Billings,et al.  Time series prediction using support vector machines, the orthogonal and the regularized orthogonal least-squares algorithms , 2002, Int. J. Syst. Sci..