Identification of Support Vector Machines for Runoff Modelling

This paper describes an exploration in using SVM (Support Vector Machine) models, which were initially developed in the Machine Learning community, in flood forecasting, with the focus on the identification of a suitable model structure and its relevant parameters for rainfall runoff modelling. SVM has been applied in many fields and has a high success rate in classification tasks such as pattern recognition, OCR, etc. The applications of SVM in regression of time series are relatively new and they are more problematic in comparison with classifications. This study found that exhaustive search of an optimum model structure and its parameter space is prohibitive due to their sheer size and unknown characteristics. Some parameters are very sensitive and can increase the CPU load tremendously (and hence result in very long computation times). All these make it very difficult to efficiently identify SVM models, which has been carried out by manual operations in all study cases so far. The paper further explored the relationships among various model structures (ξ-SV or ν-SV regression), kernel functions (linear, polynomial, radial basis and sigmoid), scaling factor, model parameters (cost C, epsilon) and composition of input vectors. These relationships should be able to provide useful information for more effective model identification in the future. The unit response curve from SVM was compared with a transfer function model and it is found that a TF model outperforms SVM in short-range predictions. It is still unclear how the unit response curve could be utilised for model identification processes and future exploration in this area is needed.

[1]  Dawei Han,et al.  Flow Modelling Using Reference Vector Machines , 2002 .

[2]  Robert A. Lordo,et al.  Learning from Data: Concepts, Theory, and Methods , 2001, Technometrics.

[3]  Andreas Kroll,et al.  Nonlinear Black Box Modelling – Fuzzy Networks versus Neural Networks , 1999, Neural Computing & Applications.

[4]  A. Soldati,et al.  River flood forecasting with a neural network model , 1999 .

[5]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[6]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[7]  Shie-Yui Liong,et al.  Rainfall and runoff forecasting with SSA-SVM approach , 2001 .

[8]  Dimitri P. Solomatine,et al.  Model Induction with Support Vector Machines: Introduction and Applications , 2001 .

[9]  Dimitri P. Solomatine,et al.  On the encapsulation of numerical-hydraulic models in artificial neural network , 1999 .

[10]  Martin Brown,et al.  Support vector machines for optimal classification and spectral unmixing , 1999 .

[11]  Dustin Boswell,et al.  Introduction to Support Vector Machines , 2002 .

[12]  S. Hajjam.  Real-time flood forecasting model intercomparison and parameter updating rain gauge and weather radar data , 1997 .

[13]  Gail D. Baura,et al.  Nonlinear System Identification , 2002 .

[14]  Dawei Han,et al.  River Flow Modelling using Support Vector Machines , 2001 .

[15]  Nello Cristianini,et al.  Dynamically Adapting Kernels in Support Vector Machines , 1998, NIPS.

[16]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[17]  Konstantine P. Georgakakos,et al.  On improved hydrologic forecasting — Results from a WMO real-time forecasting experiment , 1990 .

[18]  Davide Anguita,et al.  Learning algorithm for nonlinear support vector machines suited for digital VLSI , 1999 .