Time Series Prediction Using Robust Radial Basis Function with Two-Stage Learning Rule

The radial basis function neural network (RBFNN) is a well known method for many kinds of application, including function approximation, classification, and prediction. However, the traditional RBFNN is not robust for the training data which contains outliers. In this paper, we propose a two-stage learning rule for RBFNN to eliminate the influence of outliers. The concept of the Chebyshev theorem for detecting outlier is adopted to filter out the potential outliers in the first stage, and the M-estimator is used for dealing with the insignificant outliers in the second stage. The experimental results show that the proposed method can reduce the prediction error compared with other methods. Furthermore, even though fifty percent of all observations are the outliers this method still has a good performance.

[1]  Leo H. Chiang,et al.  Exploring process data with the use of robust outlier detection algorithms , 2003 .

[2]  Peter J. Rousseeuw,et al.  Robust estimation in very small samples , 2002 .

[3]  C. J. Kim,et al.  An algorithmic approach for fuzzy inference , 1997, IEEE Trans. Fuzzy Syst..

[4]  Brian W. Kernighan,et al.  An efficient heuristic procedure for partitioning graphs , 1970, Bell Syst. Tech. J..

[5]  Chein-I Chang,et al.  Robust radial basis function neural networks , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[6]  Yong-Sheng Chen,et al.  Fast algorithm for robust template matching with M-estimators , 2003, IEEE Trans. Signal Process..

[7]  Chris C. N. Chu,et al.  FastPlace: efficient analytical placement using cell shifting, iterative local refinement,and a hybrid net model , 2005, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[8]  T. Ferryman,et al.  Data outlier detection using the Chebyshev theorem , 2005, 2005 IEEE Aerospace Conference.

[9]  Yun-Shiow Chen,et al.  Outliers detection and confidence interval modification in fuzzy regression , 2001, Fuzzy Sets Syst..

[10]  Wei Jiang,et al.  On-line outlier detection and data cleaning , 2004, Comput. Chem. Eng..

[11]  Shashi Shekhar,et al.  Multilevel hypergraph partitioning: application in VLSI domain , 1997, DAC.

[12]  C. Alpert,et al.  Multi-Way Partitioning Via Spacefilling Curves and Dynamic Programming , 1994, 31st Design Automation Conference.

[13]  Fred W. Glover,et al.  A user's guide to tabu search , 1993, Ann. Oper. Res..

[14]  Yixin Chen,et al.  Constraint partitioning in penalty formulations for solving temporal planning problems , 2006, Artif. Intell..

[15]  Ada Wai-Chee Fu,et al.  Enhancements on local outlier detection , 2003, Seventh International Database Engineering and Applications Symposium, 2003. Proceedings..

[16]  Hui Wang,et al.  GLOF: a new approach for mining local outlier , 2003, Proceedings of the 2003 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.03EX693).

[17]  Volker Deckert,et al.  Application of principal component analysis to detect outliers and spectral deviations in near-field surface-enhanced Raman spectra , 2001 .

[18]  David R. Musicant,et al.  Robust Linear and Support Vector Regression , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Vic Barnett,et al.  Outliers in Statistical Data , 1980 .

[20]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[21]  Chulhyun Kim,et al.  Forecasting time series with genetic fuzzy predictor ensemble , 1997, IEEE Trans. Fuzzy Syst..

[22]  Randy J. Pell,et al.  Multiple outlier detection for multivariate calibration using robust statistical techniques , 2000 .

[23]  Iiro Harjunkoski,et al.  Different transformations for solving non-convex trim-loss problems by MINLP , 1998, Eur. J. Oper. Res..

[24]  Sheng Chen,et al.  M-estimator and D-optimality model construction using orthogonal forward regression , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  Yixin Chen,et al.  Solving Large-Scale Nonlinear Programming Problems by Constraint Partitioning , 2005, CP.

[26]  Jarrod A. Roy,et al.  Unification of partitioning, placement and floorplanning , 2004, ICCAD 2004.