Time Series Prediction Using Robust Radial Basis Function with Two-Stage Learning Rule

The radial basis function neural network (RBFNN) is a well known method for many kinds of application, including function approximation, classification, and prediction. However, the traditional RBFNN is not robust for the training data which contains outliers. In this paper, we propose a two-stage learning rule for RBFNN to eliminate the influence of outliers. The concept of the Chebyshev theorem for detecting outlier is adopted to filter out the potential outliers in the first stage, and the M-estimator is used for dealing with the insignificant outliers in the second stage. The experimental results show that the proposed method can reduce the prediction error compared with other methods. Furthermore, even though fifty percent of all observations are the outliers this method still has a good performance.

[1]  Wei Jiang,et al.  On-line outlier detection and data cleaning , 2004, Comput. Chem. Eng..

[2]  Chulhyun Kim,et al.  Forecasting time series with genetic fuzzy predictor ensemble , 1997, IEEE Trans. Fuzzy Syst..

[3]  David R. Musicant,et al.  Robust Linear and Support Vector Regression , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Vic Barnett,et al.  Outliers in Statistical Data , 1980 .

[5]  T. Ferryman,et al.  Data outlier detection using the Chebyshev theorem , 2005, 2005 IEEE Aerospace Conference.

[6]  Yong-Sheng Chen,et al.  Fast algorithm for robust template matching with M-estimators , 2003, IEEE Trans. Signal Process..

[7]  Peter J. Rousseeuw,et al.  Robust estimation in very small samples , 2002 .

[8]  Volker Deckert,et al.  Application of principal component analysis to detect outliers and spectral deviations in near-field surface-enhanced Raman spectra , 2001 .

[9]  Yun-Shiow Chen,et al.  Outliers detection and confidence interval modification in fuzzy regression , 2001, Fuzzy Sets Syst..

[10]  Hui Wang,et al.  GLOF: a new approach for mining local outlier , 2003, Proceedings of the 2003 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.03EX693).

[11]  Chien-Cheng Lee,et al.  Noisy time series prediction using M-estimator based robust radial basis function neural networks with growing and pruning techniques , 2009, Expert Syst. Appl..

[12]  Ada Wai-Chee Fu,et al.  Enhancements on local outlier detection , 2003, Seventh International Database Engineering and Applications Symposium, 2003. Proceedings..

[13]  Chein-I Chang,et al.  Robust radial basis function neural networks , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[14]  Randy J. Pell,et al.  Multiple outlier detection for multivariate calibration using robust statistical techniques , 2000 .

[15]  Sheng Chen,et al.  M-estimator and D-optimality model construction using orthogonal forward regression , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[16]  Leo H. Chiang,et al.  Exploring process data with the use of robust outlier detection algorithms , 2003 .