Time-series prediction using a local linear wavelet neural network

A local linear wavelet neural network (LLWNN) is presented in this paper. The difference of the network with conventional wavelet neural network (WNN) is that the connection weights between the hidden layer and output layer of conventional WNN are replaced by a local linear model. A hybrid training algorithm of particle swarm optimization (PSO) with diversity learning and gradient descent method is introduced for training the LLWNN. Simulation results for the prediction of time-series show the feasibility and effectiveness of the proposed method.

[1]  Shyh Hwang,et al.  An identification algorithm in fuzzy relational systems , 1996, Soft Computing in Intelligent Systems and Information Processing. Proceedings of the 1996 Asian Fuzzy Systems Symposium.

[2]  Héctor Pomares,et al.  Time series analysis using normalized PG-RBF network with regression weights , 2002, Neurocomputing.

[3]  Junhong Nie,et al.  Constructing fuzzy model by self-organizing counterpropagation network , 1995, IEEE Trans. Syst. Man Cybern..

[4]  Xin Yao,et al.  Evolving artificial neural networks , 1999, Proc. IEEE.

[5]  Chulhyun Kim,et al.  Forecasting time series with genetic fuzzy predictor ensemble , 1997, IEEE Trans. Fuzzy Syst..

[6]  Rolf Isermann,et al.  Adaptive predictive control of a heat exchanger based on a fuzzy model , 1998 .

[7]  Jiwen Dong,et al.  Nonlinear System Modelling Via Optimal Design Of Neural Trees , 2004, Int. J. Neural Syst..

[8]  R. Eberhart,et al.  Empirical study of particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[9]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[10]  X. Yao.  Evolving Artificial Neural Networks , 1999 .

[11]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[12]  James Kennedy,et al.  Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[13]  Andries Petrus Engelbrecht,et al.  Cooperative learning in neural networks using particle swarm optimizers , 2000, South Afr. Comput. J..

[14]  H. Surmann,et al.  Self-Organizing and Genetic Algorithms for an Automatic Design of Fuzzy Control and Decision Systems , 1993 .

[15]  Guoqiang Peter Zhang,et al.  Time series forecasting using a hybrid ARIMA and neural network model , 2003, Neurocomputing.

[16]  Yinghua Lin,et al.  A new approach to fuzzy-neural system modeling , 1995, IEEE Trans. Fuzzy Syst..

[17]  E. Mizutani,et al.  Neuro-Fuzzy and Soft Computing-A Computational Approach to Learning and Machine Intelligence [Book Review] , 1997, IEEE Transactions on Automatic Control.

[18]  Snehasis Mukhopadhyay,et al.  Adaptive control using neural networks and approximate models , 1997, IEEE Trans. Neural Networks.

[19]  Nikola K. Kasabov,et al.  HyFIS: adaptive neuro-fuzzy inference systems and their application to nonlinear dynamical systems , 1999, Neural Networks.

[20]  C. Hwang,et al.  A Combined Approach to Fuzzy Model Identification , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[21]  W. Pedrycz.  An identification algorithm in fuzzy relational systems , 1984 .

[22]  Wang Ting,et al.  A wavelet neural network for the approximation of nonlinear multivariable function , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[23]  Frans van den Bergh,et al.  Particle Swarm Weight Initialization In Multi-Layer Perceptron Artificial Neural Networks , 1999 .

[24]  Yong-Zai Lu,et al.  Fuzzy Model Identification and Self-Learning for Dynamic Systems , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[25]  R. Tong.  The evaluation of fuzzy models derived from experimental data , 1980 .

[26]  Jonathan D. Cryer,et al.  Time Series Analysis , 1986 .

[27]  Qinghua Zhang,et al.  Wavelet networks , 1992, IEEE Trans. Neural Networks.

[28]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[29]  Kwang Bo Cho,et al.  Radial basis function based adaptive fuzzy systems and their applications to system identification and prediction , 1996, Fuzzy Sets Syst..

[30]  Michael J. Watts,et al.  FuNN/2 - A Fuzzy Neural Network Architecture for Adaptive Learning and Knowledge Acquisition , 1997, Inf. Sci..

[31]  Yuehui Chen,et al.  Evolving Neurofuzzy System by Hybrid Soft Computing Approaches for System Identification , 2001, J. Adv. Comput. Intell. Intell. Informatics.

[32]  Yoshikazu Fukuyama,et al.  A particle swarm optimization for reactive power and voltage control considering voltage security assessment , 2000 .

[33]  T. A. Johansen,et al.  On local and fuzzy modelling , 1993, Third International Conference on Industrial Fuzzy Control and Intelligent Systems.

[34]  Yuehui Chen,et al.  Evolving Basis Function Networks for System Identification , 2001, J. Adv. Comput. Intell. Intell. Informatics.

[35]  Russell C. Eberhart,et al.  Human tremor analysis using particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[36]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[37]  Ting Wang,et al.  A Wavelet Neural Network for the Approximation of Nonlinear Multivariable Functions , 2000 .