Fuzzy Neural Network Technique for System State Forecasting

In many system state forecasting applications, the prediction is performed based on multiple datasets, each corresponding to a distinct system condition. The traditional methods dealing with multiple datasets (e.g., vector autoregressive moving average models and neural networks) have some shortcomings, such as limited modeling capability and opaque reasoning operations. To tackle these problems, a novel fuzzy neural network (FNN) is proposed in this paper to effectively extract information from multiple datasets, so as to improve forecasting accuracy. The proposed predictor consists of both autoregressive (AR) nodes modeling and nonlinear nodes modeling; AR models/nodes are used to capture the linear correlation of the datasets, and the nonlinear correlation of the datasets are modeled with nonlinear neuron nodes. A novel particle swarm technique [i.e., Laplace particle swarm (LPS) method] is proposed to facilitate parameters estimation of the predictor and improve modeling accuracy. The effectiveness of the developed FNN predictor and the associated LPS method is verified by a series of tests related to Mackey-Glass data forecast, exchange rate data prediction, and gear system prognosis. Test results show that the developed FNN predictor and the LPS method can capture the dynamics of multiple datasets effectively and track system characteristics accurately.

[1]  M. Clerc,et al.  Particle Swarm Optimization , 2006 .

[2]  J. Nowicka-Zagrajek,et al.  Modeling electricity loads in California: ARMA models with hyperbolic noise , 2002, Signal Process..

[3]  Helmut Ltkepohl,et al.  New Introduction to Multiple Time Series Analysis , 2007 .

[4]  Kourosh Mohammadi,et al.  Parameter estimation of an ARMA model for river flow forecasting using goal programming , 2006 .

[5]  Y. Wang,et al.  Analysis and modeling of multivariate chaotic time series based on neural network , 2009, Expert Syst. Appl..

[6]  Chin-Teng Lin,et al.  A Hybrid of Cooperative Particle Swarm Optimization and Cultural Algorithm for Neural Fuzzy Networks and Its Prediction Applications , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[7]  Li-yun Su,et al.  Prediction of multivariate chaotic time series with local polynomial fitting , 2010, Comput. Math. Appl..

[8]  Ali Arefi,et al.  A modified particle swarm optimization for correlated phenomena , 2011, Appl. Soft Comput..

[9]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[10]  E. Mizutani,et al.  Neuro-Fuzzy and Soft Computing-A Computational Approach to Learning and Machine Intelligence [Book Review] , 1997, IEEE Transactions on Automatic Control.

[11]  M. Noel,et al.  A new gradient based particle swarm optimization algorithm for accurate computation of global minimum , 2012, Appl. Soft Comput..

[12]  Wilson Q. Wang An Enhanced Diagnostic System for Gear System Monitoring , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  Wilson Wang,et al.  An integrated classifier for gear system monitoring , 2009 .

[14]  Bo Yang,et al.  Automatic Design of Hierarchical Takagi–Sugeno Type Fuzzy Systems Using Evolutionary Algorithms , 2007, IEEE Transactions on Fuzzy Systems.

[15]  Paul A. Fishwick,et al.  Neural Network Models In Simulation: A Comparison With Traditional Modeling Approaches , 1989, 1989 Winter Simulation Conference Proceedings.

[16]  E. J. Hannan,et al.  Regression Procedures for ARMA Estimation , 1988 .

[17]  L. Glass,et al.  Oscillation and chaos in physiological control systems. , 1977, Science.

[18]  Francisco F. R. Ramos Forecasts of market shares from VAR and BVAR models: a comparison of their accuracy , 2003 .

[19]  Ioannis B. Theocharis,et al.  Pipelined Recurrent Fuzzy Neural Networks for Nonlinear Adaptive Speech Prediction , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[20]  Ki H. Chon,et al.  A new algorithm for linear and nonlinear ARMA model parameter estimation using affine geometry [and application to blood flow/pressure data] , 2001, IEEE Transactions on Biomedical Engineering.

[21]  Yanqing Zhang,et al.  Evolutionary fuzzy neural networks for hybrid financial prediction , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[22]  Greg Welch,et al.  Welch & Bishop , An Introduction to the Kalman Filter 2 1 The Discrete Kalman Filter In 1960 , 1994 .

[23]  Paul A. Fishwick,et al.  Time series forecasting using neural networks vs. Box- Jenkins methodology , 1991, Simul..

[24]  Thomas Kolarik,et al.  Time series forecasting using neural networks , 1994, APL '94.

[25]  Ergin Erdem,et al.  ARMA based approaches for forecasting the tuple of wind speed and direction , 2011 .

[26]  Christian Kascha,et al.  Business cycle analysis and VARMA models , 2009 .

[27]  Niels Haldrup,et al.  Vector Autoregressive Model for Electricity Prices Subject to Long Memory and Regime Switching , 2007 .