Time-series forecasting using flexible neural tree model

Time-series forecasting is an important research and application area. Much effort has been devoted over the past several decades to develop and improve the time-series forecasting models. This paper introduces a new time-series forecasting model based on the flexible neural tree (FNT). The FNT model is generated initially as a flexible multi-layer feed-forward neural network and evolved using an evolutionary procedure. Very often it is a difficult task to select the proper input variables or time-lags for constructing a time-series model. Our research demonstrates that the FNT model is capable of handing the task automatically. The performance and effectiveness of the proposed method are evaluated using time series prediction problems and compared with those of related methods.

[1]  Risto Miikkulainen,et al.  Evolving Neural Networks through Augmenting Topologies , 2002, Evolutionary Computation.

[2]  E. Mizutani,et al.  Neuro-Fuzzy and Soft Computing-A Computational Approach to Learning and Machine Intelligence [Book Review] , 1997, IEEE Transactions on Automatic Control.

[3]  Nikola K. Kasabov,et al.  HyFIS: adaptive neuro-fuzzy inference systems and their application to nonlinear dynamical systems , 1999, Neural Networks.

[4]  Guoqiang Peter Zhang,et al.  Time series forecasting using a hybrid ARIMA and neural network model , 2003, Neurocomputing.

[5]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[6]  Yinghua Lin,et al.  A new approach to fuzzy-neural system modeling , 1995, IEEE Trans. Fuzzy Syst..

[7]  Jui-Hong Horng,et al.  Neural Adaptive Tracking Control of a DC Motor , 1999, Inf. Sci..

[8]  Christian Lebiere,et al.  The Cascade-Correlation Learning Architecture , 1989, NIPS.

[9]  B. C. Brookes,et al.  Information Sciences , 2020, Cognitive Skills You Need for the 21st Century.

[10]  Shumeet Baluja,et al.  A Method for Integrating Genetic Search Based Function Optimization and Competitive Learning , 1994 .

[11]  R. Tong.  The evaluation of fuzzy models derived from experimental data , 1980 .

[12]  W. Hauptmann,et al.  A neural net topology for bidirectional fuzzy-neuro transformation , 1995, Proceedings of 1995 IEEE International Conference on Fuzzy Systems..

[13]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[14]  Peter J. Angeline,et al.  An evolutionary algorithm that constructs recurrent neural networks , 1994, IEEE Trans. Neural Networks.

[15]  Marzuki Khalid,et al.  Neuro-control and its applications , 1996 .

[16]  Inés Couso,et al.  Combining GP operators with SA search to evolve fuzzy rule based classifiers , 2001, Inf. Sci..

[17]  Jean-Pierre Nadal,et al.  Study of a Growth Algorithm for a Feedforward Network , 1989, Int. J. Neural Syst..

[18]  H. Surmann,et al.  Self-Organizing and Genetic Algorithms for an Automatic Design of Fuzzy Control and Decision Systems , 1993 .

[19]  Reinald Hillebrand,et al.  Neural networks for HREM image analysis , 2000, Inf. Sci..

[20]  W. Pedrycz.  An identification algorithm in fuzzy relational systems , 1984 .

[21]  Jonathan D. Cryer,et al.  Time Series Analysis , 1986 .

[22]  Xin Yao,et al.  A new evolutionary system for evolving artificial neural networks , 1997, IEEE Trans. Neural Networks.

[23]  Yong-Zai Lu,et al.  Fuzzy Model Identification and Self-Learning for Dynamic Systems , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[24]  Kwang Bo Cho,et al.  Radial basis function based adaptive fuzzy systems , 1995, Proceedings of 1995 IEEE International Conference on Fuzzy Systems..

[25]  J. C. Suh,et al.  Function Approximations by Superimposing Genetic Programming Trees: With Applications to Engineering Problems , 2000, Inf. Sci..

[26]  Hogler Kirschner,et al.  Reasoning on domain knowledge level in human-computer interaction , 1994 .

[27]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[28]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[29]  Rafal Salustowicz,et al.  Probabilistic Incremental Program Evolution , 1997, Evolutionary Computation.

[30]  C. Hwang,et al.  A Combined Approach to Fuzzy Model Identification , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[31]  Rudy Setiono,et al.  Use of a quasi-Newton method in a feedforward neural network construction algorithm , 1995, IEEE Trans. Neural Networks.

[32]  Xin Yao,et al.  Evolving artificial neural networks , 1999, Proc. IEEE.

[33]  Byoung-Tak Zhang,et al.  Evolutionary Induction of Sparse Neural Trees , 1997, Evolutionary Computation.

[34]  Alaa F. Sheta,et al.  Time-series forecasting using GA-tuned radial basis functions , 2001, Inf. Sci..

[35]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[36]  Chulhyun Kim,et al.  Forecasting time series with genetic fuzzy predictor ensemble , 1997, IEEE Trans. Fuzzy Syst..

[37]  Michio Sugeno,et al.  A fuzzy-logic-based approach to qualitative modeling , 1993, IEEE Trans. Fuzzy Syst..

[38]  Michael J. Watts,et al.  FuNN/2 - A Fuzzy Neural Network Architecture for Adaptive Learning and Knowledge Acquisition , 1997, Inf. Sci..

[39]  Xiaoou Li,et al.  Dynamic system identification via recurrent multilayer perceptron , 2002, Inf. Sci..

[40]  Marzuki Khalid,et al.  Neuro-Control Applications , 1996 .

[41]  Junhong Nie,et al.  Constructing fuzzy model by self-organizing counterpropagation network , 1995, IEEE Trans. Syst. Man Cybern..

[42]  Sanja Petrovic,et al.  A NEW LOCAL SEARCH APPROACH WITH EXECUTION TIME AS AN INPUT PARAMETER , 2002 .

[43]  Shyh Hwang,et al.  An identification algorithm in fuzzy relational systems , 1996, Soft Computing in Intelligent Systems and Information Processing. Proceedings of the 1996 Asian Fuzzy Systems Symposium.

[44]  Yuehui Chen,et al.  System Identification and Control using Probabilistic Incremental Program Evolution Algorithm , 2000, J. Robotics Mechatronics.

[45]  Héctor Pomares,et al.  Time series analysis using normalized PG-RBF network with regression weights , 2002, Neurocomputing.