Batch type local search-based adaptive neuro-fuzzy inference system (ANFIS) with self-feedbacks for time-series prediction

This paper presents an improved adaptive neuro-fuzzy inference system (ANFIS) for the application of time-series prediction. Because ANFIS is based on a feedforward network structure, it is limited to static problem and cannot effectively cope with dynamic properties such as the time-series data. To overcome this problem, an improved version of ANFIS is proposed by introducing self-feedback connections that model the temporal dependence. A batch type local search is suggested to train the proposed system. The effectiveness of the presented system is tested by using three benchmark time-series examples and comparison with the various models in time-series prediction is also shown. The results obtained from the simulation show an improved performance.

[1]  Amir B. Geva,et al.  ScaleNet-multiscale neural-network architecture for time series prediction , 1998, IEEE Trans. Neural Networks.

[2]  Jose C. Principe,et al.  Neural and adaptive systems , 2000 .

[3]  D.H. Werner,et al.  Particle swarm optimization versus genetic algorithms for phased array synthesis , 2004, IEEE Transactions on Antennas and Propagation.

[4]  Jiwen Dong,et al.  Time-series prediction using a local linear wavelet neural network , 2006, Neurocomputing.

[5]  Chin-Teng Lin,et al.  An online self-constructing neural fuzzy inference network and its applications , 1998, IEEE Trans. Fuzzy Syst..

[6]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[7]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[8]  Nikola K. Kasabov,et al.  HyFIS: adaptive neuro-fuzzy inference systems and their application to nonlinear dynamical systems , 1999, Neural Networks.

[9]  Lakhmi C. Jain,et al.  ANFISunfoldedintime for multivariate time series forecasting , 2004, Neurocomputing.

[10]  Ching-Hsue Cheng,et al.  High-order fuzzy time-series based on multi-period adaptation model for forecasting stock markets , 2008 .

[11]  Cheng-Jian Lin,et al.  A hybrid evolutionary learning algorithm for TSK-type fuzzy model design , 2006, Math. Comput. Model..

[12]  Andreas S. Weigend,et al.  Time Series Prediction: Forecasting the Future and Understanding the Past , 1994 .

[13]  Kwang Bo Cho,et al.  Radial basis function based adaptive fuzzy systems and their applications to system identification and prediction , 1996, Fuzzy Sets Syst..

[14]  Hamid R. Berenji,et al.  Learning and tuning fuzzy logic controllers through reinforcements , 1992, IEEE Trans. Neural Networks.

[15]  M. Markus,et al.  On-off intermittency and intermingledlike basins in a granular medium. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[16]  Cheng-Jian Lin,et al.  A self-adaptive neural fuzzy network with group-based symbiotic evolution and its prediction applications , 2006, Fuzzy Sets Syst..

[17]  Paris A. Mastorocostas,et al.  A recurrent fuzzy-neural model for dynamic system identification , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[18]  Xiaoming Xu,et al.  A hybrid genetic algorithm for feature selection wrapper based on mutual information , 2007, Pattern Recognit. Lett..

[19]  De-Shuang Huang,et al.  A mended hybrid learning algorithm for radial basis function neural networks to improve generalization capability , 2007 .

[20]  Hiok Chai Quek,et al.  GA-TSKfnn: Parameters tuning of fuzzy neural network using genetic algorithms , 2005, Expert Syst. Appl..

[21]  Nadine N. Tschichold-Gürman,et al.  FUN: optimization of fuzzy rule based systems using neural networks , 1993, IEEE International Conference on Neural Networks.

[22]  Jun-Ping Zhang,et al.  Time series prediction based on ensemble ANFIS , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[23]  H. Joel Trussell,et al.  Fuzzy inference systems implemented on neural architectures for motor fault detection and diagnosis , 1999, IEEE Trans. Ind. Electron..

[24]  E. M. Abdelrahim,et al.  A new transformed input-domain ANFIS for highly nonlinear system modeling and prediction , 2001, Canadian Conference on Electrical and Computer Engineering 2001. Conference Proceedings (Cat. No.01TH8555).

[25]  Wen Yu,et al.  Nonlinear system identification using discrete-time recurrent neural networks with stable learning algorithms , 2004, Inf. Sci..

[26]  Detlef Nauck,et al.  Foundations Of Neuro-Fuzzy Systems , 1997 .

[27]  Qinghua Zhang,et al.  Wavelet networks , 1992, IEEE Trans. Neural Networks.

[28]  Ching-Hung Lee,et al.  Identification and control of dynamic systems using recurrent fuzzy neural networks , 2000, IEEE Trans. Fuzzy Syst..

[29]  Cheng-Jian Lin,et al.  Prediction and identification using wavelet-based recurrent fuzzy neural networks , 2004, IEEE Trans. Syst. Man Cybern. Part B.

[30]  Xiaoou Li,et al.  Dynamic system identification via recurrent multilayer perceptron , 2002, Inf. Sci..

[31]  P.-H. Shen,et al.  An Adaptive Recurrent-Neural-Network Motion Controller for X-Y Table in CNC Machine , 2006, IEEE Trans. Syst. Man Cybern. Part B.

[32]  Ajith Abraham,et al.  Optimal Design of Neural Nets Using Hybrid Algorithms , 2000, PRICAI.

[33]  Michael Small,et al.  Minimum description length neural networks for time series prediction. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[34]  Eric A. Wan.  Finite impulse response neural networks with applications in time series prediction , 1994 .

[35]  Jiwen Dong,et al.  Nonlinear System Modelling Via Optimal Design Of Neural Trees , 2004, Int. J. Neural Syst..

[36]  Chuen-Tsai Sun,et al.  Neuro-fuzzy modeling and control , 1995, Proc. IEEE.

[37]  Min Han,et al.  Prediction of chaotic time series based on the recurrent predictor neural network , 2004, IEEE Transactions on Signal Processing.

[38]  Roman Neruda,et al.  Learning methods for radial basis function networks , 2005, Future Gener. Comput. Syst..

[39]  Héctor Pomares,et al.  Time series analysis using normalized PG-RBF network with regression weights , 2002, Neurocomputing.

[40]  Haiping Du,et al.  Time series prediction using evolving radial basis function networks with new encoding scheme , 2008, Neurocomputing.

[41]  Ajith Abraham,et al.  Neuro Fuzzy Systems: Sate-of-the-Art Modeling Techniques , 2001, IWANN.

[42]  Chunshien Li,et al.  Recurrent neuro-fuzzy hybrid-learning approach to accurate system modeling , 2007, Fuzzy Sets Syst..

[43]  T. Martin McGinnity,et al.  Predicting a Chaotic Time Series using Fuzzy Neural network , 1998, Inf. Sci..

[44]  Shun-Feng Su,et al.  On the dynamical modeling with neural fuzzy networks , 2002, IEEE Trans. Neural Networks.

[45]  Aleksandrs Vališevskis.  Adaptive Learning Algorithm for Hybrid Fuzzy System , 2002 .

[46]  Alaa F. Sheta,et al.  Time-series forecasting using GA-tuned radial basis functions , 2001, Inf. Sci..

[47]  I. Reljin,et al.  Modified ANFIS architecture - improving efficiency of ANFIS technique , 2004, 7th Seminar on Neural Network Applications in Electrical Engineering, 2004. NEUREL 2004. 2004.

[48]  Chulhyun Kim,et al.  Forecasting time series with genetic fuzzy predictor ensemble , 1997, IEEE Trans. Fuzzy Syst..

[49]  Christian W. Dawson,et al.  The effect of different basis functions on a radial basis function network for time series prediction: A comparative study , 2006, Neurocomputing.

[50]  Ajith Abraham,et al.  Evolutionary Design of Neuro-Fuzzy Systems - A Generic Framework , 2000 .

[51]  Hui Li,et al.  Hybrid Model of WT and ANFIS and Its Application on Time Series Prediction of Ship Roll Motion , 2006, The Proceedings of the Multiconference on "Computational Engineering in Systems Applications".

[52]  M.H. Hassoun,et al.  Fundamentals of Artificial Neural Networks , 1996, Proceedings of the IEEE.

[53]  Tommy W. S. Chow,et al.  A recurrent neural-network-based real-time learning control strategy applying to nonlinear systems with unknown dynamics , 1998, IEEE Trans. Ind. Electron..

[54]  Chia-Feng Juang,et al.  A TSK-type recurrent fuzzy network for dynamic systems processing by neural network and genetic algorithms , 2002, IEEE Trans. Fuzzy Syst..

[55]  Shun'ichi Tano,et al.  Deep combination of fuzzy inference and neural network in fuzzy inference software - FINEST , 1996, Fuzzy Sets Syst..

[56]  Faa-Jeng Lin,et al.  Hybrid controller with recurrent neural network for magnetic levitation system , 2005 .

[57]  Sheng Chen,et al.  Representations of non-linear systems: the NARMAX model , 1989 .

[58]  Chin-Teng Lin,et al.  An ART-based fuzzy adaptive learning control network , 1997, IEEE Trans. Fuzzy Syst..