Identification of Lags in Nonlinear Autoregressive Time Series Using a Flexible Fuzzy Model

This work proposes a method to find the set of the most influential lags and the rule structure of a Takagi–Sugeno–Kang (TSK) fuzzy model for time series applications. The proposed method resembles the techniques that prioritize lags, evaluating the proximity of nearby samples in the input space using the closeness of the corresponding target values. Clusters of samples are generated, and the consistency of the mapping between the predicted variable and the set of candidate past values is evaluated. A TSK model is established, and possible redundancies in the rule base are avoided. The proposed method is evaluated using simulated and real data. Several simulation experiments were conducted for five synthetic nonlinear autoregressive processes, two nonlinear vector autoregressive processes and eight benchmark time series. The results show a competitive performance in the mean square error and a promising ability to find a proper set of lags for a given autoregressive process.

[1]  Tyrone L. Vincent,et al.  Compressive topology identification of interconnected dynamic systems via Clustered Orthogonal Matching Pursuit , 2011, IEEE Conference on Decision and Control and European Control Conference.

[2]  J. Abonyi,et al.  Model Order Selection of Nonlinear Input-Output Models - A Clustering Based Approach , 2004 .

[3]  Balazs Feil,et al.  Cluster Analysis for Data Mining and System Identification , 2007 .

[4]  Robert D. Nowak,et al.  Causal Network Inference Via Group Sparse Regularization , 2011, IEEE Transactions on Signal Processing.

[5]  Hiok Chai Quek,et al.  GenSoFNN: a generic self-organizing fuzzy neural network , 2002, IEEE Trans. Neural Networks.

[6]  James M. Keller,et al.  A possibilistic fuzzy c-means clustering algorithm , 2005, IEEE Transactions on Fuzzy Systems.

[7]  Michio Sugeno,et al.  A fuzzy-logic-based approach to qualitative modeling , 1993, IEEE Trans. Fuzzy Syst..

[8]  Jing Zeng,et al.  Identification of Quasi-ARX neurofuzzy model by using SVR-based approach with input selection , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[9]  Stephen L. Chiu,et al.  Selecting Input Variables for Fuzzy Models , 1996, J. Intell. Fuzzy Syst..

[10]  Roy Rada,et al.  Comparison of different input selection algorithms in neuro-fuzzy modeling , 2012, Expert systems with applications.

[11]  J.-S.R. Jang,et al.  Input selection for ANFIS learning , 1996, Proceedings of IEEE 5th International Fuzzy Systems.

[12]  Todd P. Coleman,et al.  A minimal approach to causal inference on topologies with bounded indegree , 2011, IEEE Conference on Decision and Control and European Control Conference.

[13]  Vincent Wertz,et al.  Fuzzy Logic, Identification and Predictive Control , 2004 .

[14]  Nils Lid Hjort,et al.  Model Selection and Model Averaging: Contents , 2008 .

[15]  Michel Verleysen,et al.  Forecasting electricity consumption using nonlinear projection and self-organizing maps , 2002, Neurocomputing.

[16]  Nils Lid Hjort,et al.  Model Selection and Model Averaging , 2001 .

[17]  M. Medeiros,et al.  Building Neural Network Models for Time Series: A Statistical Approach , 2002 .

[18]  Ramdane Maamri,et al.  Structure Identification for Complex System and Inference Interpretable Rules , 2012, 2012 Sixth International Conference on Complex, Intelligent, and Software Intensive Systems.

[19]  Jeongho Cho,et al.  Modeling and inverse controller design for an unmanned aerial vehicle based on the self-organizing map , 2006, IEEE Transactions on Neural Networks.

[20]  Ferenc Szeifert,et al.  Modified Gath-Geva fuzzy clustering for identification of Takagi-Sugeno fuzzy models , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[21]  Song-Shyong Chen,et al.  Robust TSK fuzzy modeling for function approximation with outliers , 2001, IEEE Trans. Fuzzy Syst..

[22]  M. Morari,et al.  Determining the model order of nonlinear input/output systems , 1998 .

[23]  Xiangdong He,et al.  A New Method for Identifying Orders of Input-Output Models for Nonlinear Dynamic Systems , 1993, 1993 American Control Conference.

[24]  Timo Teräsvirta,et al.  A SIMPLE VARIABLE SELECTION TECHNIQUE FOR NONLINEAR MODELS , 2001 .

[25]  Robert Babu.  Input Selection for Nonlinear Regression Models , 2004 .

[26]  H. Abarbanel,et al.  Determining embedding dimension for phase-space reconstruction using a geometrical construction. , 1992, Physical review. A, Atomic, molecular, and optical physics.

[27]  Min Gan,et al.  A locally linear RBF network-based state-dependent AR model for nonlinear time series modeling , 2010, Inf. Sci..

[28]  Angel Barriga Barros,et al.  Automatic clustering-based identification of autoregressive fuzzy inference models for time series , 2010, Neurocomputing.

[29]  Carsten Peterson,et al.  Finding the Embedding Dimension and Variable Dependencies in Time Series , 1994, Neural Computation.

[30]  Yinghua Lin,et al.  A new approach to fuzzy-neural system modeling , 1995, IEEE Trans. Fuzzy Syst..

[31]  Sylvie Galichet,et al.  Inverse controller design for fuzzy interval systems , 2006, IEEE Transactions on Fuzzy Systems.

[32]  Yinghua Lin,et al.  Input variable identification - fuzzy curves and fuzzy surfaces , 1996, Fuzzy Sets Syst..

[33]  Stefan Jakubek,et al.  Identification of Neurofuzzy Models Using GTLS Parameter Estimation , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[34]  Joos Vandewalle,et al.  Fuzzy Logic, Identification and Predictive Control (Advances in Industrial Control) , 2004 .

[35]  Claudio Moraga,et al.  A Flexible Neuro-Fuzzy Autoregressive Technique for Non-linear Time Series Forecasting , 2009, KES.

[36]  Derek A. Linkens,et al.  Input selection and partition validation for fuzzy modelling using neural network , 1999, Fuzzy Sets Syst..

[37]  Hui Peng,et al.  A hybrid algorithm to optimize RBF network architecture and parameters for nonlinear time series prediction , 2012 .

[38]  W. Pedrycz,et al.  An introduction to fuzzy sets : analysis and design , 1998 .

[39]  D. Sáez,et al.  Fuzzy modelling for a combined cycle power plant , 1999, FUZZ-IEEE'99. 1999 IEEE International Fuzzy Systems. Conference Proceedings (Cat. No.99CH36315).

[40]  D. Gradisar,et al.  Input variable selection algorithms for HPC , 2012, 2012 IEEE International Conference on Industrial Technology.

[41]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[42]  Claudio Moraga,et al.  Artificial neural networks in time series forecasting: a comparative analysis , 2002, Kybernetika.

[43]  Guilherme De A. Barreto,et al.  On building local models for inverse system identification with vector quantization algorithms , 2010, Neurocomputing.

[44]  Danilo P. Mandic,et al.  Recurrent Neural Networks for Prediction: Learning Algorithms, Architectures and Stability , 2001 .

[45]  Sun-Yuan Kung,et al.  A delay damage model selection algorithm for NARX neural networks , 1997, IEEE Trans. Signal Process..

[46]  Claudio Moraga,et al.  Multiple-Valued Logic and Artificial Intelligence Fundamentals of Fuzzy Control Revisited , 2003, Artificial Intelligence Review.

[47]  C. L. Philip Chen,et al.  A rapid learning and dynamic stepwise updating algorithm for flat neural networks and the application to time-series prediction , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[48]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[49]  Thomas Martinetz,et al.  'Neural-gas' network for vector quantization and its application to time-series prediction , 1993, IEEE Trans. Neural Networks.

[50]  H. Akaike.  A new look at the statistical model identification , 1974 .

[51]  Danilo P. Mandic,et al.  Recurrent Neural Networks for Prediction: Learning Algorithms, Architectures and Stability , 2001 .

[52]  Dale E. Seborg,et al.  Determination of model order for NARX models directly from input-output data , 1998 .

[53]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[54]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[55]  Jan W. Owsiński,et al.  Book reviews: ''Cluster analysis for data mining and system identification'' by János Abonyi and Balázs Feil , 2008 .

[56]  Motoaki Kawanabe,et al.  Modeling Sparse Connectivity Between Underlying Brain Sources for EEG/MEG , 2009, IEEE Transactions on Biomedical Engineering.

[57]  Junfei Qiao,et al.  A self-organizing fuzzy neural network and its applications to function approximation and forecast modeling , 2008, Neurocomputing.

[58]  Witold Pedrycz,et al.  Fuzzy prediction architecture using recurrent neural networks , 2009, Neurocomputing.