Equivalences Between Neural-Autoregressive Time Series Models and Fuzzy Systems

Soft computing (SC) emerged as an integrating framework for a number of techniques that could complement one another quite well (artificial neural networks, fuzzy systems, evolutionary algorithms, probabilistic reasoning). Since its inception, a distinctive goal has been to dig out the deep relationships among their components. This paper considers two wide families of SC models. On the one hand, the regime-switching autoregressive paradigm is a recent development in statistical time series modeling, and it includes a set of models closely related to artificial neural networks. On the other hand, we consider fuzzy rule-based systems in the framework of time series analysis. This paper discloses original results establishing functional equivalences between models of these two classes, and hence opens the door to a productive line of research where results and techniques from one area can be applied in the other. As a consequence of the equivalences presented in this paper, we prove the asymptotic stationarity of a class of fuzzy rule-based systems. Simulations based on information criteria show the importance of the selection of the proper membership function.

[1]  Xue-Bin Liang.  Equivalence between local exponential stability of the unique equilibrium point and global stability for Hopfield-type neural networks with two neurons , 2000, IEEE Trans. Neural Networks Learn. Syst..

[2]  Marcelo C. Medeiros,et al.  Diagnostic Checking in a Flexible Nonlinear Time Series Model , 2003 .

[3]  Denise R. Osborn,et al.  Business cycle non-linearities in UK consumption and production , 2000 .

[4]  Ahmad Lotfi,et al.  Comments on "Functional equivalence between radial basis function networks and fuzzy inference systems" [and reply] , 1998, IEEE Trans. Neural Networks.

[5]  Dobrivoje Popovic,et al.  Computational Intelligence in Time Series Forecasting: Theory and Engineering Applications (Advances in Industrial Control) , 2005 .

[6]  H. S. Byun,et al.  A decision support system for the selection of a rapid prototyping process using the modified TOPSIS method , 2005 .

[7]  H. Poincaré.  Calcul des Probabilités , 1912 .

[8]  Marcílio Carlos Pereira de Souto,et al.  Equivalence between RAM-based neural networks and probabilistic automata , 2005, IEEE Transactions on Neural Networks.

[9]  Bart Kosko,et al.  Modeling gunshot bruises in soft body armor with an adaptive fuzzy system , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  A. Kolmogoroff.  Über die analytischen Methoden in der Wahrscheinlichkeitsrechnung , 1931 .

[11]  Mayte Suárez-Fariñas,et al.  Mixture of Experts and Local-Global Neural Networks , 2003, ESANN.

[12]  Ignacio Requena,et al.  Are artificial neural networks black boxes? , 1997, IEEE Trans. Neural Networks.

[13]  Robert Ivor John,et al.  Modeling uncertainty in clinical diagnosis using fuzzy logic , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  H. Tong.  On a threshold model , 1978 .

[15]  Chi-Hsu Wang,et al.  On the Equivalence of a Table Lookup (TL) Technique and Fuzzy Neural Network (FNN) With Block Pulse Membership Functions (BPMFs) and Its Application to Water Injection Control of an Automobile , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[16]  F. e..  Calcul des Probabilités , 1889, Nature.

[17]  José Manuel Benítez,et al.  Smooth transition autoregressive models and fuzzy rule-based systems: Functional equivalence and consequences , 2007, Fuzzy Sets Syst..

[18]  Marcelo C. Medeiros,et al.  A hybrid linear-neural model for time series forecasting , 2000, IEEE Trans. Neural Networks Learn. Syst..

[19]  Marcelo C. Medeiros,et al.  Local Global Neural Networks , 2004 .

[20]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[21]  José Manuel Benítez,et al.  Interpretation of artificial neural networks by means of fuzzy rules , 2002, IEEE Trans. Neural Networks.

[22]  Michael Margaliot,et al.  Extracting symbolic knowledge from recurrent neural networks - A fuzzy logic approach , 2009, Fuzzy Sets Syst..

[23]  R. N. Silva,et al.  Robust fault diagnosis approach using analytical and knowledge based techniques applied to a water tank system , 2005 .

[24]  Chuen-Tsai Sun,et al.  Functional equivalence between radial basis function networks and fuzzy inference systems , 1993, IEEE Trans. Neural Networks.

[25]  Marcelo C. Medeiros,et al.  A flexible coefficient smooth transition time series model , 2005, IEEE Transactions on Neural Networks.

[26]  C. L. Philip Chen,et al.  The equivalence between fuzzy logic systems and feedforward neural networks , 2000, IEEE Trans. Neural Networks Learn. Syst..

[27]  G. Yule.  On a Method of Investigating Periodicities in Disturbed Series, with Special Reference to Wolfer's Sunspot Numbers , 1927 .

[28]  Kurt Hornik,et al.  Stationarity and Stability of Autoregressive Neural Network Processes , 1998, NIPS.

[29]  H. Akaike.  A new look at the statistical model identification , 1974 .

[30]  P. Levy,et al.  Calcul des Probabilites , 1926, The Mathematical Gazette.

[31]  Yingcun Xia,et al.  On Single-Index Coefficient Regression Models , 1999 .

[32]  Geoffrey E. Hinton,et al.  Adaptive Mixtures of Local Experts , 1991, Neural Computation.

[33]  T. Teräsvirta.  Specification, Estimation, and Evaluation of Smooth Transition Autoregressive Models , 1994 .

[34]  M. Medeiros,et al.  Linear models, smooth transition autoregressions, and neural networks for forecasting macroeconomic time series: A re-examination , 2005 .

[35]  Michael Margaliot,et al.  Are artificial neural networks white boxes? , 2005, IEEE Transactions on Neural Networks.

[36]  A. Khintchine.  Korrelationstheorie der stationären stochastischen Prozesse , 1934 .

[37]  Ruey S. Tsay,et al.  Functional-Coefficient Autoregressive Models , 1993 .

[38]  Roderick Murray-Smith,et al.  Extending the functional equivalence of radial basis function networks and fuzzy inference systems , 1996, IEEE Trans. Neural Networks.

[39]  Lotfi A. Zadeh,et al.  Soft computing and fuzzy logic , 1994, IEEE Software.

[40]  M. Medeiros,et al.  Building Neural Network Models for Time Series: A Statistical Approach , 2002 .