Dynamic Evolving Neuro-Fuzzy Inference System (DENFIS): On-line learning and Application for Time-Series Prediction

This paper introduces a new type of fuzzy inference systems, denoted as DENFIS (dynamic evolving neural-fuzzy system), for adaptive on-line learning, and its application for dynamic time series prediction. DENFIS evolve through incremental, hybrid (supervised/unsupervised), learning and accommodate new input data, including new features, new classes, etc. through local element tuning. New fuzzy rules are created and updated during the operation of the system. At each time moment the output of DENFIS is calculated through a fuzzy inference system based on m-most activated fuzzy rules which are dynamically chosen from a fuzzy rule set. An approach is proposed for a dynamic creation of a firstorder Takagi-Sugeno type fuzzy rule set for the DENFIS model. The fuzzy rules can be inserted into DENFIS before, or during its learning process, and the rules can also be extracted from DENFIS during, or after its learning process. An evolving clustering method (ECM), which is employed in the DENFIS model, is also introduced. It is demonstrated that DENFIS can effectively learn complex temporal sequences in an adaptive way and outperform some existing models.

[1]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[2]  R. Scott Crowder,et al.  Predicting the Mackey-Glass Timeseries With Cascade-Correlation Learning , 1990 .

[3]  Eduard Aved’yan,et al.  The Cerebellar Model Articulation Controller (CMAC) , 1995 .

[4]  Nikola K. Kasabov,et al.  ESOM: an algorithm to evolve self-organizing maps from online data streams , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[5]  L. Glass,et al.  Oscillation and chaos in physiological control systems. , 1977, Science.

[6]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[7]  Stephen L. Chiu,et al.  Fuzzy Model Identification Based on Cluster Estimation , 1994, J. Intell. Fuzzy Syst..

[8]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[9]  John C. Platt A Resource-Allocating Network for Function Interpolation , 1991, Neural Computation.

[10]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[11]  Nikola K. Kasabov,et al.  DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction , 2002, IEEE Trans. Fuzzy Syst..

[12]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[13]  Tien C. Hsia,et al.  System identification: Least-squares methods , 1977 .

[14]  Graham C. Goodwin,et al.  Adaptive filtering prediction and control , 1984 .

[15]  Bernd Fritzke,et al.  A Growing Neural Gas Network Learns Topologies , 1994, NIPS.