Predictive modular fuzzy systems for time-series classification

We introduce the so-called predictive modular fuzzy system (PREMOFS) which performs time-series classification. A PREMOFS consists of 1) a bank of prediction modules and 2) a fuzzy decision module. It is assumed that the time series is generated by a source belonging to a finite search set (universal set); then the classification problem is to select the source that best represents the observed data, Classification is based on a membership function which is updated recursively according to the predictive accuracy of each model. Two algorithms are presented for updating the membership function. The first is based on sum/product fuzzy inference and the second on max/min fuzzy inference. In short, PREMOFS is a fuzzy modular system that classifies time series to one of a finite number of classes using the full set of past data (without preprocessing) to perform a recursive competitive computation of membership function based on predictive accuracy. Convergence proofs are given for both PREMOFS algorithms; in both cases the membership grade tends to one for the source that best predicts the observed data and to less than one for the remaining sources; hence, correct classification is guaranteed. Simulation results are also presented: PREMOFS are applied to signal detection, system identification, and phoneme classification tasks.

[1]  Jerry M. Mendel,et al.  Fuzzy basis functions: comparisons with other basis functions , 1995, IEEE Trans. Fuzzy Syst..

[2]  V. V. S. Sarma,et al.  A fuzzy approximation scheme for sequential learning in pattern recognition , 1986, IEEE Transactions on Systems, Man, and Cybernetics.

[3]  Athanasios Kehagias,et al.  A Recurrent Network Implementation of Time Series Classification , 1996, Neural Computation.

[4]  Michael P. Windham,et al.  Cluster Validity for the Fuzzy c-Means Clustering Algorithrm , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Athanasios Kehagias,et al.  Modular neural networks for MAP classification of time series and the partition algorithm , 1996, IEEE Trans. Neural Networks.

[6]  A. Wennberg,et al.  Computer analysis of EEG signals with parametric models , 1981, Proceedings of the IEEE.

[7]  J. Bezdek,et al.  Fuzzy partitions and relations; an axiomatic basis for clustering , 1978 .

[8]  Sankar K. Pal,et al.  Fuzzy sets and decisionmaking approaches in vowel and speaker recognition , 1977 .

[9]  Eric A. Wan,et al.  Neural network classification: a Bayesian interpretation , 1990, IEEE Trans. Neural Networks.

[10]  Shigeki Miyake,et al.  Bayes statistical behavior and valid generalization of pattern classifying neural networks , 1991, IEEE Trans. Neural Networks.

[11]  Esther Levin.  Hidden control neural architecture modeling of nonlinear time varying systems and its applications , 1993, IEEE Trans. Neural Networks.

[12]  Enrique H. Ruspini,et al.  A New Approach to Clustering , 1969, Inf. Control..

[13]  R. Krishnan,et al.  Study of Parameter Sensitivity in High-Performance Inverter-Fed Induction Motor Drive Systems , 1987, IEEE Transactions on Industry Applications.

[14]  C. S. George Lee,et al.  Reinforcement structure/parameter learning for neural-network-based fuzzy logic control systems , 1994, IEEE Trans. Fuzzy Syst..

[15]  Si-Zhao Joe Qin,et al.  A multiregion fuzzy logic controller for nonlinear process control , 1994, IEEE Trans. Fuzzy Syst..

[16]  R. B. Knapp,et al.  Pattern recognition of the polygraph using fuzzy classification , 1994, Proceedings of 1994 IEEE 3rd International Fuzzy Systems Conference.

[17]  D. Lainiotis,et al.  Recursive algorithm for the calculation of the adaptive Kalman filter weighting coefficients , 1969 .

[18]  Konstantinos N. Plataniotis,et al.  Adaptive dynamic neural network estimators , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[19]  Roberto Guerrieri,et al.  An enhanced two-level Boolean synthesis methodology for fuzzy rules minimization , 1995, IEEE Trans. Fuzzy Syst..

[20]  Patrick Billingsley,et al.  Probability and Measure. , 1986 .

[21]  Michael I. Jordan,et al.  Hierarchical Mixtures of Experts and the EM Algorithm , 1994, Neural Computation.

[22]  Michio Sugeno,et al.  A fuzzy-logic-based approach to qualitative modeling , 1993, IEEE Trans. Fuzzy Syst..

[23]  R. Krishnan,et al.  A review of parameter sensitivity and adaptation in indirect vector controlled induction motor drive systems , 1990, 21st Annual IEEE Conference on Power Electronics Specialists.

[24]  R.J. Hathaway,et al.  Switching regression models and fuzzy clustering , 1993, IEEE Trans. Fuzzy Syst..

[25]  Jerry M. Mendel,et al.  Fuzzy adaptive filters, with application to nonlinear channel equalization , 1993, IEEE Trans. Fuzzy Syst..

[26]  Athanasios Kehagias,et al.  Predictive Modular Neural Networks for Time Series Classification , 1997, Neural Networks.

[27]  Yinghua Lin,et al.  A new approach to fuzzy-neural system modeling , 1995, IEEE Trans. Fuzzy Syst..

[28]  Demetrios G. Lainiotis,et al.  Unsupervised Learning Minimum Risk Pattern Classification for Dependent Hypotheses and Dependent Measurements , 1969, IEEE Trans. Syst. Sci. Cybern..

[29]  D. Lainiotis.  Optimal adaptive estimation: Structure and parameter adaption , 1971 .

[30]  Isak Gath,et al.  Unsupervised Optimal Fuzzy Clustering , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Simon Haykin,et al.  Classification of radar clutter using neural networks , 1991, IEEE Trans. Neural Networks.

[32]  Geoffrey E. Hinton,et al.  Adaptive Mixtures of Local Experts , 1991, Neural Computation.

[33]  Un-Chul Moon,et al.  A self-organizing fuzzy logic controller for dynamic systems using a fuzzy auto-regressive moving average (FARMA) model , 1995, IEEE Trans. Fuzzy Syst..

[34]  J. C. Dunn,et al.  A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters , 1973 .

[35]  Anil K. Jain,et al.  A Clustering Performance Measure Based on Fuzzy Set Decomposition , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  A. Zardecki,et al.  Fuzzy control for forecasting and pattern recognition in a time series , 1994, Proceedings of 1994 IEEE 3rd International Fuzzy Systems Conference.

[37]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[38]  N. Karayiannis.  MECA: maximum entropy clustering algorithm , 1994, Proceedings of 1994 IEEE 3rd International Fuzzy Systems Conference.

[39]  Hisao Ishibuchi,et al.  Selecting fuzzy rules with forgetting in fuzzy classification systems , 1994, Proceedings of 1994 IEEE 3rd International Fuzzy Systems Conference.

[40]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[41]  C. M. Place,et al.  An Introduction to Dynamical Systems , 1990 .

[42]  Richard A. Davis,et al.  Time Series: Theory and Methods , 2013 .