Fuzzy associative learning of feature dependency for time series forecasting

Neuro-fuzzy system (NFS) has successfully been widely applied in solving problems across diverse fields, such as signal detection, fault detection, and forecasting. In recent years, many forecasting problems require the processing and learning of large number of dynamic data streams. Existing systems are inadequate in handling this type of complex problem. This paper presents a learning system that incorporates an evolving correlation-based feature selector to handle the high dimensionality of the data streams, and an evolving NFS to sequentially model and extract fuzzy knowledge about these data streams. The proposed system requires no prior knowledge of the data, reads the stream of data in a single pass, and accounts for the time-varying characteristics of the data. These three features allow the system to handle large and dynamic data. The effectiveness of the proposed system is validated on both synthetic and real-world problems. The experiments illustrate the viability of the proposed learning technique, and exemplifies how it can outperform existing NFS. Experiment on real-world stock price forecasting shows a remarkable reduction of error rate by 15.4%.

[1]  M. Emin Yüksel,et al.  A simple neuro-fuzzy impulse detector for efficient blur reduction of impulse noise removal operators for digital images , 2004, IEEE Transactions on Fuzzy Systems.

[2]  Michael J. Watts,et al.  A Decade of Kasabov's Evolving Connectionist Systems: A Review , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[3]  D. Ruppert The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[4]  Ebrahim Mamdani,et al.  Applications of fuzzy algorithms for control of a simple dynamic plant , 1974 .

[5]  Pedro Larrañaga,et al.  A review of feature selection techniques in bioinformatics , 2007, Bioinform..

[6]  D.P. Filev,et al.  An approach to online identification of Takagi-Sugeno fuzzy models , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[7]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[8]  Hiok Chai Quek,et al.  FCMAC-Yager: A Novel Yager-Inference-Scheme-Based Fuzzy CMAC , 2006, IEEE Transactions on Neural Networks.

[9]  Ruowei Zhou,et al.  The POP learning algorithms: reducing work in identifying fuzzy rules , 2001, Neural Networks.

[10]  M. Farid Golnaraghi,et al.  A neuro-fuzzy approach to gear system monitoring , 2004, IEEE Transactions on Fuzzy Systems.

[11]  Nikola K. Kasabov,et al.  Evolving fuzzy neural networks for supervised/unsupervised online knowledge-based learning , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[12]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Hiok Chai Quek,et al.  A Novel Blood Glucose Regulation Using TSK$^{0}$-FCMAC: A Fuzzy CMAC Based on the Zero-Ordered TSK Fuzzy Inference Scheme , 2009, IEEE Transactions on Neural Networks.

[14]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[15]  Giovanna Castellano,et al.  A neuro-fuzzy network to generate human-understandable knowledge from data , 2002, Cognitive Systems Research.

[16]  Chai Quek,et al.  Enhancing Decision Support System with Neural Fuzzy Model and Simple Model Visualizations , 2010 .

[17]  See-Kiong Ng,et al.  Evolving ensemble of fuzzy models , 2011, 2011 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2011).

[18]  Lotfi A. Zadeh,et al.  Fuzzy logic, neural networks, and soft computing , 1993, CACM.

[19]  Toshio Fukuda,et al.  Neuro-fuzzy control of a robotic exoskeleton with EMG signals , 2004, IEEE Transactions on Fuzzy Systems.

[20]  M. Sugeno,et al.  A review and comparison of six reasoning methods , 1993 .

[21]  David C. Tam,et al.  Theoretical Analysis of Cross-Correlation of Time-Series Signals Computed by a Time-Delayed Hebbian Associative Learning Neural Network , 2007 .

[22]  Cuntai Guan,et al.  FAPOP: Feature analysis enhanced pseudo outer-product fuzzy rule identification system , 2011, 2011 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2011).

[23]  Lotfi A. Zadeh,et al.  Fuzzy Logic , 2009, Encyclopedia of Complexity and Systems Science.

[24]  C. S. George Lee,et al.  Neural fuzzy systems: a neuro-fuzzy synergism to intelligent systems , 1996 .

[25]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[26]  Kai Keng Ang,et al.  RSPOP: Rough SetBased Pseudo Outer-Product Fuzzy Rule Identification Algorithm , 2005, Neural Computation.

[27]  Luigi Fortuna,et al.  Soft Sensors for Monitoring and Control of Industrial Processes (Advances in Industrial Control) , 2006 .

[28]  Ferenc Szeifert,et al.  Data-driven generation of compact, accurate, and linguistically sound fuzzy classifiers based on a decision-tree initialization , 2003, Int. J. Approx. Reason..

[29]  S. Schor STATISTICS: AN INTRODUCTION. , 1965, The Journal of trauma.

[30]  Nassim Nicholas Taleb Fooled by randomness : the hidden role of chance in the markets and in life , 2001 .

[31]  W S McCulloch,et al.  A logical calculus of the ideas immanent in nervous activity , 1990, The Philosophy of Artificial Intelligence.

[32]  Nikola K. Kasabov,et al.  HyFIS: adaptive neuro-fuzzy inference systems and their application to nonlinear dynamical systems , 1999, Neural Networks.

[33]  Wen Yu,et al.  Hierarchical Fuzzy CMAC for Nonlinear Systems Modeling , 2008, IEEE Transactions on Fuzzy Systems.

[34]  Arthur K. Kordon,et al.  Variable Selection in Industrial Datasets Using Pareto Genetic Programming , 2006 .

[35]  Paramasivan Saratchandran,et al.  Sequential Adaptive Fuzzy Inference System (SAFIS) for nonlinear system identification and prediction , 2006, Fuzzy Sets Syst..

[36]  Narasimhan Sundararajan,et al.  A generalized growing and pruning RBF (GGAP-RBF) neural network for function approximation , 2005, IEEE Transactions on Neural Networks.

[37]  R. Preisendorfer,et al.  Principal Component Analysis in Meteorology and Oceanography , 1988 .