Fuzzy Knowledge-Based Prediction Through Weighted Rule Interpolation

Fuzzy rule interpolation (FRI) facilitates approximate reasoning in fuzzy rule-based systems only with sparse knowledge available, remedying the limitation of conventional compositional rule of inference working with a dense rule base. Most of the existing FRI work assumes equal significance of the conditional attributes in the rules while performing interpolation. Recently, interesting techniques have been reported for achieving weighted interpolative reasoning. However, they are either particularly tailored to perform classification problems only or employ attribute weights that are obtained using additional information (rather than just the given rules), without integrating them with the associated FRI procedure. This paper presents a weighted rule interpolation scheme for performing prediction tasks by the use of fuzzy sparse knowledge only. The weights of rule conditional attributes are learned from a given rule base to discriminate the relative significance of each individual attribute and are integrated throughout the internal mechanism of the FRI process. This scheme is demonstrated using the popular scale and move transformation-based FRI for resolving prediction problems, systematically evaluated on 12 benchmark prediction tasks. The performance is compared with the relevant state-of-the-art FRI techniques, showing the efficacy of the proposed approach.

[1]  Qiang Shen,et al.  Fuzzy Interpolation and Extrapolation: A Practical Approach , 2008, IEEE Transactions on Fuzzy Systems.

[2]  Kyung-shik Shin,et al.  An application of support vector machines in bankruptcy prediction model , 2005, Expert Syst. Appl..

[3]  Péter Baranyi,et al.  Comprehensive analysis of a new fuzzy rule interpolation method , 2000, IEEE Trans. Fuzzy Syst..

[4]  Qiang Shen,et al.  Dynamic Fuzzy Rule Interpolation and Its Application to Intrusion Detection , 2018, IEEE Transactions on Fuzzy Systems.

[5]  Hiok Chai Quek,et al.  Backward Fuzzy Rule Interpolation , 2014, IEEE Transactions on Fuzzy Systems.

[6]  E.C.C. Tsang,et al.  Weighted fuzzy interpolative reasoning method , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[7]  Ying Li,et al.  Rough-fuzzy rule interpolation , 2016, Inf. Sci..

[8]  Pei-Chann Chang,et al.  A TSK type fuzzy rule based system for stock price prediction , 2008, Expert Syst. Appl..

[9]  Shyi-Ming Chen,et al.  Weighted Fuzzy Rule Interpolation Based on GA-Based Weight-Learning Techniques , 2011, IEEE Transactions on Fuzzy Systems.

[10]  Nikola K. Kasabov,et al.  DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction , 2002, IEEE Trans. Fuzzy Syst..

[11]  Wei Wang,et al.  Adaptive Granulation-Based Prediction for Energy System of Steel Industry , 2018, IEEE Transactions on Cybernetics.

[12]  László T. Kóczy,et al.  A generalized concept for fuzzy rule interpolation , 2004, IEEE Transactions on Fuzzy Systems.

[13]  Igor Kononenko,et al.  Estimating Attributes: Analysis and Extensions of RELIEF , 1994, ECML.

[14]  Churn-Jung Liau,et al.  Fuzzy Interpolative Reasoning for Sparse Fuzzy-Rule-Based Systems Based on the Areas of Fuzzy Sets , 2008, IEEE Transactions on Fuzzy Systems.

[15]  László T. Kóczy,et al.  Approximate reasoning by linear rule interpolation and general approximation , 1993, Int. J. Approx. Reason..

[16]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[17]  C.J.H. Mann,et al.  Clinical Prediction Models: A Practical Approach to Development, Validation and Updating , 2009 .

[18]  Giorgio Roffo,et al.  Feature Selection Library (MATLAB Toolbox) , 2016, 1607.01327.

[19]  László T. Kóczy,et al.  Interpolative reasoning with insufficient evidence in sparse fuzzy rule bases , 1993, Inf. Sci..

[20]  Luming Zhang,et al.  Camera-Assisted Video Saliency Prediction and Its Applications , 2018, IEEE Transactions on Cybernetics.

[21]  Qiang Shen,et al.  Fuzzy interpolative reasoning via scale and move transformations , 2006, IEEE Transactions on Fuzzy Systems.

[22]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[23]  Qiang Shen,et al.  New Approaches to Fuzzy-Rough Feature Selection , 2009, IEEE Transactions on Fuzzy Systems.

[24]  Huan Liu,et al.  Consistency-based search in feature selection , 2003, Artif. Intell..

[25]  Ying Li,et al.  Fuzzy Rule Based Interpolative Reasoning Supported by Attribute Ranking , 2018, IEEE Transactions on Fuzzy Systems.

[26]  J. Bezdek,et al.  FCM: The fuzzy c-means clustering algorithm , 1984 .

[27]  Lotfi A. Zadeh,et al.  Outline of a New Approach to the Analysis of Complex Systems and Decision Processes , 1973, IEEE Trans. Syst. Man Cybern..

[28]  Fei Chao,et al.  Generalized Adaptive Fuzzy Rule Interpolation , 2017, IEEE Transactions on Fuzzy Systems.

[29]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[30]  Yiu-ming Cheung,et al.  Feature Selection and Kernel Learning for Local Learning-Based Clustering , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Yeung Yam,et al.  Interpolation with function space representation of membership functions , 2006, IEEE Transactions on Fuzzy Systems.

[32]  Tossapon Boongoen,et al.  Disclosing false identity through hybrid link analysis , 2010, Artificial Intelligence and Law.

[33]  R. Scott Crowder,et al.  Predicting the Mackey-Glass Timeseries With Cascade-Correlation Learning , 1990 .

[34]  Qiang Shen,et al.  Antecedent selection in fuzzy rule interpolation using feature selection techniques , 2014, 2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[35]  Tie Qiu,et al.  Hybrid Regularized Echo State Network for Multivariate Chaotic Time Series Prediction , 2019, IEEE Transactions on Cybernetics.

[36]  Jesús Alcalá-Fdez,et al.  KEEL Data-Mining Software Tool: Data Set Repository, Integration of Algorithms and Experimental Analysis Framework , 2011, J. Multiple Valued Log. Soft Comput..

[37]  Shyi-Ming Chen,et al.  Weighted fuzzy interpolative reasoning for sparse fuzzy rule-based systems based on piecewise fuzzy entropies of fuzzy sets , 2016, Inf. Sci..

[38]  Deng Cai,et al.  Laplacian Score for Feature Selection , 2005, NIPS.

[39]  Jeng-Shyang Pan,et al.  Weighted Fuzzy Interpolative Reasoning Based on Weighted Increment Transformation and Weighted Ratio Transformation Techniques , 2009, IEEE Transactions on Fuzzy Systems.

[40]  Simon J. Godsill,et al.  Bayesian Intent Prediction in Object Tracking Using Bridging Distributions , 2015, IEEE Transactions on Cybernetics.

[41]  Shyi-Ming Chen,et al.  Fuzzy interpolative reasoning based on ranking values of polygonal fuzzy sets and automatically generated weights of fuzzy rules , 2015, Inf. Sci..