Antecedent selection in fuzzy rule interpolation using feature selection techniques

Fuzzy rule interpolation offers a useful means for enhancing the robustness of fuzzy models by making inference possible in systems of only a sparse rule base. However in practical applications, the rule bases provided may contain irrelevant, redundant, or even misleading antecedents, which makes the already challenging tasks such as inference and interpolation even more difficult. The majority of the techniques developed in the literature assumes equal significance of rules and their antecedents, which may lead to biased or incorrect reasoning outcomes. This paper investigates similar problems being tackled in the area of feature selection, in an attempt to identify techniques that can be applied to measure the significance of rule antecedents. In particular, two feature evaluation methods based on correlation analysis and fuzzy-rough set theory have been examined, in order to reveal their effectiveness in determining the importance of individual antecedents, and their capabilities for discovering subsets of antecedents that provide similar reasoning accuracies as a larger set of antecedents used in the original rules. In addition, the significance values measured by the proposed method are treated as the weights associated with the relevant rule antecedents, in an effort to facilitate more appropriate selection of, and interactions with the rules in performing both forward and backward fuzzy rule interpolation via scale and move transformation-based methods. Experimental studies based on a practical scenario concerning terrorist activities and also synthetic random data are conducted, demonstrating the potential and efficacy of the proposed work.

[1]  Richard Jensen,et al.  Fuzzy-rough set based semi-supervised learning , 2011, 2011 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2011).

[2]  László T. Kóczy,et al.  Stability of interpolative fuzzy KH controllers , 2002, Fuzzy Sets Syst..

[3]  Mauro Birattari,et al.  The local paradigm for modeling and control: from neuro-fuzzy to lazy learning , 2001, Fuzzy Sets Syst..

[4]  László T. Kóczy,et al.  Interpolative reasoning with insufficient evidence in sparse fuzzy rule bases , 1993, Inf. Sci..

[5]  Hiroshi Motoda,et al.  Book Review: Computational Methods of Feature Selection , 2007, The IEEE intelligent informatics bulletin.

[6]  László T. Kóczy,et al.  Approximate reasoning by linear rule interpolation and general approximation , 1993, Int. J. Approx. Reason..

[7]  Shiliang Zhang,et al.  Correlation-Based Feature Selection and Regression , 2010, PCM.

[8]  Qiang Shen,et al.  Feature Selection With Harmony Search , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  Qiang Shen,et al.  Fuzzy interpolative reasoning via scale and move transformations , 2006, IEEE Transactions on Fuzzy Systems.

[10]  Marko Robnik-Sikonja,et al.  Overcoming the Myopia of Inductive Learning Algorithms with RELIEFF , 2004, Applied Intelligence.

[11]  Qiang Shen,et al.  New Approaches to Fuzzy-Rough Feature Selection , 2009, IEEE Transactions on Fuzzy Systems.

[12]  Jidong Zhao,et al.  Locality sensitive semi-supervised feature selection , 2008, Neurocomputing.

[13]  Ronald R. Yager,et al.  On ordered weighted averaging aggregation operators in multicriteria decisionmaking , 1988, IEEE Trans. Syst. Man Cybern..

[14]  N. Ramaraj,et al.  A novel hybrid feature selection via Symmetrical Uncertainty ranking based local memetic search algorithm , 2010, Knowl. Based Syst..

[15]  Huan Liu,et al.  Consistency-based search in feature selection , 2003, Artif. Intell..

[16]  Vicenç Torra,et al.  Modeling decisions - information fusion and aggregation operators , 2007 .

[17]  Hiok Chai Quek,et al.  Backward Fuzzy Rule Interpolation , 2014, IEEE Transactions on Fuzzy Systems.

[18]  Jeng-Shyang Pan,et al.  Weighted Fuzzy Interpolative Reasoning Based on Weighted Increment Transformation and Weighted Ratio Transformation Techniques , 2009, IEEE Transactions on Fuzzy Systems.

[19]  Hiok Chai Quek,et al.  Backward fuzzy rule interpolation with multiple missing values , 2013, 2013 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[20]  R. Tibshirani,et al.  "Preconditioning" for feature selection and regression in high-dimensional problems , 2007, math/0703858.

[21]  Ludmila I. Kuncheva,et al.  "Fuzzy" versus "nonfuzzy" in combining classifiers designed by Boosting , 2003, IEEE Trans. Fuzzy Syst..

[22]  Shyi-Ming Chen,et al.  Weighted Fuzzy Rule Interpolation Based on GA-Based Weight-Learning Techniques , 2011, IEEE Transactions on Fuzzy Systems.

[23]  Qiang Shen,et al.  Fuzzy Interpolation and Extrapolation: A Practical Approach , 2008, IEEE Transactions on Fuzzy Systems.

[24]  Qiang Shen,et al.  Backward fuzzy interpolation and extrapolation with multiple multi-antecedent rules , 2012, 2012 IEEE International Conference on Fuzzy Systems.

[25]  Tossapon Boongoen,et al.  Nearest-Neighbor Guided Evaluation of Data Reliability and Its Applications , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[26]  Richard Jensen,et al.  Measures for Unsupervised Fuzzy-Rough Feature Selection , 2009, ISDA.

[27]  Qiang Shen,et al.  Computational Intelligence and Feature Selection - Rough and Fuzzy Approaches , 2008, IEEE Press series on computational intelligence.

[28]  Szilveszter Kov cs Special Issue on Fuzzy Rule Interpolation , 2011 .

[29]  Jakub Wroblewski,et al.  Ensembles of Classifiers Based on Approximate Reducts , 2001, Fundam. Informaticae.