Feature Selection in Decision Systems Based on Conditional Knowledge Granularity

Feature selection is an important technique for dimension reduction in machine learning and pattern recognition communities. Feature evaluation functions play essential roles in constructing feature selection algorithms. This paper introduces a new notion of knowledge granularity, called conditional knowledge granularity, reflecting relationship between conditional attributes and decision attribute. An evaluation function to measure significance of conditional attributes is proposed and equivalent characterization of attribute reduction is established based on the conditional knowledge granularity. An optimal algorithm for feature selection is developed on the basis of the proposed evaluation function. Furthermore, a novel approach to performing feature selection in an inconsistent decision system is put forward through establishing a rough communication between the inconsistent decision system and a consistent decision system. Simulated experiments verifies feasibility and efficiency of the proposed tech...

[1]  Qiang Shen,et al.  Exploring the boundary region of tolerance rough sets for feature selection , 2009, Pattern Recognit..

[2]  Geert Wets,et al.  A rough sets based characteristic relation approach for dynamic attribute generalization in data mining , 2007, Knowl. Based Syst..

[3]  Z. Pawlak.  Rough Sets: Theoretical Aspects of Reasoning about Data , 1991 .

[4]  Wen-Yau Liang,et al.  Rough Sets as a Knowledge Discovery and Classification Tool for the Diagnosis of Students with Learning Disabilities , 2011, Int. J. Comput. Intell. Syst..

[5]  Feifei Xu,et al.  Fuzzy-rough attribute reduction via mutual information with an application to cancer classification , 2009, Comput. Math. Appl..

[6]  Jiye Liang,et al.  On the evaluation of the decision performance of an incomplete decision table , 2008, Data Knowl. Eng..

[7]  Lech Polkowski,et al.  On Knowledge Granulation and Applications to Classifier Induction in the Framework of Rough Mereology , 2009 .

[8]  Zdzislaw Pawlak,et al.  Some remarks on conflict analysis , 2005, Eur. J. Oper. Res..

[9]  Henk J. A. M. Heijmans,et al.  Grey-Scale Morphology Based on Fuzzy Logic , 2002, Journal of Mathematical Imaging and Vision.

[10]  Inés Couso,et al.  Mutual information-based feature selection and partition design in fuzzy rule-based classifiers from vague data , 2008, Int. J. Approx. Reason..

[11]  Mark van der Gaag,et al.  The five-factor model of the Positive and Negative Syndrome Scale II: A ten-fold cross-validation of a revised model , 2006, Schizophrenia Research.

[12]  Qinghua Hu,et al.  Information entropy for ordinal classification , 2010, Science China Information Sciences.

[13]  Cong Wu,et al.  Communicating between information systems , 2008, Inf. Sci..

[14]  Wang Ju,et al.  Reduction algorithms based on discernibility matrix: The ordered attributes method , 2001, Journal of Computer Science and Technology.

[15]  Yiyu Yao,et al.  Discernibility matrix simplification for constructing attribute reducts , 2009, Inf. Sci..

[16]  Qiang Shen,et al.  New Approaches to Fuzzy-Rough Feature Selection , 2009, IEEE Transactions on Fuzzy Systems.

[17]  Qinghua Hu,et al.  Neighborhood classifiers , 2008, Expert Syst. Appl..

[18]  Andrzej Skowron,et al.  The Discernibility Matrices and Functions in Information Systems , 1992, Intelligent Decision Support.

[19]  Martin Riera-Guasp,et al.  Feature Extraction for the Prognosis of Electromechanical Faults in Electrical Machines through the DWT , 2009 .

[20]  Wojciech Ziarko,et al.  Variable Precision Rough Set Model , 1993, J. Comput. Syst. Sci..

[21]  Yiyu Yao,et al.  Three-way Investment Decisions with Decision-theoretic Rough Sets , 2011, Int. J. Comput. Intell. Syst..

[22]  Shuchita Upadhyaya,et al.  Reduct Driven Pattern Extraction from Clusters , 2009 .

[23]  Jiye Liang,et al.  The Information Entropy, Rough Entropy And Knowledge Granulation In Rough Set Theory , 2004, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[24]  Lech Polkowski,et al.  On Knowledge Granulation and Applications to Classifier Induction in the Framework of Rough Mereology , 2009, Int. J. Comput. Intell. Syst..

[25]  Dominik Slezak,et al.  Degrees of conditional (in)dependence: A framework for approximate Bayesian networks and examples related to the rough set-based feature selection , 2009, Inf. Sci..

[26]  W. Zakowski.  APPROXIMATIONS IN THE SPACE (U,π) , 1983 .

[27]  Xun Gong,et al.  Expression Detection Based on a Novel Emotion Recognition Method , 2011, Int. J. Comput. Intell. Syst..

[28]  Geert Wets,et al.  Intelligent Data Mining: Techniques and Applications (Studies in Computational Intelligence) , 2005 .

[29]  Qinghua Hu,et al.  Hybrid attribute reduction based on a novel fuzzy-rough model and information granulation , 2007, Pattern Recognit..

[30]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[31]  Ching-Hsue Cheng,et al.  Entropy-based fuzzy rough classification approach for extracting classification rules , 2006, Expert Syst. Appl..

[32]  Alfredo Petrosino,et al.  Rough fuzzy set-based image compression , 2009, Fuzzy Sets Syst..

[33]  Yaonan Wang,et al.  Rough neural network modeling based on fuzzy rough model and its application to texture classification , 2009, Neurocomputing.

[34]  Qiang Shen,et al.  Selecting informative features with fuzzy-rough sets and its application for complex systems monitoring , 2004, Pattern Recognit..

[35]  Jacek M. Zurada,et al.  Normalized Mutual Information Feature Selection , 2009, IEEE Transactions on Neural Networks.

[36]  Loris Nanni,et al.  Ensemble generation and feature selection for the identification of students with learning disabilities , 2009, Expert Syst. Appl..

[37]  Sankar K. Pal,et al.  Roughness of a Fuzzy Set , 1996, Inf. Sci..

[38]  Edoardo Amaldi,et al.  On the Approximability of Minimizing Nonzero Variables or Unsatisfied Relations in Linear Systems , 1998, Theor. Comput. Sci..

[39]  Lei Liu,et al.  Feature selection with dynamic mutual information , 2009, Pattern Recognit..

[40]  Janusz Zalewski,et al.  Rough sets: Theoretical aspects of reasoning about data , 1996 .

[41]  Pornthep Rojanavasu,et al.  Estimating Optimal Feature Subsets Using Mutual Information Feature Selector and Rough Sets , 2009, PAKDD.

[42]  Subhadip Basu,et al.  Text line extraction from multi-skewed handwritten documents , 2007, Pattern Recognit..

[43]  Geert Wets,et al.  Intelligent Data Mining , 2005 .

[44]  Ming-Chi Lee,et al.  Using support vector machine with a hybrid feature selection method to the stock trend prediction , 2009, Expert Syst. Appl..

[45]  Philippe Fortemps,et al.  Multicriteria decision support using rules that represent rough-graded preference relations , 2008, Eur. J. Oper. Res..

[46]  S. Nanda,et al.  Fuzzy rough sets , 1992 .

[47]  Shi Kai-quan,et al.  S-rough sets and the discovery of F-hiding knowledge , 2008 .

[48]  Andrzej Skowron,et al.  Rough set methods in feature selection and recognition , 2003, Pattern Recognit. Lett..

[49]  Huan Liu,et al.  Efficient Feature Selection via Analysis of Relevance and Redundancy , 2004, J. Mach. Learn. Res..

[50]  Qionghai Dai,et al.  A novel approach to fuzzy rough sets based on a fuzzy covering , 2007, Inf. Sci..

[51]  Qinghua Hu,et al.  Neighborhood rough set based heterogeneous feature subset selection , 2008, Inf. Sci..

[52]  Rajen B. Bhatt,et al.  On fuzzy-rough sets approach to feature selection , 2005, Pattern Recognit. Lett..

[53]  Lotfi A. Zadeh,et al.  Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic , 1997, Fuzzy Sets Syst..

[54]  Jiye Liang,et al.  Measures for evaluating the decision performance of a decision table in rough set theory , 2008, Inf. Sci..

[55]  Wei-Zhi Wu,et al.  Attribute reduction based on evidence theory in incomplete decision systems , 2008, Inf. Sci..

[56]  Jerzy W. Grzymala-Busse,et al.  Rough Sets , 1995, Commun. ACM.

[57]  Jiye Liang,et al.  A new measure of uncertainty based on knowledge granulation for rough sets , 2009, Inf. Sci..