Feature Reduction with Inconsistency

Feature selection is a classical problem in machine learning, and how to design a method to select the features that can contain all the internal semantic correlation of the original feature set is a challenge. The authors present a general approach to select features via rough set based reduction, which can keep the selected features with the same semantic correlation as the original feature set. A new concept named inconsistency is proposed, which can be used to calculate the positive region easily and quickly with only linear temporal complexity. Some properties of inconsistency are also given, such as the monotonicity of inconsistency and so forth. The authors also propose three inconsistency based attribute reduction generation algorithms with different search policies. Finally, a "mini-saturation" bias is presented to choose the proper reduction for further predictive designing.

[1]  Yingxu Wang,et al.  Semantic Manipulations and Formal Ontology for Machine Learning based on Concept Algebra , 2011, Int. J. Cogn. Informatics Nat. Intell..

[2]  D. Davis.  Visions of mind : architectures for cognition and affect , 2005 .

[3]  Thomas G. Dietterich,et al.  Learning Boolean Concepts in the Presence of Many Irrelevant Features , 1994, Artif. Intell..

[4]  Djamel-Eddine Saïdouni,et al.  A New Quantum Evolutionary Algorithm with Sifting Strategy for Binary Decision Diagram Ordering Problem , 2010, Int. J. Cogn. Informatics Nat. Intell..

[5]  Pat Langley,et al.  Selection of Relevant Features and Examples in Machine Learning , 1997, Artif. Intell..

[6]  Cindy Mason,et al.  Affective Computing and Interaction: Psychological, Cognitive and Neuroscientific Perspectives , 2012 .

[7]  Leonid Perlovsky.  Modeling Field Theory of Higher Cognitive Functions , 2007 .

[8]  Michel Aubé,et al.  Beyond Needs: Emotions and the Commitments Requirements , 2005 .

[9]  Igor Kononenko,et al.  Estimating Attributes: Analysis and Extensions of RELIEF , 1994, ECML.

[10]  Tsau Young Lin,et al.  Feature Subset Selection Based on Relative Dependency between Attributes , 2004, Rough Sets and Current Trends in Computing.

[11]  Z. Pawlak.  Rough Sets: Theoretical Aspects of Reasoning about Data , 1991 .

[12]  Yingxu Wang.  Discoveries and Breakthroughs in Cognitive Informatics and Natural Intelligence (Advances in Cognitive Informatics and Natural Intelligence (Acini) Book Series) , 2009 .

[13]  Qiang Shen,et al.  Semantics-preserving dimensionality reduction: rough and fuzzy-rough-based approaches , 2004, IEEE Transactions on Knowledge and Data Engineering.

[14]  Yingxu Wang.  Cognitive Informatics for Revealing Human Cognition: Knowledge Manipulations in Natural Intelligence , 2012 .

[15]  Ning Zhong,et al.  Using Rough Sets with Heuristics for Feature Selection , 1999, Journal of Intelligent Information Systems.

[16]  Xiaofeng Liao,et al.  A Novel Approach for Designing Dynamical S-Boxes Using Hyperchaotic System , 2012, Int. J. Cogn. Informatics Nat. Intell..

[17]  Wayne Niblack,et al.  A modeling approach to feature selection , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[18]  Andrzej Skowron,et al.  Rough set methods in feature selection and recognition , 2003, Pattern Recognit. Lett..

[19]  Yingxu Wang.  Developments in Natural Intelligence Research and Knowledge Engineering: Advancing Applications , 2012 .

[20]  Zhongzhi Shi,et al.  A Novel Plausible Model for Visual Perception , 2008, Int. J. Cogn. Informatics Nat. Intell..

[21]  Chu Jian.  Quick Attribute Reduction Algorithm with Hash , 2009 .

[22]  Huan Liu,et al.  Consistency-based search in feature selection , 2003, Artif. Intell..

[23]  Takuya Maekawa,et al.  The Event Search Engine , 2010, Int. J. Cogn. Informatics Nat. Intell..

[24]  Claire Cardie,et al.  Using Decision Trees to Improve Case-Based Learning , 1993, ICML.

[25]  Krzysztof Krawiec,et al.  ROUGH SET REDUCTION OF ATTRIBUTES AND THEIR DOMAINS FOR NEURAL NETWORKS , 1995, Comput. Intell..

[26]  Xiaohua Hu.  Knowledge discovery in databases: an attribute-oriented rough set approach , 1996 .

[27]  T. Gevers,et al.  Communication and Automatic Interpretation of Affect from Facial Expressions , 2010 .

[28]  David A. Bell,et al.  A Formalism for Relevance and Its Application in Feature Subset Selection , 2000, Machine Learning.

[29]  Yingxu Wang,et al.  An Operational Semantics of Real-Time Process Algebra (RTPA) , 2008, Int. J. Cogn. Informatics Nat. Intell..

[30]  Qinghua Hu,et al.  Consistency Based Attribute Reduction , 2007, PAKDD.

[31]  Tsau Young Lin,et al.  Heuristically Fast Finding of the Shortest Reducts , 2004, Rough Sets and Current Trends in Computing.