Dynamic feature selection with fuzzy-rough sets

Various strategies have been exploited for the task of feature selection, in an effort to identify more compact and better quality feature subsets. Most existing approaches focus on selecting from a static pool of training instances with a fixed number of original features. However, in practice, data may be gradually refined, and information regarding the problem domain may be actively added or removed. In this paper, a technique based on fuzzy-rough sets is extended to support dynamic feature selection. The proposed method is capable of carrying out on-line selection with incrementally added features or instances. Also, the cases of feature or instance removal are investigated. This brings a novel and beneficial addition to the current research in feature selection. Four possible dynamic selection scenarios are considered, with algorithms proposed in order to handle such individual situations. Simulated experimentation is carried out using real world benchmark data sets, in order to demonstrate the efficacy of the proposed work.

[1]  Qiang Shen,et al.  A Distance Measure Approach to Exploring the Rough Set Boundary Region for Attribute Reduction , 2010, IEEE Transactions on Knowledge and Data Engineering.

[2]  Qiang Shen,et al.  New Approaches to Fuzzy-Rough Feature Selection , 2009, IEEE Transactions on Fuzzy Systems.

[3]  Hiroshi Motoda,et al.  Computational Methods of Feature Selection , 2022 .

[4]  ´ RaSantos-Rodr Cost-sensitive feature selection based on the Set Covering Machine , 2010 .

[5]  Michael I. Jordan,et al.  Feature selection for high-dimensional genomic microarray data , 2001, ICML.

[6]  Xiangyang Wang,et al.  Feature selection based on rough sets and particle swarm optimization , 2007, Pattern Recognit. Lett..

[7]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[8]  Chris Cornelis,et al.  Fuzzy-rough instance selection , 2010, International Conference on Fuzzy Systems.

[9]  Rafail Ostrovsky,et al.  Optimal sampling from sliding windows , 2012, J. Comput. Syst. Sci..

[10]  Reyer Zwiggelaar,et al.  Fuzzy-rough approaches for mammographic risk analysis , 2010, Intell. Data Anal..

[11]  Won Suk Lee,et al.  Finding recently frequent itemsets adaptively over online transactional data streams, , 2006, Inf. Syst..

[12]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[13]  Rong Jin,et al.  Online feature selection for mining big data , 2012, BigMine '12.

[14]  Babak Falsafi,et al.  Dynamic feature selection for hardware prediction , 2006, J. Syst. Archit..

[15]  Yafei Wang,et al.  A dynamic feature selection method based on combination of GA with K-means , 2010, 2010 The 2nd International Conference on Industrial Mechatronics and Automation.

[16]  N. Ramaraj,et al.  A novel hybrid feature selection via Symmetrical Uncertainty ranking based local memetic search algorithm , 2010, Knowl. Based Syst..

[17]  Huan Liu,et al.  Consistency-based search in feature selection , 2003, Artif. Intell..

[18]  Chun-Nan Hsu,et al.  The ANNIGMA-wrapper approach to fast feature selection for neural nets , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[19]  Qiang Shen,et al.  Selecting informative features with fuzzy-rough sets and its application for complex systems monitoring , 2004, Pattern Recognit..

[20]  Qiang Shen,et al.  Feature Selection With Harmony Search , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[21]  Qiang Shen,et al.  Computational Intelligence and Feature Selection - Rough and Fuzzy Approaches , 2008, IEEE Press series on computational intelligence.

[22]  Didier Dubois,et al.  Putting Rough Sets and Fuzzy Sets Together , 1992, Intelligent Decision Support.

[23]  Changjing Shang,et al.  Support vector machine-based classification of rock texture images aided by efficient feature selection , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[24]  Qiang Shen,et al.  A rough-fuzzy approach for generating classification rules , 2002, Pattern Recognit..

[25]  Hao Wang,et al.  Online Feature Selection with Streaming Features , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Qiang Shen,et al.  Are More Features Better? A Response to Attributes Reduction Using Fuzzy Rough Sets , 2009, IEEE Transactions on Fuzzy Systems.