Simultaneous Features and Objects Selection for Mixed and Incomplete Data

In this paper a new simultaneous editing and feature selection method for the Most Similar Neighbor classifier is proposed. It is designed for databases with objects described by features no exclusively numeric or categorical. It is based on Testor Theory and the Compact Set Editing method, mixing edited projections until a good accuracy is achieved. Experimental results with several databases show a good performance compared to previous methods and the classifier using the original sample.

[1]  José Ruiz-Shulcloper,et al.  Selecting Prototypes in Mixed Incomplete Data , 2005, CIARP.

[2]  David B. Skalak,et al.  Prototype and Feature Selection by Sampling and Random Mutation Hill Climbing Algorithms , 1994, ICML.

[3]  J. Kittler,et al.  Feature Set Search Alborithms , 1978 .

[4]  Aurora Pons Porrata,et al.  LEX: un nuevo algoritmo para el cálculo de los testores típicos , 2003 .

[5]  Belur V. Dasarathy,et al.  Minimal consistent set (MCS) identification for optimal nearest neighbor decision systems design , 1994, IEEE Trans. Syst. Man Cybern..

[6]  José Ruiz-Shulcloper,et al.  Determining the feature relevance for non-classically described objects and a new algorithm to compute typical fuzzy testors , 1995, Pattern Recognit. Lett..

[7]  José Francisco Martínez-Trinidad,et al.  Progress in Pattern Recognition, Image Analysis and Applications, 12th Iberoamericann Congress on Pattern Recognition, CIARP 2007, Valparaiso, Chile, November 13-16, 2007, Proceedings , 2008, CIARP.

[8]  Godfried T. Toussaint,et al.  Proximity Graphs for Nearest Neighbor Decision Rules: Recent Progress , 2002 .

[9]  Lakhmi C. Jain,et al.  Nearest neighbor classifier: Simultaneous editing and feature selection , 1999, Pattern Recognit. Lett..

[10]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[11]  Hisao Ishibuchi,et al.  Evolution of Reference Sets in Nearest Neighbor Classification , 1998, SEAL.

[12]  José Ruiz-Shulcloper,et al.  Logical Combinatorial Pattern Recognition: A Review , 2002 .