Feature Selection: Evaluation, Application, and Small Sample Performance

A large number of algorithms have been proposed for feature subset selection. Our experimental results show that the sequential forward floating selection algorithm, proposed by Pudil et al. (1994), dominates the other algorithms tested. We study the problem of choosing an optimal feature set for land use classification based on SAR satellite images using four different texture models. Pooling features derived from different texture models, followed by a feature selection results in a substantial improvement in the classification accuracy. We also illustrate the dangers of using feature selection in small sample size situations.

[1]  Anil K. Jain,et al.  Unsupervised texture segmentation using Gabor filters , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[2]  Gerard V. Trunk,et al.  A Problem of Dimensionality: A Simple Example , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Jan M. Van Campenhout,et al.  On the Possible Orderings in the Measurement Selection Problem , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[4]  Y. Chien,et al.  Pattern classification and scene analysis , 1974 .

[5]  Anil K. Jain,et al.  Small Sample Size Effects in Statistical Pattern Recognition: Recommendations for Practitioners , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Jack Sklansky,et al.  On Automatic Feature Selection , 1988, Int. J. Pattern Recognit. Artif. Intell..

[7]  Jian Fan,et al.  Texture Classification by Wavelet Packet Signatures , 1993, MVA.

[8]  Keinosuke Fukunaga,et al.  A Branch and Bound Algorithm for Feature Subset Selection , 1977, IEEE Transactions on Computers.

[9]  Anil K. Jain,et al.  Image retrieval using color and shape , 1996, Pattern Recognit..

[10]  Yoshihiko Hamamoto,et al.  Evaluation of the branch and bound algorithm for feature selection , 1990, Pattern Recognit. Lett..

[11]  Rangasami L. Kashyap,et al.  A Model-Based Method for Rotation Invariant Texture Classification , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  A. K. Jain,et al.  A study of the invariance properties of textural features in SAR images , 1995, 1995 International Geoscience and Remote Sensing Symposium, IGARSS '95. Quantitative Remote Sensing for Science and Applications.

[13]  John G. Daugman,et al.  Complete discrete 2-D Gabor transforms by neural networks for image analysis and compression , 1988, IEEE Trans. Acoust. Speech Signal Process..

[14]  Anil K. Jain,et al.  39 Dimensionality and sample size considerations in pattern recognition practice , 1982, Classification, Pattern Recognition and Reduction of Dimensionality.

[15]  André Gagalowicz,et al.  Blind texture segmentation , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[16]  J. Kittler,et al.  Feature Set Search Alborithms , 1978 .

[17]  Anil K. Jain,et al.  Parsimonious network design and feature selection through node pruning , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[18]  Jack Sklansky,et al.  A note on genetic algorithms for large-scale feature selection , 1989, Pattern Recognit. Lett..

[19]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[20]  Yehoshua Y. Zeevi,et al.  The Generalized Gabor Scheme of Image Representation in Biological and Machine Vision , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[22]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[23]  Peter E. Hart,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[24]  R. M. Haralick,et al.  Textural features for image classification. IEEE Transaction on Systems, Man, and Cybernetics , 1973 .

[25]  M.,et al.  Statistical and Structural Approaches to Texture , 2022 .

[26]  Richard J. Enbody,et al.  Further Research on Feature Selection and Classification Using Genetic Algorithms , 1993, ICGA.

[27]  Francesc J. Ferri,et al.  Comparative study of techniques for large-scale feature selection* *This work was suported by a SERC grant GR/E 97549. The first author was also supported by a FPI grant from the Spanish MEC, PF92 73546684 , 1994 .

[28]  C. H. Chen,et al.  A Study of Texture Classification Using Spectral Features , 1982 .

[29]  Baozong Yuan,et al.  A more efficient branch and bound algorithm for feature selection , 1993, Pattern Recognit..

[30]  Rama Chellappa,et al.  Estimation and choice of neighbors in spatial-interaction models of images , 1983, IEEE Trans. Inf. Theory.

[31]  Anil K. Jain,et al.  Performance evaluation of shape matching via chord length distribution , 1984, Comput. Vis. Graph. Image Process..