Selection of ICA Features for Texture Classification

In the literature of texture analysis, research has been focused on the issue of feature extraction. Much less attention has been given to the important issue of feature selection, however. Most of the methods rank the features by some criteria, for instance, the eigenvalues and the Fish Criterion, and select some percentage of the top features. In this paper, we propose a feature selection scheme for texture classification. We use the filter bank obtained by independent component analysis (ICA) of nature scenes for multichannel feature extraction and the least squares support vector machine (LS-SVM) for classification. The dimension of the ICA features is first reduced using principal component analysis (PCA). Recursive feature elimination (RFE) is then employed to select the relevant features for LS-SVM classification. Our experimental results show that the proposed method achieves better classification accuracy than the simple PCA and the Fisher Criterion methods.

[1]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[2]  Hanqing Lu,et al.  Texture representation based on pattern map , 2004, Signal Process..

[3]  Jason Weston,et al.  Gene Selection for Cancer Classification using Support Vector Machines , 2002, Machine Learning.

[4]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[5]  Michael Unser,et al.  Texture classification and segmentation using wavelet frames , 1995, IEEE Trans. Image Process..

[6]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[7]  Aapo Hyvärinen,et al.  A Fast Fixed-Point Algorithm for Independent Component Analysis , 1997, Neural Computation.

[8]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[9]  Nicolai Petkov,et al.  Comparison of texture features based on Gabor filters , 2002, IEEE Trans. Image Process..

[10]  E. Oja,et al.  Sparse code shrinkage for image denoising , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[11]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[12]  Robert Jenssen,et al.  ICA FILTER BANK FOR SEGMENTATION OF TEXTURED IMAGES , 2003 .

[13]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[14]  Nostrand Reinhold,et al.  the utility of using the genetic algorithm approach on the problem of Davis, L. (1991), Handbook of Genetic Algorithms. Van Nostrand Reinhold, New York. , 1991 .

[15]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[16]  Trygve Randen,et al.  Filtering for Texture Classification: A Comparative Study , 1999, IEEE Trans. Pattern Anal. Mach. Intell..