Feature selection of spectral dimension by hyperspectral remote sensing images based on genetic algorithm and support vector machine

An algorithm is presented for deriving an optimal features classified with a support vector machine. The approach is based on direct objective optimization which is approximated by the selection of appropriate features as the SVM learning predictor in a regularized learning framework. To process the regularized learning, a genetic method provides a learning rule for in an outer loop of an iteration, while at each iteration training predictor model using gradient descent is to gradually added the feature into improving the existing model. The inner loop is heuristic to perform support vector machine training and provide support vector coefficients on which the gradient descent depends. The experiment was conduced on the Airborne Visible/Infrared Imaging Spectrometer(AVIRIS) data for classification. The result shows that the feature selection of spectral dimension and support vector machine are jointly optimized.

[1]  Sayan Mukherjee,et al.  Feature Selection for SVMs , 2000, NIPS.

[2]  Ron Kohavi,et al.  Irrelevant Features and the Subset Selection Problem , 1994, ICML.

[3]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[4]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[5]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[6]  Lawrence Carin,et al.  An EM Algorithm for Joint Feature Selection and Classifier Design 1 , 2003 .

[7]  Jeff Fortuna,et al.  An Optimal Basis for Feature Extraction With Support Vector Machine Classification Using The Radius–Margin Bound , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[8]  Sayan Mukherjee,et al.  Choosing Multiple Parameters for Support Vector Machines , 2002, Machine Learning.

[9]  James Theiler,et al.  Grafting: Fast, Incremental Feature Selection by Gradient Descent in Function Space , 2003, J. Mach. Learn. Res..

[10]  Kezhi Mao,et al.  Feature subset selection for support vector machines through discriminative function pruning analysis , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[11]  Paul S. Bradley,et al.  Feature Selection via Concave Minimization and Support Vector Machines , 1998, ICML.

[12]  Bernhard Schölkopf,et al.  Use of the Zero-Norm with Linear Models and Kernel Methods , 2003, J. Mach. Learn. Res..

[13]  Yves Grandvalet,et al.  Adaptive Scaling for Feature Selection in SVMs , 2002, NIPS.