Adaptive feature selection for hyperspectral data analysis

Hyperspectral data can potentially provide greatly improved capability for discrimination between many land cover types, but new methods are required to process these data and extract the required information. Data sets are extremely large, and the data are not well distributed across these high dimensional spaces. The increased number and resolution of spectral bands, many of which are highly correlated, is problematic for supervised statistical classification techniques when the number of training samples is small relative to the dimension of the input vector. Selection of the most relevant subset of features is one means of mitigating these effects. A new algorithm based on the tabu search metaheuristic optimization technique was developed to perform subset feature selection and implemented within a binary hierarchical tree framework. Results obtained using the new approach were compared to those from a greedy common greedy selection technique and to a Fisher discriminant based feature extraction method, both of which were implemented in the same binary hierarchical tree classification scheme. The tabu search based method generally yielded higher classification accuracies with lower variability than these other methods in experiments using hyperspectral data acquired by the EO-1 Hyperion sensor over the Okavango Delta of Botswana.

[1]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Joydeep Ghosh,et al.  GAMLS: a generalized framework for associative modular learning systems , 1999, Defense, Security, and Sensing.

[3]  Anil K. Jain,et al.  Feature Selection: Evaluation, Application, and Small Sample Performance , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Ron Kohavi,et al.  Irrelevant Features and the Subset Selection Problem , 1994, ICML.

[5]  Melba M. Crawford,et al.  Fusion of airborne polarimetric and interferometric SAR for classification of coastal environments , 1999, IEEE Trans. Geosci. Remote. Sens..

[6]  Joydeep Ghosh,et al.  Adaptive Feature Spaces For Land Cover Classification With Limited Ground Truth Data , 2004, Int. J. Pattern Recognit. Artif. Intell..

[7]  Andrew R. Webb,et al.  Statistical Pattern Recognition , 1999 .

[8]  Jack Sklansky,et al.  On Automatic Feature Selection , 1988, Int. J. Pattern Recognit. Artif. Intell..

[9]  Mineichi Kudo,et al.  Comparison of algorithms that select features for pattern classifiers , 2000, Pattern Recognit..

[10]  Joydeep Ghosh,et al.  Hierarchical Fusion of Multiple Classifiers for Hyperspectral Data Analysis , 2002, Pattern Analysis & Applications.

[11]  Jack Sklansky,et al.  A note on genetic algorithms for large-scale feature selection , 1989, Pattern Recognit. Lett..

[12]  P. Langley Selection of Relevant Features in Machine Learning , 1994 .

[13]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[14]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[15]  M. Crawford,et al.  Results from the EO‐1 experiment—A comparative study of Earth Observing‐1 Advanced Land Imager (ALI) and Landsat ETM+ data for land cover mapping in the Okavango Delta, Botswana , 2005 .

[16]  F. Glover HEURISTICS FOR INTEGER PROGRAMMING USING SURROGATE CONSTRAINTS , 1977 .

[17]  Hiroshi Motoda,et al.  Feature Extraction, Construction and Selection: A Data Mining Perspective , 1998 .

[18]  Hongbin Zhang,et al.  Feature selection using tabu search method , 2002, Pattern Recognit..

[19]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[20]  Fred W. Glover,et al.  Tabu search for dynamic routing communications network design , 1997, Telecommun. Syst..

[21]  Josef Kittler,et al.  An analysis of the Max-Min approach to feature selection and ordering , 1993, Pattern Recognit. Lett..

[22]  Donna Kay Korycinski,et al.  Investigating the use of tabu search to find near-optimal solutions in multiclassifier systems , 2003 .

[23]  David A. Landgrebe,et al.  Hyperspectral Image Data Analysis as a High Dimensional Signal Processing Problem , 2002 .

[24]  Fred W. Glover,et al.  Using tabu search to solve the Steiner tree-star problem in telecommunications network design , 1996, Telecommun. Syst..

[25]  Lorenzo Bruzzone,et al.  A new search algorithm for feature selection in hyperspectral remote sensing images , 2001, IEEE Trans. Geosci. Remote. Sens..

[26]  Bruce W. Colletti,et al.  Local search structure in the symmetric travelling salesperson problem under a general class of rearrangement neighborhoods , 2001, Appl. Math. Lett..

[27]  David A. Landgrebe,et al.  Information Extraction Principles and Methods for Multispectral and Hyperspectral Image Data , 1999 .

[28]  J. Barnes,et al.  Solving the job shop scheduling problem with tabu search , 1995 .

[29]  John Shepanski,et al.  Hyperion, a space-based imaging spectrometer , 2003, IEEE Trans. Geosci. Remote. Sens..