Dimensionality Reduction Based on Clonal Selection for Hyperspectral Imagery

A new stochastic search strategy inspired by the clonal selection theory in an artificial immune system is proposed for dimensionality reduction of hyperspectral remote-sensing imagery. The clonal selection theory is employed to describe the basic features of an immune response to an antigenic stimulus in order to meet the requirement of diversity in the antibody population. In our proposed strategy, dimensionality reduction is formulated as an optimization problem that searches an optimum with less number of features in a feature space. In line with this novel strategy, a feature subset search algorithm, clonal selection Feature-Selection (CSFS) algorithm, and a feature-weighting algorithm, Clonal-Selection Feature-Weighting (CSFW) algorithm, have been developed. In the CSFS, each solution is evolved in binary space, and the value of each bit is either 0 or 1, which indicates that the corresponding feature is either removed or selected, respectively. In CSFW, each antibody is directly represented by a string consisting of integer numbers and their corresponding weights. These algorithms are compared with the following four well-known algorithms: sequential forward selection, sequential forward floating selection, genetic-algorithm-based feature selection, and decision-boundary feature extraction using the hyperspectral remote-sensing imagery acquired by the Pushbroom Hyperspectral Imager and the Airborne Visible/Infrared Imaging Spectrometer, respectively. Experimental results demonstrate that CSFS and CSFW outperform other algorithms and hence provide effective new options for dimensionality reduction of hyperspectral remote-sensing imagery.

[1]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[2]  Keinosuke Fukunaga,et al.  A Branch and Bound Algorithm for Feature Subset Selection , 1977, IEEE Transactions on Computers.

[3]  G. Oster,et al.  Theoretical studies of clonal selection: minimal antibody repertoire size and reliability of self-non-self discrimination. , 1979, Journal of theoretical biology.

[4]  Philip H. Swain,et al.  Remote Sensing: The Quantitative Approach , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Jack Sklansky,et al.  On Automatic Feature Selection , 1988, Int. J. Pattern Recognit. Artif. Intell..

[6]  A. Perelson Immune Network Theory , 1989, Immunological reviews.

[7]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[8]  Jack Sklansky,et al.  A note on genetic algorithms for large-scale feature selection , 1989, Pattern Recognition Letters.

[9]  David A. Landgrebe,et al.  Feature Extraction Based on Decision Boundaries , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  David A. Landgrebe,et al.  Analyzing high-dimensional multispectral data , 1993, IEEE Trans. Geosci. Remote. Sens..

[11]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[12]  Lorenzo Bruzzone,et al.  An extension of the Jeffreys-Matusita distance to multiclass cases for feature selection , 1995, IEEE Trans. Geosci. Remote. Sens..

[13]  David A. Landgrebe,et al.  Decision boundary feature extraction for neural networks , 1997, IEEE Trans. Neural Networks.

[14]  G. Weisbuch,et al.  Immunology for physicists , 1997 .

[15]  Anil K. Jain,et al.  Feature Selection: Evaluation, Application, and Small Sample Performance , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[17]  David A. Landgrebe,et al.  Classification of High Dimensional Data , 1998 .

[18]  Song-Yop Hahn,et al.  A study on comparison of optimization performances between immune algorithm and other heuristic algorithms , 1998 .

[19]  D. Dasgupta Artificial Immune Systems and Their Applications , 1998, Springer Berlin Heidelberg.

[20]  Leandro Nunes de Castro,et al.  The Clonal Selection Algorithm with Engineering Applications 1 , 2000 .

[21]  Chein-I Chang,et al.  Unsupervised hyperspectral image analysis with projection pursuit , 2000, IEEE Trans. Geosci. Remote. Sens..

[22]  M. Eaman Immune system. , 2000, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[23]  Anil K. Jain,et al.  Dimensionality reduction using genetic algorithms , 2000, IEEE Trans. Evol. Comput..

[24]  Lorenzo Bruzzone,et al.  A technique for feature selection in multiclass problems , 2000 .

[25]  Lorenzo Bruzzone,et al.  A new search algorithm for feature selection in hyperspectral remote sensing images , 2001, IEEE Trans. Geosci. Remote. Sens..

[26]  Jonathan Timmis,et al.  Artificial Immune Systems: A New Computational Intelligence Approach , 2003 .

[27]  Fernando José Von Zuben,et al.  Learning and optimization using the clonal selection principle , 2002, IEEE Trans. Evol. Comput..

[28]  J. Wade Davis,et al.  Statistical Pattern Recognition , 2003, Technometrics.

[29]  Antonio J. Plaza,et al.  Dimensionality reduction and classification of hyperspectral image data using sequences of extended morphological transformations , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Liangpei Zhang,et al.  Multispectral remote sensing image classification based on simulated annealing clonal selection algorithm , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[31]  Timo Mantere,et al.  Evolutionary software engineering, a review , 2005, Appl. Soft Comput..

[32]  Zhong Yan Classification of Multi spectral Remote Sensing Image Based on Clonal Selection , 2005 .

[33]  Pavel Pudil,et al.  Introduction to Statistical Pattern Recognition , 2006 .

[34]  Liangpei Zhang,et al.  An unsupervised artificial immune classifier for multi/hyperspectral remote sensing imagery , 2006, IEEE Trans. Geosci. Remote. Sens..

[35]  Chein-I Chang,et al.  Constrained band selection for hyperspectral imagery , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Jing Wang,et al.  Independent component analysis-based dimensionality reduction with applications in hyperspectral image analysis , 2006, IEEE Transactions on Geoscience and Remote Sensing.