Hyperspectral band selection based on multi-objective optimization with high information and low redundancy

Abstract For band selection in hyperspectral images, there are two crucial aspects, information preservation and redundancy reduction, which have a great influence on the subsequent applications. Most of current works have a fixed preference on these two aspects. However, since different data sets possess different numerical characteristics, optimal preferences on these two aspects may be different and difficult to be decided. Therefore, a method is required, which can explore optimal trade-offs of these two aspects according to different characteristics of data sets. To address this challenge, a novel multi-objective optimization model for band selection is proposed. Two conflicting objective functions compose the proposed model. One measures the amount of information and the other one measures the redundancy contained in the selected bands. Through this model, the two aspects are quantified, which makes it possible to optimize them simultaneously. To optimize this model, a new multi-objective immune algorithm is designed to fit the characteristics of hyperspectral data. And it has the ability to obtain a series of Pareto optimal solutions which represent different optimal trade-offs between the two objective functions. In this way, the proposed method can explore the optimal trade-offs between the two aspects and provide decision makers more options according to different characteristics of data sets. Experiments are implemented on three real hyperspectral data sets. The results show the superiority of the proposed method.

[1]  David Corne,et al.  The Pareto archived evolution strategy: a new baseline algorithm for Pareto multiobjective optimisation , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[2]  P. Switzer,et al.  A transformation for ordering multispectral data in terms of image quality with implications for noise removal , 1988 .

[3]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[4]  Q. Mcnemar Note on the sampling error of the difference between correlated proportions or percentages , 1947, Psychometrika.

[5]  Yongchao Zhao,et al.  A Fast Volume-Gradient-Based Band Selection Method for Hyperspectral Image , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[6]  A. Agarwal,et al.  Efficient Hierarchical-PCA Dimension Reduction for Hyperspectral Imagery , 2007, 2007 IEEE International Symposium on Signal Processing and Information Technology.

[7]  Peter J. Fleming,et al.  An Overview of Evolutionary Algorithms in Multiobjective Optimization , 1995, Evolutionary Computation.

[8]  Jing Wang,et al.  Independent component analysis-based dimensionality reduction with applications in hyperspectral image analysis , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[9]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[10]  Fang Liu,et al.  Unsupervised feature selection based on maximum information and minimum redundancy for hyperspectral images , 2016, Pattern Recognit..

[11]  Liangpei Zhang,et al.  Dimensionality Reduction Based on Clonal Selection for Hyperspectral Imagery , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[12]  A. Neubauer,et al.  A theoretical analysis of the non-uniform mutation operator for the modified genetic algorithm , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[13]  James E. Fowler,et al.  Locality-Preserving Dimensionality Reduction and Classification for Hyperspectral Image Analysis , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Weiwei Sun,et al.  Band Selection Using Improved Sparse Subspace Clustering for Hyperspectral Imagery Classification , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[15]  Chenhong Sui,et al.  Unsupervised Band Selection by Integrating the Overall Accuracy and Redundancy , 2015, IEEE Geoscience and Remote Sensing Letters.

[16]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[17]  Qian Du,et al.  Optimized Hyperspectral Band Selection Using Particle Swarm Optimization , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[18]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[19]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[20]  Qian Du,et al.  Unsupervised Hyperspectral Band Selection Using Graphics Processing Units , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[21]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .

[22]  Yilong Yin,et al.  A Hybrid Evolutionary Immune Algorithm for Multiobjective Optimization Problems , 2016, IEEE Transactions on Evolutionary Computation.

[23]  Maoguo Gong,et al.  Multiobjective Immune Algorithm with Nondominated Neighbor-Based Selection , 2008, Evolutionary Computation.

[24]  Jianbin Huang,et al.  An immune multi-objective optimization algorithm with differential evolution inspired recombination , 2015, Appl. Soft Comput..

[25]  Maoguo Gong,et al.  Unsupervised Band Selection Based on Evolutionary Multiobjective Optimization for Hyperspectral Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Qian Li,et al.  Enhanced index tracking based on multi-objective immune algorithm , 2011, Expert Syst. Appl..

[27]  Robert I. Damper,et al.  Band Selection for Hyperspectral Image Classification Using Mutual Information , 2006, IEEE Geoscience and Remote Sensing Letters.

[28]  Qi Wang,et al.  Hyperspectral Band Selection by Multitask Sparsity Pursuit , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[30]  Ibrahim F. Imam,et al.  A novel approach for measuring hyperspectral similarity , 2012, Appl. Soft Comput..

[31]  Qi Wang,et al.  Salient Band Selection for Hyperspectral Image Classification via Manifold Ranking , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[32]  Jee Cheng Wu,et al.  Unsupervised Cluster-based Band Selection for Hyperspectral Image Classification , 2013 .

[33]  Claude Cariou,et al.  BandClust: An Unsupervised Band Reduction Method for Hyperspectral Remote Sensing , 2011, IEEE Geoscience and Remote Sensing Letters.

[34]  Carlos A. Coello Coello,et al.  Handling multiple objectives with particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[35]  Ashish Ghosh,et al.  Combination of Clustering and Ranking Techniques for Unsupervised Band Selection of Hyperspectral Images , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[36]  R. E. Roger A faster way to compute the noise-adjusted principal components transform matrix , 1994, IEEE Trans. Geosci. Remote. Sens..

[37]  Qiuzhen Lin,et al.  A novel hybrid multi-objective immune algorithm with adaptive differential evolution , 2015, Comput. Oper. Res..

[38]  J. B. Lee,et al.  Enhancement of high spectral resolution remote-sensing data by a noise-adjusted principal components transform , 1990 .

[39]  P. Groves,et al.  Methodology For Hyperspectral Band Selection , 2004 .

[40]  Feifei Xu,et al.  Unsupervised Hyperspectral Band Selection by Dominant Set Extraction , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Qian Du,et al.  Hyperspectral Band Selection Using Improved Firefly Algorithm , 2016, IEEE Geoscience and Remote Sensing Letters.

[42]  Xin-She Yang,et al.  Multiobjective firefly algorithm for continuous optimization , 2012, Engineering with Computers.

[43]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[44]  Jefersson Alex dos Santos,et al.  Efficient Unsupervised Band Selection Through Spectral Rhythms , 2015, IEEE Journal of Selected Topics in Signal Processing.

[45]  Liangpei Zhang,et al.  Adaptive Multiobjective Memetic Fuzzy Clustering Algorithm for Remote Sensing Imagery , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[47]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[48]  Abdelkader Benyettou,et al.  Gray Wolf Optimizer for hyperspectral band selection , 2016, Appl. Soft Comput..

[49]  Qian Du,et al.  A joint band prioritization and band-decorrelation approach to band selection for hyperspectral image classification , 1999, IEEE Trans. Geosci. Remote. Sens..

[50]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[51]  Ashish Ghosh,et al.  Self-adaptive differential evolution for feature selection in hyperspectral image data , 2013, Appl. Soft Comput..

[52]  Farid Melgani,et al.  Clustering of Hyperspectral Images Based on Multiobjective Particle Swarm Optimization , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[53]  Jiankun Hu,et al.  A New Dimensionality Reduction Algorithm for Hyperspectral Image Using Evolutionary Strategy , 2012, IEEE Transactions on Industrial Informatics.

[54]  LinLin Shen,et al.  Unsupervised Band Selection for Hyperspectral Imagery Classification Without Manual Band Removal , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[55]  Adolfo Martínez Usó,et al.  Clustering-Based Hyperspectral Band Selection Using Information Measures , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[56]  Licheng Jiao,et al.  Hyperspectral Band Selection Based on Trivariate Mutual Information and Clonal Selection , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[57]  Jonathan Timmis,et al.  Application areas of AIS: The past, the present and the future , 2008, Appl. Soft Comput..

[58]  Kalyanmoy Deb,et al.  Multi-objective code-smells detection using good and bad design examples , 2016, Software Quality Journal.

[59]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[60]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[61]  Hans-Paul Schwefel,et al.  Evolution and Optimum Seeking: The Sixth Generation , 1993 .

[62]  Qian Du,et al.  Hyperspectral Image Classification Using Band Selection and Morphological Profiles , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.