A Diversified Deep Ensemble for Hyperspectral Image Classification

Recently, deep models have shown their superiority on the representation of the hyperspectral image. However, the limited number of training samples in hyperspectral image tasks makes it difficult to obtain well-trained deep model. Generally, deep belief network (DBN) which makes use of unsupervised learning can be introduced to partly solve the problem. To further improve the above-mentioned problem, this work feds DBN into deep ensemble. However, traditional deep ensemble usually produces models that tend to be very similar to the MAP solution and each other. To overcome this problem, this work introduces a novel strategy which divides the training samples into several subsets and thus the obtained multiple models would be diversified. Then a special information fusion method is proposed to obtain the final inference. Experiments are conducted over Pavia Unversity dataset to evaluate the effectiveness of the proposed method.

[1]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[2]  Matthieu Cord,et al.  Biasing Restricted Boltzmann Machines to Manipulate Latent Selectivity and Sparsity , 2010, NIPS 2010.

[3]  Shutao Li,et al.  Learning to Diversify Deep Belief Networks for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Paul Smolensky,et al.  Information processing in dynamical systems: foundations of harmony theory , 1986 .

[5]  Gregory Shakhnarovich,et al.  Discriminative Re-ranking of Diverse Segmentations , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Fan Zhang,et al.  Deep Convolutional Neural Networks for Hyperspectral Image Classification , 2015, J. Sensors.

[8]  Gregory Shakhnarovich,et al.  A Systematic Exploration of Diversity in Machine Translation , 2013, EMNLP.

[9]  Yi Shen,et al.  Learning group-based sparse and low-rank representation for hyperspectral image classification , 2016, Pattern Recognit..

[10]  Pushmeet Kohli,et al.  Multiple Choice Learning: Learning to Produce Multiple Structured Outputs , 2012, NIPS.

[11]  J. Chanussot,et al.  Hyperspectral Remote Sensing Data Analysis and Future Challenges , 2013, IEEE Geoscience and Remote Sensing Magazine.

[12]  Michael Cogswell,et al.  Stochastic Multiple Choice Learning for Training Diverse Deep Ensembles , 2016, NIPS.