Multiple Instance Learning for Multiple Diverse Hyperspectral Target Characterizations

A practical hyperspectral target characterization task estimates a target signature from imprecisely labeled training data. The imprecisions arise from the characteristics of the real-world tasks. First, accurate pixel-level labels on training data are often unavailable. Second, the subpixel targets and occluded targets cause the training samples to contain mixed data and multiple target types. To address these imprecisions, this paper proposes a new hyperspectral target characterization method to produce diverse multiple hyperspectral target signatures under a multiple instance learning (MIL) framework. The proposed method uses only bag-level training samples and labels, which solves the problems arising from the mixed data and lack of pixel-level labels. Moreover, by formulating a multiple characterization MIL and including a diversity-promoting term, the proposed method can learn a set of diverse target signatures, which solves the problems arising from multiple target types in training samples. The experiments on hyperspectral target detections using the learned multiple target signatures over synthetic and real-world data show the effectiveness of the proposed method.

[1]  Cordelia Schmid,et al.  Weakly Supervised Object Localization with Multi-Fold Multiple Instance Learning , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Yung-Yu Chuang,et al.  Augmented Multiple Instance Regression for Inferring Object Contours in Bounding Boxes , 2014, IEEE Transactions on Image Processing.

[3]  Varun Ramakrishna,et al.  Predicting Multiple Structured Visual Interpretations , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[4]  Yaoliang Yu,et al.  Efficient Multiple Instance Metric Learning Using Weakly Supervised Data , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Jian Yang,et al.  Learning with Inadequate and Incorrect Supervision , 2017, 2017 IEEE International Conference on Data Mining (ICDM).

[6]  Bo Du,et al.  Multi-Task Learning for Blind Source Separation , 2018, IEEE Transactions on Image Processing.

[7]  Slobodan Vucetic,et al.  Mixture Model for Multiple Instance Regression and Applications in Remote Sensing , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Ping Zhong,et al.  Diversity-Promoting Deep Structural Metric Learning for Remote Sensing Scene Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Changzhe Jiao Target concept learning from ambiguously labeled data , 2017 .

[10]  Carsten Rother,et al.  Inferring M-Best Diverse Labelings in a Single One , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[11]  Wei Liu,et al.  Multi-Modal Curriculum Learning for Semi-Supervised Image Classification , 2016, IEEE Transactions on Image Processing.

[12]  Bo Du,et al.  PLTD: Patch-Based Low-Rank Tensor Decomposition for Hyperspectral Images , 2017, IEEE Transactions on Multimedia.

[13]  Peter M. Williams,et al.  Bayesian Regularization and Pruning Using a Laplace Prior , 1995, Neural Computation.

[14]  Jun Zhou,et al.  MILIS: Multiple Instance Learning with Instance Selection , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Shutao Li,et al.  Learning to Diversify Deep Belief Networks for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Eleman Teitei,et al.  Biased Random Forest For Dealing With the Class Imbalance Problem , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Shutao Li,et al.  Hyperspectral Image Super-Resolution via Non-local Sparse Tensor Factorization , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Ping Zhong,et al.  Learning Conditional Random Fields for Classification of Hyperspectral Images , 2010, IEEE Transactions on Image Processing.

[19]  Heesung Kwon,et al.  Kernel matched subspace detectors for hyperspectral target detection , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Liu Liu,et al.  Diversified dictionaries for multi-instance learning , 2017, Pattern Recognit..

[21]  Bo Du,et al.  Robust Graph-Based Semisupervised Learning for Noisy Labeled Data via Maximum Correntropy Criterion , 2019, IEEE Transactions on Cybernetics.

[22]  Yuan Yan Tang,et al.  Maximum Likelihood Estimation-Based Joint Sparse Representation for the Classification of Hyperspectral Remote Sensing Images , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[23]  David W. Messinger,et al.  The SHARE 2012 data campaign , 2013, Defense, Security, and Sensing.

[24]  Yang Wang,et al.  Data Subset Selection With Imperfect Multiple Labels , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[25]  Jianghong Ma,et al.  Topic-Based Algorithm for Multilabel Learning With Missing Labels , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[26]  Eric Granger,et al.  Bag-Level Aggregation for Multiple-Instance Active Learning in Instance Classification Problems , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[27]  Changzhe Jiao,et al.  Functions of Multiple Instances for Learning Target Signatures , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Marco Loog,et al.  Dissimilarity-Based Ensembles for Multiple Instance Learning , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[29]  Dacheng Tao,et al.  Early Expression Detection via Online Multi-Instance Learning With Nonlinear Extension , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[30]  Nasser M. Nasrabadi,et al.  Hyperspectral Target Detection : An Overview of Current and Future Challenges , 2014, IEEE Signal Processing Magazine.

[31]  Shuyuan Yang,et al.  Self-Paced Learning-Based Probability Subspace Projection for Hyperspectral Image Classification , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[32]  Qi Zhang,et al.  EM-DD: An Improved Multiple-Instance Learning Technique , 2001, NIPS.

[33]  Ajmal Mian,et al.  Nonparametric Coupled Bayesian Dictionary and Classifier Learning for Hyperspectral Classification , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[34]  Changzhe Jiao,et al.  Multiple Instance Dictionary Learning using Functions of Multiple Instances , 2015, 2016 23rd International Conference on Pattern Recognition (ICPR).