Deep Adversarial Inconsistent Cognitive Sampling for Multi-view Progressive Subspace Clustering

Deep multiview clustering methods have achieved remarkable performance. However, all of them failed to consider the difficulty labels (uncertainty of ground truth for training samples) over multiview samples, which may result in a nonideal clustering network for getting stuck into poor local optima during the training process; worse still, the difficulty labels from the multiview samples are always inconsistent, and such a fact makes it even more challenging to handle. In this article, we propose a novel deep adversarial inconsistent cognitive sampling (DAICS) method for multiview progressive subspace clustering. A multiview binary classification (easy or difficult) loss and a feature similarity loss are proposed to jointly learn a binary classifier and a deep consistent feature embedding network, throughout an adversarial minimax game over difficulty labels of multiview consistent samples. We develop a multiview cognitive sampling strategy to select the input samples from easy to difficult for multiview clustering network training. However, the distributions of easy and difficult samples are mixed together, hence not trivial to achieve the goal. To resolve it, we define a sampling probability with a theoretical guarantee. Based on that, a golden section mechanism is further designed to generate a sample set boundary to progressively select the samples with varied difficulty labels via a gate unit, which is utilized to jointly learn a multiview common progressive subspace and clustering network for more efficient clustering. Experimental results on four real-world datasets demonstrate the superiority of DAICS over state-of-the-art methods.

[1]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[2]  Zhaoyang Li,et al.  Deep Adversarial Multi-view Clustering Network , 2019, IJCAI.

[3]  Yi-Dong Shen,et al.  End-to-End Adversarial-Attention Network for Multi-Modal Clustering , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Ronen Basri,et al.  SpectralNet: Spectral Clustering using Deep Neural Networks , 2018, ICLR.

[5]  Yun Fu,et al.  Multi-View Clustering via Deep Matrix Factorization , 2017, AAAI.

[6]  Hongdong Li,et al.  Neural Collaborative Subspace Clustering , 2019, ICML.

[7]  Hal Daumé,et al.  Co-regularized Multi-view Spectral Clustering , 2011, NIPS.

[8]  Chao Li,et al.  A Self-Paced Multiple-Instance Learning Framework for Co-Saliency Detection , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[9]  Lin Wu,et al.  Robust Subspace Clustering for Multi-View Data by Exploiting Correlation Consensus , 2015, IEEE Transactions on Image Processing.

[10]  Feiping Nie,et al.  K-Multiple-Means: A Multiple-Means Clustering Method with Specified K Clusters , 2019, KDD.

[11]  Chao Shang,et al.  VIGAN: Missing view imputation with generative adversarial networks , 2017, 2017 IEEE International Conference on Big Data (Big Data).

[12]  Weihong Deng,et al.  Adversarial Learning With Margin-Based Triplet Embedding Regularization , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[13]  Tong Zhang,et al.  Deep Subspace Clustering Networks , 2017, NIPS.

[14]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[15]  Kunio Kashino,et al.  Subspace Structure-Aware Spectral Clustering for Robust Subspace Clustering , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[16]  Jiashi Feng,et al.  Deep Adversarial Subspace Clustering , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[17]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Maoguo Gong,et al.  Multi-Objective Self-Paced Learning , 2016, AAAI.

[19]  Zhouchen Lin,et al.  Self-Supervised Convolutional Subspace Clustering Network , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Lin Wu,et al.  Multiview Spectral Clustering via Structured Low-Rank Matrix Factorization , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[21]  Yann LeCun,et al.  Dimensionality Reduction by Learning an Invariant Mapping , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[22]  Jiancheng Lv,et al.  Multi-view Spectral Clustering Network , 2019, IJCAI.

[23]  Wei Liu,et al.  Deep Spectral Clustering Using Dual Autoencoder Network , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[25]  Jason Weston,et al.  Curriculum learning , 2009, ICML '09.

[26]  Xuelong Li,et al.  Deep Multimodal Clustering for Unsupervised Audiovisual Learning , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Hans-Peter Kriegel,et al.  Subspace clustering , 2012, WIREs Data Mining Knowl. Discov..

[28]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[29]  Cheng Deng,et al.  Balanced Self-Paced Learning for Generative Adversarial Clustering Network , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  René Vidal,et al.  Sparse Subspace Clustering: Algorithm, Theory, and Applications , 2012, IEEE transactions on pattern analysis and machine intelligence.

[31]  Tat-Seng Chua,et al.  NUS-WIDE: a real-world web image database from National University of Singapore , 2009, CIVR '09.

[32]  Dong Cao,et al.  Self-Paced Cross-Modal Subspace Matching , 2016, SIGIR.

[33]  Ling Shao,et al.  Cycle-Consistent Deep Generative Hashing for Cross-Modal Retrieval , 2018, IEEE Transactions on Image Processing.

[34]  Lin Wu,et al.  Iterative Views Agreement: An Iterative Low-Rank Based Structured Optimization Method to Multi-View Spectral Clustering , 2016, IJCAI.

[35]  René Vidal,et al.  On Geometric Analysis of Affine Sparse Subspace Clustering , 2018, IEEE Journal of Selected Topics in Signal Processing.

[36]  René Vidal,et al.  Structured Sparse Subspace Clustering: A Joint Affinity Learning and Subspace Clustering Framework , 2016, IEEE Transactions on Image Processing.

[37]  Zhaoyang Li,et al.  Deep Adversarial Multiview Clustering Network , 2019 .

[38]  Matthijs Douze,et al.  Deep Clustering for Unsupervised Learning of Visual Features , 2018, ECCV.

[39]  Sreeram Kannan,et al.  ClusterGAN : Latent Space Clustering in Generative Adversarial Networks , 2018, AAAI.

[40]  Shiguang Shan,et al.  Self-Paced Learning with Diversity , 2014, NIPS.

[41]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  Deyu Meng,et al.  A Fast Adaptive k-means with No Bounds. , 2020, IEEE transactions on pattern analysis and machine intelligence.

[43]  Qingming Huang,et al.  When to Learn What: Deep Cognitive Subspace Clustering , 2018, ACM Multimedia.

[44]  Kaiqi Huang,et al.  Beyond Triplet Loss: A Deep Quadruplet Network for Person Re-identification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  Xiaochun Cao,et al.  DM2C: Deep Mixed-Modal Clustering , 2019, NeurIPS.

[46]  Yang Wang,et al.  Survey on Deep Multi-modal Data Analytics: Collaboration, Rivalry, and Fusion , 2020, ACM Trans. Multim. Comput. Commun. Appl..

[47]  Heng Huang,et al.  Self-Paced Network Embedding , 2018, KDD.

[48]  Jeff A. Bilmes,et al.  Deep Canonical Correlation Analysis , 2013, ICML.

[49]  Cai Xu,et al.  Adversarial Incomplete Multi-view Clustering , 2019, IJCAI.

[50]  Xiaochun Cao,et al.  Duet Robust Deep Subspace Clustering , 2019, ACM Multimedia.

[51]  Daphne Koller,et al.  Self-Paced Learning for Latent Variable Models , 2010, NIPS.