Selecting the Best Part From Multiple Laplacian Autoencoders for Multi-View Subspace Clustering

The multi-view subspace clustering attracts much attention in recent years. Most methods follow the framework of fusing the affinity graph learned in each view. In this framework, both the fusion strategy and built graph of each view are very important. In this paper, we propose novel methods for multi-view subspace clustering to address these two aspects. On the one hand, we adopt the autoencoders with Laplacian regularization to construct the affinity graph in each view. Compared with previous work employing the autoencoders, the Laplacian term in our method can guide the learned latent representation favoring affinity extraction. Besides, we also discuss the reasons for adding Laplacian regularization. On the other hand, we propose a novel fusion strategy distinguished from the related literature. If the affinity graph of some view is not extracted well, the performance of previous fusion strategies will be seriously affected. Since our strategy can choose the best part from each affinity graph, it can overcome this limitation to some extent. Extensive experimental results on multiple benchmark data sets confirm the effectiveness of our method.

[1]  Chang Tang,et al.  Cross-View Locality Preserved Diversity and Consensus Learning for Multi-View Unsupervised Feature Selection , 2022, IEEE Transactions on Knowledge and Data Engineering.

[2]  Xuelong Li,et al.  Multiview Clustering: A Scalable and Parameter-Free Bipartite Graph Fusion Method , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Qinghua Hu,et al.  Cross-View Equivariant Auto-Encoder , 2021, 2021 IEEE International Conference on Multimedia and Expo (ICME).

[4]  René Vidal,et al.  Learning a Self-Expressive Network for Subspace Clustering , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Lunke Fei,et al.  Unified Tensor Framework for Incomplete Multi-view Clustering and Missing-view Inferring , 2021, AAAI.

[6]  Meng Wang,et al.  Deep Adversarial Inconsistent Cognitive Sampling for Multi-view Progressive Subspace Clustering , 2021, IEEE transactions on neural networks and learning systems.

[7]  Xinzhong Zhu,et al.  Multi-View Deep Clustering based on AutoEncoder , 2020, Journal of Physics: Conference Series.

[8]  Bob Zhang,et al.  DIMC-net: Deep Incomplete Multi-view Clustering Network , 2020, ACM Multimedia.

[9]  Hao Wang,et al.  GMC: Graph-Based Multi-View Clustering , 2020, IEEE Transactions on Knowledge and Data Engineering.

[10]  Zheng Zhang,et al.  Generalized Incomplete Multiview Clustering With Flexible Locality Structure Diffusion , 2020, IEEE Transactions on Cybernetics.

[11]  Xiao Wang,et al.  One2Multi Graph Autoencoder for Multi-view Graph Clustering , 2020, WWW.

[12]  Chang Tang,et al.  CGD: Multi-View Clustering via Cross-View Graph Diffusion , 2020, AAAI.

[13]  Shuicheng Yan,et al.  Deep Subspace Clustering , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Minping Jia,et al.  Deep Laplacian Auto-encoder and its application into imbalanced fault diagnosis of rotating machinery , 2020 .

[15]  Qinghua Hu,et al.  Generalized Latent Multi-View Subspace Clustering , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Zenglin Xu,et al.  Auto-weighted multi-view clustering via deep matrix decomposition , 2020, Pattern Recognit..

[17]  Jiashi Feng,et al.  Deep Clustering With Sample-Assignment Invariance Prior , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Chenping Hou,et al.  Latent Complete Row Space Recovery for Multi-View Subspace Clustering , 2019, IEEE Transactions on Image Processing.

[19]  Yang Wang,et al.  Kernelized Multiview Subspace Analysis By Self-Weighted Learning , 2019, IEEE Transactions on Multimedia.

[20]  Zenglin Xu,et al.  Large-scale Multi-view Subspace Clustering in Linear Time , 2019, AAAI.

[21]  Philip S. Yu,et al.  From Joint Feature Selection and Self-Representation Learning to Robust Multi-view Subspace Clustering , 2019, 2019 IEEE International Conference on Data Mining (ICDM).

[22]  Tao Mei,et al.  Deep Collaborative Embedding for Social Image Understanding , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Changqing Zhang,et al.  Multi-view Deep Subspace Clustering Networks , 2019, ArXiv.

[24]  Zhaoyang Li,et al.  Deep Adversarial Multi-view Clustering Network , 2019, IJCAI.

[25]  Junbin Gao,et al.  Shared Generative Latent Representation Learning for Multi-view Clustering , 2019, AAAI.

[26]  Xinwang Liu,et al.  Learning a Joint Affinity Graph for Multiview Subspace Clustering , 2019, IEEE Transactions on Multimedia.

[27]  Junbin Gao,et al.  Nonlinear Subspace Clustering via Adaptive Graph Regularized Autoencoder , 2019, IEEE Access.

[28]  Huazhu Fu,et al.  AE2-Nets: Autoencoder in Autoencoder Networks , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Qingming Huang,et al.  Split Multiplicative Multi-View Subspace Clustering , 2019, IEEE Transactions on Image Processing.

[30]  Matthijs Douze,et al.  Deep Clustering for Unsupervised Learning of Visual Features , 2018, ECCV.

[31]  Wei-Yun Yau,et al.  Structured AutoEncoders for Subspace Clustering , 2018, IEEE Transactions on Image Processing.

[32]  Wei Zhang,et al.  Consistent and Specific Multi-View Subspace Clustering , 2018, AAAI.

[33]  Vishal M. Patel,et al.  Deep Multimodal Subspace Clustering Networks , 2018, IEEE Journal of Selected Topics in Signal Processing.

[34]  Chao Li,et al.  Shared Predictive Cross-Modal Deep Quantization , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[35]  Tong Zhang,et al.  Deep Subspace Clustering Networks , 2017, NIPS.

[36]  Qinghua Hu,et al.  Latent Multi-view Subspace Clustering , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Stan Z. Li,et al.  Exclusivity-Consistency Regularized Multi-view Subspace Clustering , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Yun Fu,et al.  Multi-View Clustering via Deep Matrix Factorization , 2017, AAAI.

[39]  Xuelong Li,et al.  Multi-view Subspace Clustering , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[40]  Lin Sun,et al.  Laplacian Auto-Encoders: An explicit learning of nonlinear data manifold , 2015, Neurocomputing.

[41]  Xiaochun Cao,et al.  Diversity-induced Multi-view Subspace Clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Lei Du,et al.  Robust Multi-View Spectral Clustering via Low-Rank and Sparse Decomposition , 2014, AAAI.

[43]  Shuicheng Yan,et al.  Robust and Efficient Subspace Segmentation via Least Squares Regression , 2012, ECCV.

[44]  Hans-Peter Kriegel,et al.  Subspace clustering , 2012, WIREs Data Mining Knowl. Discov..

[45]  René Vidal,et al.  Sparse Subspace Clustering: Algorithm, Theory, and Applications , 2012, IEEE transactions on pattern analysis and machine intelligence.

[46]  Hal Daumé,et al.  Co-regularized Multi-view Spectral Clustering , 2011, NIPS.

[47]  V. Kshirsagar,et al.  Face recognition using Eigenfaces , 2011, 2011 3rd International Conference on Computer Research and Development.

[48]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Yi Ma,et al.  The Augmented Lagrange Multiplier Method for Exact Recovery of Corrupted Low-Rank Matrices , 2010, Journal of structural biology.

[50]  Pinar Duygulu Sahin,et al.  Recognizing actions from still images , 2008, 2008 19th International Conference on Pattern Recognition.

[51]  Ville Ojansivu,et al.  Blur Insensitive Texture Classification Using Local Phase Quantization , 2008, ICISP.

[52]  René Vidal,et al.  A Benchmark for the Comparison of 3-D Motion Segmentation Algorithms , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[53]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[54]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression Database , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[55]  Ronen Basri,et al.  Lambertian reflectance and linear subspaces , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[56]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[57]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[58]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[59]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[60]  V. D. Sa.  Spectral Clustering with Two Views , 2007 .

[61]  Stephen Lin,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.