Unbalanced Incomplete Multi-view Clustering via the Scheme of View Evolution: Weak Views are Meat; Strong Views do Eat

Incomplete multi-view clustering is an important technique to deal with real-world incomplete multi-view data. Previous works assume that all views have the same incompleteness, i.e., balanced incompleteness. However, different views often have distinct incompleteness, i.e., unbalanced incompleteness, which results in strong views (low-incompleteness views) and weak views (high-incompleteness views). The unbalanced incompleteness prevents us from directly using the previous methods for clustering. In this paper, inspired by the effective biological evolution theory, we design the novel scheme of view evolution to cluster strong and weak views. Moreover, we propose an Unbalanced Incomplete Multi-view Clustering method (UIMC), which is the first effective method based on view evolution for unbalanced incomplete multi-view clustering. Compared with previous methods, UIMC has two unique advantages: 1) it proposes weighted multi-view subspace clustering to integrate these unbalanced incomplete views, which effectively solves the unbalanced incomplete multi-view problem; 2) it designs the low-rank and robust representation to recover the data, which diminishes the impact of the incompleteness and noises. Extensive experimental results demonstrate that UIMC improves the clustering performance by up to 40% on three evaluation metrics over other state-of-the-art methods.

[1]  Yan Li,et al.  Power Line Detection by Pyramidal Patch Classification , 2019, IEEE Transactions on Emerging Topics in Computational Intelligence.

[2]  Ling Shao,et al.  Binary Multi-View Clustering , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Yu Zheng,et al.  Urban Water Quality Prediction Based on Multi-Task Multi-View Learning , 2016, IJCAI.

[4]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[5]  Xinwang Liu,et al.  Cross-View Local Structure Preserved Diversity and Consensus Learning for Multi-View Unsupervised Feature Selection , 2019, AAAI.

[6]  Zhao Kang,et al.  Robust PCA Via Nonconvex Rank Approximation , 2015, 2015 IEEE International Conference on Data Mining.

[7]  Charles Darwin,et al.  On the origin of species, 1859 , 1988 .

[8]  Liang Feng,et al.  Insights on Transfer Optimization: Because Experience is the Best Teacher , 2018, IEEE Transactions on Emerging Topics in Computational Intelligence.

[9]  Jiancheng Lv,et al.  COMIC: Multi-view Clustering Without Parameter Selection , 2019, ICML.

[10]  Xuelong Li,et al.  Auto-Weighted Multi-View Learning for Image Clustering and Semi-Supervised Classification , 2018, IEEE Transactions on Image Processing.

[11]  Xuelong Li,et al.  Self-weighted Multiview Clustering with Multiple Graphs , 2017, IJCAI.

[12]  Xiang-Gen Xia,et al.  Millimeter-Wave NOMA With User Grouping, Power Allocation and Hybrid Beamforming , 2019, IEEE Transactions on Wireless Communications.

[13]  Jiajun Zhang,et al.  Implicit Discourse Relation Recognition for English and Chinese with Multiview Modeling and Effective Representation Learning , 2017, ACM Trans. Asian Low Resour. Lang. Inf. Process..

[14]  Zhiwu Lu,et al.  Unified Constraint Propagation on Multi-View Data , 2013, AAAI.

[15]  Shuqiang Jiang,et al.  A Delicious Recipe Analysis Framework for Exploring Multi-Modal Recipes with Various Attributes , 2017, ACM Multimedia.

[16]  Zhigang Zeng,et al.  Memristive Fully Convolutional Network: An Accurate Hardware Image-Segmentor in Deep Learning , 2018, IEEE Transactions on Emerging Topics in Computational Intelligence.

[17]  Haiyun Luo,et al.  Energy-Optimal Mobile Cloud Computing under Stochastic Wireless Channel , 2013, IEEE Transactions on Wireless Communications.

[18]  Qinghua Hu,et al.  Latent Multi-view Subspace Clustering , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Hong Yang,et al.  Recommendation with Multi-Source Heterogeneous Information , 2018, IJCAI.

[20]  Herbert Spencer,et al.  The Principles of Biology , 1863, The British and Foreign Medico-Chirurgical Review.

[21]  Sung Wook Baik,et al.  A novel magic LSB substitution method (M-LSB-SM) using multi-level encryption and achromatic component of an image , 2015, Multimedia Tools and Applications.

[22]  Shao-Yuan Li,et al.  Partial Multi-View Clustering , 2014, AAAI.

[23]  Tobey H Ko,et al.  Contextual Correlation Preserving Multiview Featured Graph Clustering , 2020, IEEE Transactions on Cybernetics.

[24]  Changqiao Xu,et al.  Decentralized Online Learning Methods Based on Weight-Balancing Over Time-Varying Digraphs , 2021, IEEE Transactions on Emerging Topics in Computational Intelligence.

[25]  Hong Liu,et al.  Unified Embedding Alignment with Missing Views Inferring for Incomplete Multi-View Clustering , 2019, AAAI.

[26]  Wei Liu,et al.  Multi-Modal Curriculum Learning for Semi-Supervised Image Classification , 2016, IEEE Transactions on Image Processing.

[27]  Hong Liu,et al.  Incomplete Multiview Spectral Clustering With Adaptive Graph Learning , 2020, IEEE Transactions on Cybernetics.

[28]  Xuelong Li,et al.  Multi-view Subspace Clustering , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[29]  Wu-Jun Li,et al.  Collaborative Topic Regression with Social Regularization for Tag Recommendation , 2013, IJCAI.

[30]  Yun Fu,et al.  Incomplete Multi-Modal Visual Data Grouping , 2016, IJCAI.

[31]  Yew-Soon Ong,et al.  AIR5: Five Pillars of Artificial Intelligence Research , 2018, IEEE Transactions on Emerging Topics in Computational Intelligence.

[32]  Chen Zhang,et al.  Multi-view Adversarially Learned Inference for Cross-domain Joint Distribution Matching , 2018, KDD.

[33]  Hong Yu,et al.  Weighted Multi-View Spectral Clustering Based on Spectral Perturbation , 2018, AAAI.

[34]  Ying Zhang,et al.  NetClust: A Framework for Scalable and Pareto-Optimal Media Server Placement , 2013, IEEE Transactions on Multimedia.

[35]  T. P. Dinh,et al.  Convex analysis approach to d.c. programming: Theory, Algorithm and Applications , 1997 .

[36]  Ming Shao,et al.  Multi-View Low-Rank Analysis with Applications to Outlier Detection , 2018, ACM Trans. Knowl. Discov. Data.

[37]  Pan Zhou,et al.  Accurate Content Push for Content-Centric Social Networks: A Big Data Support Online Learning Approach , 2018, IEEE Transactions on Emerging Topics in Computational Intelligence.

[38]  Min-Yen Kan,et al.  Comment-based multi-view clustering of web 2.0 items , 2014, WWW.

[39]  Feifei Zhai,et al.  A Compact and Language-Sensitive Multilingual Translation Method , 2019, ACL.

[40]  Yuzhong Qu,et al.  Multi-view Knowledge Graph Embedding for Entity Alignment , 2019, IJCAI.

[41]  Philip S. Yu,et al.  Multiple Incomplete Views Clustering via Weighted Nonnegative Matrix Factorization with L2, 1 Regularization , 2015, ECML/PKDD.

[42]  Xing Xie,et al.  Explainable Recommendation through Attentive Multi-View Learning , 2019, AAAI.

[43]  Avrim Blum,et al.  The Bottleneck , 2021, Monopsony Capitalism.

[44]  Songcan Chen,et al.  Doubly Aligned Incomplete Multi-view Clustering , 2018, IJCAI.

[45]  Feng Xia,et al.  ROSE: Robustness Strategy for Scale-Free Wireless Sensor Networks , 2017, IEEE/ACM Transactions on Networking.