A new multi-view learning machine with incomplete data

Multi-view learning with incomplete views (MVL-IV) is a reliable algorithm to process incomplete datasets which consist of instances with missing views or features. In MVL-IV, it exploits the connections among multiple views and suggests that different views are generated from a shared subspace such that it can recover the missing views or features well while MVL-IV neglects two facts. One is that different views should always be generated from different subspaces. The other is that the information of view-based classifiers is useful to the design of MVL-IV. Thus, on the base of MVL-IV, we consider these two facts and develop a new multi-view learning with incomplete data (NMVL-IV). Related experiments on clustering, regression, classification, bipartite ranking, and image retrieval have validated that the proposed NMVL-IV can recover the incomplete data much better.

[1]  Martha White,et al.  Convex Multi-view Subspace Learning , 2012, NIPS.

[2]  Chang-Dong Wang,et al.  Weighted Multi-view Clustering with Feature Selection , 2016, Pattern Recognit..

[3]  Min Chen,et al.  Selection-based resampling ensemble algorithm for nonstationary imbalanced stream data learning , 2019, Knowl. Based Syst..

[4]  Jicong Fan,et al.  Matrix completion by least-square, low-rank, and sparse self-representations , 2017, Pattern Recognit..

[5]  Siheng Zhang,et al.  Re-KISSME: A robust resampling scheme for distance metric learning in the presence of label noise , 2019, Neurocomputing.

[6]  Chulhee Lee,et al.  Linear classifier design in the weight space , 2019, Pattern Recognit..

[7]  Elif Vural,et al.  Nonlinear Supervised Dimensionality Reduction via Smooth Regular Embeddings , 2017, Pattern Recognit..

[8]  Henrik Boström,et al.  Interpretable regression trees using conformal prediction , 2018, Expert Syst. Appl..

[9]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[10]  Songcan Chen,et al.  Locality preserving CCA with applications to data visualization and pose estimation , 2007, Image Vis. Comput..

[11]  Changming Zhu,et al.  Entropy-based matrix learning machine for imbalanced data sets , 2017, Pattern Recognit. Lett..

[12]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[13]  Xun Wang,et al.  Video object matching across multiple non-overlapping camera views based on multi-feature fusion and incremental learning , 2014, Pattern Recognit..

[14]  Dacheng Tao,et al.  Multi-View Learning With Incomplete Views , 2015, IEEE Transactions on Image Processing.

[15]  Hui Cheng,et al.  Multi-instance learning based on representative instance and feature mapping , 2016, Neurocomputing.

[16]  Jinbo Bi,et al.  On Multiplicative Multitask Feature Learning , 2014, NIPS.

[17]  Massih-Reza Amini,et al.  Learning from Multiple Partially Observed Views - an Application to Multilingual Text Categorization , 2009, NIPS.

[18]  Trevor Darrell,et al.  Factorized Latent Spaces with Structured Sparsity , 2010, NIPS.

[19]  Yuan Lei,et al.  A new accelerated alternating minimization method for analysis sparse recovery , 2018, Signal Process..

[20]  Cong Wang,et al.  Human gait recognition based on deterministic learning through multiple views fusion , 2016, Pattern Recognit. Lett..

[21]  Changming Zhu,et al.  Globalized and localized canonical correlation analysis with multiple empirical kernel mapping , 2015, Neurocomputing.

[22]  Jicong Fan,et al.  Non-linear matrix completion , 2017, Pattern Recognit..

[23]  Daoqiang Zhang,et al.  A New Canonical Correlation Analysis Algorithm with Local Discrimination , 2010, Neural Processing Letters.

[24]  Qiang Wu,et al.  Cross-view and multi-view gait recognitions based on view transformation model using multi-layer perceptron , 2012, Pattern Recognit. Lett..

[25]  Martín Carpio,et al.  A novel formulation of orthogonal polynomial kernel functions for SVM classifiers: The Gegenbauer family , 2018, Pattern Recognit..

[26]  Zhi-Hua Zhou,et al.  Multi-View Matrix Completion for Clustering with Side Information , 2017, PAKDD.

[27]  Andrea Montanari,et al.  Matrix completion from a few entries , 2009, 2009 IEEE International Symposium on Information Theory.

[28]  Alexander J. Smola,et al.  Support Vector Regression Machines , 1996, NIPS.

[29]  James Brusey,et al.  Linear classifier design under heteroscedasticity in Linear Discriminant Analysis , 2017, Expert Syst. Appl..

[30]  Jie Chen,et al.  Learning low-complexity autoregressive models via proximal alternating minimization , 2016, Syst. Control. Lett..

[31]  Massih-Reza Amini,et al.  Multiview Semi-supervised Learning for Ranking Multilingual Documents , 2011, ECML/PKDD.

[32]  Xian Sun,et al.  Multi-view semi-supervised learning for image classification , 2016, Neurocomputing.

[33]  Emmanuel J. Candès,et al.  Exact Matrix Completion via Convex Optimization , 2008, Found. Comput. Math..

[34]  Yi-Ping Hung,et al.  Ordinal hyperplanes ranker with cost sensitivities for age estimation , 2011, CVPR 2011.

[35]  Jieping Ye,et al.  A Reconstruction Error Based Framework for Multi-Label and Multi-View Learning , 2015, IEEE Transactions on Knowledge and Data Engineering.

[36]  Javier Jorge,et al.  Passive-Aggressive online learning with nonlinear embeddings , 2018, Pattern Recognit..

[37]  Jieping Ye,et al.  Multi-stage multi-task feature learning , 2012, J. Mach. Learn. Res..

[38]  Chen Zu,et al.  Weight-based canonical sparse cross-view correlation analysis , 2017, Pattern Analysis and Applications.

[39]  Robert Sabourin,et al.  Random forest dissimilarity based multi-view learning for Radiomics application , 2019, Pattern Recognit..

[40]  Dong Yue,et al.  Multi-view low-rank dictionary learning for image classification , 2016, Pattern Recognit..

[41]  Massimiliano Pontil,et al.  Multi-Task Feature Learning , 2006, NIPS.

[42]  Shiliang Sun,et al.  Multiple-View Multiple-Learner Semi-Supervised Learning , 2011, Neural Processing Letters.

[43]  John Shawe-Taylor,et al.  Canonical Correlation Analysis: An Overview with Application to Learning Methods , 2004, Neural Computation.

[44]  Nathan Srebro,et al.  Fast maximum margin matrix factorization for collaborative prediction , 2005, ICML.

[45]  Rajesh P. N. Rao,et al.  Learning Shared Latent Structure for Image Synthesis and Robotic Imitation , 2005, NIPS.

[46]  Aristidis Likas,et al.  Kernel-Based Weighted Multi-view Clustering , 2012, 2012 IEEE 12th International Conference on Data Mining.

[47]  Daoqiang Zhang,et al.  Canonical sparse cross-view correlation analysis , 2016, Neurocomputing.

[48]  Robert D. Nowak,et al.  Transduction with Matrix Completion: Three Birds with One Stone , 2010, NIPS.

[49]  Qinghua Hu,et al.  Semi-Supervised Multi-view Multi-label Classification Based on Nonnegative Matrix Factorization , 2017, ICANN.