Multi-View Classification via a Fast and Effective Multi-View Nearest-Subspace Classifier

Multi-view data represented in multiple views contains more complementary information than a single view, whereby multi-view learning explores and utilizes the multi-view data. In general, most existing multi-view learning methods consider the correlation between multiple views. However, the relationship between classes and views which is also important in multi-view learning has never been involved in the existing works. In this paper, we propose a fast and effective multi-view nearest-subspace classifier (MV-NSC) by taking advantage of both the two relationships simultaneously. MV-NSC consists of four main parts: 1) projection residual, 2) view-dependent class separability, 3) view similarity, and 4) final decision. The last part combines the first three parts in one final decision matrix, while the first three parts utilize the information of the multi-view data in various aspects. Our proposed method is evaluated on four benchmark datasets and compared with seven other classifiers including both multi- and single-view algorithms. According to the experimental results, it shows that our proposed method is effective, efficient, and robust in multi-view classification.

[1]  Jun Wang,et al.  Multi-view Representation Learning via Canonical Correlation Analysis for Dysarthric Speech Recognition , 2018, Advances in Intelligent Systems and Computing.

[2]  Mehryar Mohri,et al.  Learning Non-Linear Combinations of Kernels , 2009, NIPS.

[3]  J. Shawe-Taylor,et al.  Multi-View Canonical Correlation Analysis , 2010 .

[4]  Nello Cristianini,et al.  Learning the Kernel Matrix with Semidefinite Programming , 2002, J. Mach. Learn. Res..

[5]  David Zhang,et al.  Joint discriminative and collaborative representation for fatty liver disease diagnosis , 2017, Expert Syst. Appl..

[6]  Guoqing Zhang,et al.  Multiple kernel locality-constrained collaborative representation-based discriminant projection for face recognition , 2018, Neurocomputing.

[7]  Jeff A. Bilmes,et al.  Unsupervised learning of acoustic features via deep canonical correlation analysis , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[8]  Dacheng Tao,et al.  Multi-View Intact Space Learning , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  H. Hotelling Relations Between Two Sets of Variates , 1936 .

[10]  Zhi-Hua Zhou,et al.  A New Analysis of Co-Training , 2010, ICML.

[11]  David W. Jacobs,et al.  Generalized Multiview Analysis: A discriminative latent space , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Yun Fu,et al.  Robust Multi-View Subspace Learning through Dual Low-Rank Decompositions , 2016, AAAI.

[13]  Ethem Alpaydin,et al.  Localized multiple kernel learning , 2008, ICML '08.

[14]  John G. Daugman,et al.  Complete discrete 2-D Gabor transforms by neural networks for image analysis and compression , 1988, IEEE Trans. Acoust. Speech Signal Process..

[15]  David J. Kriegman,et al.  Acquiring linear subspaces for face recognition under variable lighting , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Mikhail Belkin,et al.  A Co-Regularization Approach to Semi-supervised Learning with Multiple Views , 2005 .

[17]  Cosimo Rubino,et al.  3D Object Localisation from Multi-View Image Detections , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Yongcheng Li,et al.  Joint similar and specific learning for diabetes mellitus and impaired glucose regulation detection , 2017, Inf. Sci..

[19]  Sameer A. Nene,et al.  Columbia Object Image Library (COIL100) , 1996 .

[20]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[21]  Yixin Yang,et al.  Matrix-Regularized Multiple Kernel Learning via $(r,~p)$ Norms , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Lei Zhang,et al.  Sparse representation or collaborative representation: Which helps face recognition? , 2011, 2011 International Conference on Computer Vision.

[23]  Jun Guo,et al.  Face Recognition via Collaborative Representation: Its Discriminant Nature and Superposed Representation , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Jie Lu,et al.  Two-Stage Fuzzy Multiple Kernel Learning Based on Hilbert–Schmidt Independence Criterion , 2018, IEEE Transactions on Fuzzy Systems.

[25]  Gunnar Rätsch,et al.  Large Scale Multiple Kernel Learning , 2006, J. Mach. Learn. Res..

[26]  Shiliang Sun,et al.  Multiview Uncorrelated Discriminant Analysis , 2016, IEEE Transactions on Cybernetics.

[27]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Dong Yue,et al.  Multi-view low-rank dictionary learning for image classification , 2016, Pattern Recognit..

[29]  Wen Hu,et al.  Sensor-Assisted Multi-View Face Recognition System on Smart Glass , 2018, IEEE Transactions on Mobile Computing.

[30]  Ziming Zhang LMKL-Net: A Fast Localized Multiple Kernel Learning Solver via Deep Neural Networks , 2018, ArXiv.

[31]  Aristidis Likas,et al.  Weighted multi-view key-frame extraction , 2016, Pattern Recognit. Lett..

[32]  David Zhang,et al.  Relaxed collaborative representation for pattern classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Shotaro Akaho,et al.  A kernel method for canonical correlation analysis , 2006, ArXiv.

[34]  Alexander Zien,et al.  lp-Norm Multiple Kernel Learning , 2011, J. Mach. Learn. Res..

[35]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[36]  Rayid Ghani,et al.  Analyzing the effectiveness and applicability of co-training , 2000, CIKM '00.

[37]  Dacheng Tao,et al.  A Survey on Multi-view Learning , 2013, ArXiv.

[38]  Avrim Blum,et al.  The Bottleneck , 2021, Monopsony Capitalism.

[39]  Zenglin Xu,et al.  Simple and Efficient Multiple Kernel Learning by Group Lasso , 2010, ICML.

[40]  Ion Muslea,et al.  Active Learning with Multiple Views , 2009, Encyclopedia of Data Warehousing and Mining.

[41]  Andy Harter,et al.  Parameterisation of a stochastic model for human face identification , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[42]  Rong Jin,et al.  Online Multiple Kernel Similarity Learning for Visual Search. , 2013, IEEE transactions on pattern analysis and machine intelligence.

[43]  Robert Tibshirani,et al.  Sparse canonical correlation analysis , 2017, 1705.10865.

[44]  Ivor W. Tsang,et al.  Domain Transfer Multiple Kernel Learning , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  D. Sorensen Numerical methods for large eigenvalue problems , 2002, Acta Numerica.

[47]  Alexandros Iosifidis,et al.  Generalized Multi-View Embedding for Visual Recognition and Cross-Modal Retrieval , 2016, IEEE Transactions on Cybernetics.

[48]  A. Laptev Analysis and applications , 2010 .