Fractional generalized multiview discriminative projections and extension for multiview learning

Abstract In multi-view learning, there are a large number of small sample size problems in which the number of training samples is less than the dimension of feature vectors. For such problems, generalized multi-view linear discriminant analysis (GMLDA) usually fails to achieve good learning performance for many classification tasks. In this paper, we propose a new multi-view feature extraction method via fractional spectral modeling, namely, fractional generalized multi-view discriminant analysis (FGMDA), which is able to subsume GMLDA as a special case. In addition, an uncorrelated FGMDA (UFGMDA) is further proposed, where the extracted features are mutually uncorrelated in each view and thus have minimum redundancy. Extensive experimental results on visual recognition demonstrate the superiority of our proposed methods over the state-of-the-art methods in terms of classification accuracy.

[1]  D. Jacobs,et al.  Bypassing synthesis: PLS for face recognition with pose, low-resolution and sketch , 2011, CVPR 2011.

[2]  Yan Liu,et al.  A new method of feature fusion and its application in image recognition , 2005, Pattern Recognit..

[3]  Joshua B. Tenenbaum,et al.  Separating Style and Content with Bilinear Models , 2000, Neural Computation.

[4]  Stefan Kramer,et al.  Exploring Multiobjective Optimization for Multiview Clustering , 2018, ACM Trans. Knowl. Discov. Data.

[5]  Shiguang Shan,et al.  Multi-View Discriminant Analysis , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Shiguang Shan,et al.  Semi-Supervised Multi-View Correlation Feature Learning with Application to Webpage Classification , 2017, AAAI.

[7]  John Shawe-Taylor,et al.  Canonical Correlation Analysis: An Overview with Application to Learning Methods , 2004, Neural Computation.

[8]  Yueting Zhuang,et al.  Sparse Unsupervised Dimensionality Reduction for Multiple View Data , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Dezhong Peng,et al.  Local feature based multi-view discriminant analysis , 2018, Knowl. Based Syst..

[10]  Ke Lu,et al.  Multiview Hessian regularized logistic regression for action recognition , 2015, Signal Process..

[11]  Miki Haseyama,et al.  Sfemcca: Supervised Fractional-Order Embedding Multiview Canonical Correlation Analysis for Video Preference Estimation , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[13]  Quan-Sen Sun,et al.  Multiset Canonical Correlations Using Globality Preserving Projections With Applications to Feature Extraction and Recognition , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Sham M. Kakade,et al.  Multi-view clustering via canonical correlation analysis , 2009, ICML '09.

[15]  Feiping Nie,et al.  Multiple view semi-supervised dimensionality reduction , 2010, Pattern Recognit..

[16]  Jing Liu,et al.  Partially Shared Latent Factor Learning With Multiview Data , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Christos Faloutsos,et al.  On the 'Dimensionality Curse' and the 'Self-Similarity Blessing' , 2001, IEEE Trans. Knowl. Data Eng..

[18]  Qingming Huang,et al.  Bilevel Multiview Latent Space Learning , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Shiliang Sun,et al.  Semi-supervised multi-view maximum entropy discrimination with expectation Laplacian regularization , 2019, Inf. Fusion.

[20]  Quan-Sen Sun,et al.  Fractional-order embedding canonical correlation analysis and its applications to multi-view dimensionality reduction and recognition , 2014, Pattern Recognit..

[21]  Jieping Ye,et al.  Characterization of a Family of Algorithms for Generalized Discriminant Analysis on Undersampled Problems , 2005, J. Mach. Learn. Res..

[22]  Xuelong Li,et al.  Multi-view Subspace Clustering , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[23]  Steffen Bickel,et al.  Multi-view clustering , 2004, Fourth IEEE International Conference on Data Mining (ICDM'04).

[24]  Yongdong Zhang,et al.  Multiview Spectral Embedding , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  Weifeng Liu,et al.  Multiview dimension reduction via Hessian multiset canonical correlations , 2018, Inf. Fusion.

[26]  Philip S. Yu,et al.  A General Model for Multiple View Unsupervised Learning , 2008, SDM.

[27]  Dacheng Tao,et al.  Multi-View Intact Space Learning , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Shiliang Sun,et al.  Multiview Uncorrelated Discriminant Analysis , 2016, IEEE Transactions on Cybernetics.

[29]  Qiang Zhou,et al.  A novel multiset integrated canonical correlation analysis framework and its application in feature fusion , 2011, Pattern Recognit..

[30]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Qi Tian,et al.  Multiview Hessian Semisupervised Sparse Feature Selection for Multimedia Analysis , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[32]  Fuchun Sun,et al.  Large-Margin Predictive Latent Subspace Learning for Multiview Data Analysis , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Jiwen Lu,et al.  Nonlinear subspace clustering for image clustering , 2017, Pattern Recognit. Lett..

[34]  Jing-Yu Yang,et al.  Face recognition based on the uncorrelated discriminant transformation , 2001, Pattern Recognit..

[35]  David W. Jacobs,et al.  Generalized Multiview Analysis: A discriminative latent space , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Xuelong Li,et al.  Convex Multiview Semi-Supervised Classification , 2017, IEEE Transactions on Image Processing.

[37]  Qinghua Hu,et al.  Flexible Multi-View Dimensionality Co-Reduction , 2017, IEEE Transactions on Image Processing.