Supervised Fractional-Order Embedding Geometrical Multi-View CCA (SFGMCCA) for Multiple Feature Integration

Techniques for integrating different types of multiple features effectively have been actively studied in recent years. Multiset canonical correlation analysis (MCCA), which maximizes the sum of pairwise correlations of inter-view (i.e., between different features), is one of the powerful methods for integrating different types of multiple features, and various MCCA-based methods have been proposed. This work focuses on a supervised MCCA variant in order to construct a novel effective feature integration framework. In this paper, we newly propose supervised fractional-order embedding geometrical multi-view CCA (SFGMCCA). This method constructs not only the correlation structure but also two types of geometrical structures of intra-view (i.e., within each feature) and inter-view simultaneously, thereby realizing more precise feature integration. This method also supports the integration of small sample and high-dimensional data by using the fractional-order technique. We conducted experiments using four types of image datasets, i.e., MNIST, COIL-20, ETH-80 and CIFAR-10. Furthermore, we also performed an fMRI dataset containing brain signals to verify the robustness. As a result, it was confirmed that accuracy improvements using SFGMCCA were statistically significant at the significance level of 0.05 compared to those using conventional representative MCCA-based methods.

[1]  Weiwei Liu,et al.  Multiview Discrete Hashing for Scalable Multimedia Search , 2018, ACM Trans. Intell. Syst. Technol..

[2]  Horst Bischof,et al.  Appearance models based on kernel canonical correlation analysis , 2003, Pattern Recognit..

[3]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[4]  Miki Haseyama,et al.  Estimating Viewed Image Categories from Human Brain Activity via Semi-supervised Fuzzy Discriminative Canonical Correlation Analysis , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[6]  Haibo Wang,et al.  Supervised Multi-View Canonical Correlation Analysis (sMVCCA): Integrating Histologic and Proteomic Features for Predicting Recurrent Prostate Cancer , 2015, IEEE Transactions on Medical Imaging.

[7]  Quan-Sen Sun,et al.  A unified multiset canonical correlation analysis framework based on graph embedding for multiple feature extraction , 2015, Neurocomputing.

[8]  Shiliang Sun,et al.  A survey of multi-view machine learning , 2013, Neural Computing and Applications.

[9]  Pavel Pudil,et al.  Introduction to Statistical Pattern Recognition , 2006 .

[10]  Quan-Sen Sun,et al.  Laplacian multiset canonical correlations for multiview feature extraction and image recognition , 2015, Multimedia Tools and Applications.

[11]  Miki Haseyama,et al.  Sfemcca: Supervised Fractional-Order Embedding Multiview Canonical Correlation Analysis for Video Preference Estimation , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Long Lan,et al.  Discriminative Locality Preserving Canonical Correlation Analysis , 2012, CCPR.

[13]  Olivier Ledoit,et al.  A well-conditioned estimator for large-dimensional covariance matrices , 2004 .

[14]  David W. Jacobs,et al.  Generalized Multiview Analysis: A discriminative latent space , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  L. Tucker,et al.  Some mathematical notes on three-mode factor analysis , 1966, Psychometrika.

[16]  Y. Takane,et al.  Regularized Multiple-Set Canonical Correlation Analysis , 2008 .

[17]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[18]  Allan Aasbjerg Nielsen,et al.  Multiset canonical correlations analysis and multispectral, truly multitemporal remote sensing data , 2002, IEEE Trans. Image Process..

[19]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[20]  Jing-Yu Yang,et al.  Kernelized discriminative canonical correlation analysis , 2007, 2007 International Conference on Wavelet Analysis and Pattern Recognition.

[21]  Sameer A. Nene,et al.  Columbia Object Image Library (COIL100) , 1996 .

[22]  Miki Haseyama,et al.  Novel Audio Feature Projection Using KDLPCCA-Based Correlation with EEG Features for Favorite Music Classification , 2019, IEEE Transactions on Affective Computing.

[23]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[24]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[25]  Shiliang Sun,et al.  Multiview Uncorrelated Discriminant Analysis , 2016, IEEE Transactions on Cybernetics.

[26]  Songcan Chen,et al.  Locality preserving CCA with applications to data visualization and pose estimation , 2007, Image Vis. Comput..

[27]  Raman Arora,et al.  Multi-view CCA-based acoustic features for phonetic recognition across speakers and domains , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[28]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[29]  J. Kettenring,et al.  Canonical Analysis of Several Sets of Variables , 2022 .

[30]  Yong Luo,et al.  Tensor Canonical Correlation Analysis for Multi-View Dimension Reduction , 2015, IEEE Transactions on Knowledge and Data Engineering.

[31]  J. Daugman Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[32]  Jieping Ye,et al.  Feature Reduction via Generalized Uncorrelated Linear Discriminant Analysis , 2006, IEEE Transactions on Knowledge and Data Engineering.

[33]  Makoto Aoshima,et al.  Effective PCA for high-dimension, low-sample-size data with noise reduction via geometric representations , 2012, J. Multivar. Anal..

[34]  Quan-Sen Sun,et al.  Fractional-order embedding canonical correlation analysis and its applications to multi-view dimensionality reduction and recognition , 2014, Pattern Recognit..

[35]  Luuk J. Spreeuwers,et al.  A Bootstrap Approach to Eigenvalue Correction , 2009, 2009 Ninth IEEE International Conference on Data Mining.

[36]  Lei Gao,et al.  Discriminative Multiple Canonical Correlation Analysis for Information Fusion , 2018, IEEE Transactions on Image Processing.

[37]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[38]  Quan-Sen Sun,et al.  A novel semi-supervised canonical correlation analysis and extensions for multi-view dimensionality reduction , 2014, J. Vis. Commun. Image Represent..

[39]  Gang Wang,et al.  Graph Multiview Canonical Correlation Analysis , 2018, IEEE Transactions on Signal Processing.

[40]  Shiliang Sun,et al.  Multi-view uncorrelated linear discriminant analysis with applications to handwritten digit recognition , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[41]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[42]  Xiaoyang Tan,et al.  Fractional order singular value decomposition representation for face recognition , 2008, Pattern Recognit..

[43]  Daoqiang Zhang,et al.  A New Locality-Preserving Canonical Correlation Analysis Algorithm for Multi-View Dimensionality Reduction , 2013, Neural Processing Letters.

[44]  Joos Vandewalle,et al.  A Multilinear Singular Value Decomposition , 2000, SIAM J. Matrix Anal. Appl..

[45]  John Shawe-Taylor,et al.  Canonical Correlation Analysis: An Overview with Application to Learning Methods , 2004, Neural Computation.

[46]  Chaofeng Li,et al.  Learning multi-kernel multi-view canonical correlations for image recognition , 2016, Computational Visual Media.

[47]  Bernt Schiele,et al.  Analyzing appearance and contour based methods for object categorization , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[48]  Quansen Sun,et al.  Graph regularized multiset canonical correlations with applications to joint feature extraction , 2014, Pattern Recognit..

[49]  Alex Krizhevsky,et al.  Learning Multiple Layers of Features from Tiny Images , 2009 .

[50]  Quan-Sen Sun,et al.  Fractional-order embedding multiset canonical correlations with applications to multi-feature fusion and recognition , 2013, Neurocomputing.

[51]  Avrim Blum,et al.  The Bottleneck , 2021, Monopsony Capitalism.

[52]  Miki Haseyama,et al.  Multi-feature Fusion Based on Supervised Multi-view Multi-label Canonical Correlation Projection , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[53]  H. Hotelling Relations Between Two Sets of Variates , 1936 .

[54]  Tomoyasu Horikawa,et al.  Generic decoding of seen and imagined objects using hierarchical visual features , 2015, Nature Communications.

[55]  Yann LeCun,et al.  The mnist database of handwritten digits , 2005 .