Multi-view local discrimination and canonical correlation analysis for image classification

Abstract Multi-view subspace learning has been aroused much concern recently. Although there exist a few multi-view subspace learning methods taking both the discrimination information and the correlation information into consideration, they always ignore the use of the inter-view discriminant information. In view of this, we propose an approach called multi-view local discrimination and canonical correlation analysis (MLDC2A) for image classification. MLDC2A aims to learn a common multi-view subspace from multi-view data, by making use of not only the discriminant information from both intra-view and inter-view but also the correlation information between paired view data. Furthermore, in the learned subspace, the local geometric structure of multi-view data is preserved. We conduct experiments on MNIST, COIL-20, Multi-PIE, Caltech-101, and COCO datasets and the results indicate the effectiveness of the proposed approach.

[1]  Yong Luo,et al.  Low-Rank Multi-View Learning in Matrix Completion for Multi-Label Image Classification , 2015, AAAI.

[2]  Chun Chen,et al.  Multi-view based multi-label propagation for image annotation , 2015, Neurocomputing.

[3]  Wei Xu,et al.  CNN-RNN: A Unified Framework for Multi-label Image Classification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Wei Liu,et al.  Multi-View Matrix Decomposition: A New Scheme for Exploring Discriminative Information , 2015, IJCAI.

[6]  Wei Liu,et al.  Latent Max-Margin Multitask Learning With Skelets for 3-D Action Recognition , 2017, IEEE Transactions on Cybernetics.

[7]  Songcan Chen,et al.  Locality preserving CCA with applications to data visualization and pose estimation , 2007, Image Vis. Comput..

[8]  Pietro Perona,et al.  One-shot learning of object categories , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Wei Liu,et al.  Discriminative Multi-instance Multitask Learning for 3D Action Recognition , 2017, IEEE Transactions on Multimedia.

[10]  Quan-Sen Sun,et al.  Laplacian multiset canonical correlations for multiview feature extraction and image recognition , 2015, Multimedia Tools and Applications.

[11]  Fuzhen Zhuang,et al.  Multi-view learning via probabilistic latent semantic analysis , 2012, Inf. Sci..

[12]  Xiaoqing Ding,et al.  MiLDA: A graph embedding approach to multi-view face recognition , 2015, Neurocomputing.

[13]  Dong Yue,et al.  Multi-view low-rank dictionary learning for image classification , 2016, Pattern Recognit..

[14]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[15]  Shuang Gao,et al.  A locality correlation preserving support vector machine , 2014, Pattern Recognit..

[16]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[17]  Yadong Mu,et al.  Large-scale multi-task image labeling with adaptive relevance discovery and feature hashing , 2015, Signal Process..

[18]  Ruiping Wang,et al.  Manifold Discriminant Analysis , 2009, CVPR.

[19]  Andrew Zisserman,et al.  Image Classification using Random Forests and Ferns , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[20]  Geoffrey Zweig,et al.  From captions to visual concepts and back , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Shiguang Shan,et al.  Multi-View Discriminant Analysis , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  David W. Jacobs,et al.  Generalized Multiview Analysis: A discriminative latent space , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[24]  Shiliang Sun,et al.  Hierarchical Multi-view Fisher Discriminant Analysis , 2009, ICONIP.

[25]  Jitendra Malik,et al.  SVM-KNN: Discriminative Nearest Neighbor Classification for Visual Category Recognition , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[26]  Baowen Xu,et al.  Web Page Classification Based on Uncorrelated Semi-Supervised Intra-View and Inter-View Manifold Discriminant Feature Extraction , 2015, IJCAI.

[27]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[28]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[29]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[30]  Jing-Yu Yang,et al.  Unsupervised discriminant canonical correlation analysis based on spectral clustering , 2016, Neurocomputing.

[31]  Kun Zhou,et al.  Locality Sensitive Discriminant Analysis , 2007, IJCAI.

[32]  Jieping Ye,et al.  Using uncorrelated discriminant analysis for tissue classification with gene expression data , 2004, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[33]  Wei Gao,et al.  Multi-View Discriminant Transfer Learning , 2013, IJCAI.

[34]  Xin Shu,et al.  Multi-view uncorrelated discriminant analysis via dependence maximization , 2018, Applied Intelligence.

[35]  Aristidis Likas,et al.  Weighted multi-view key-frame extraction , 2016, Pattern Recognit. Lett..

[36]  Balaraman Ravindran,et al.  From multiple views to single view: a neural network approach , 2015, CODS.

[37]  Rongrong Ji,et al.  Visual Reranking through Weakly Supervised Multi-graph Learning , 2013, 2013 IEEE International Conference on Computer Vision.

[38]  Zhaoyang Lu,et al.  A subset method for improving Linear Discriminant Analysis , 2014, Neurocomputing.

[39]  Hiroshi Murase,et al.  Visual learning and recognition of 3-d objects from appearance , 2005, International Journal of Computer Vision.

[40]  Jun Yue,et al.  Supervised multiview learning based on simultaneous learning of multiview intact and single view classifier , 2016, Neural Computing and Applications.

[41]  Quan-Sen Sun,et al.  Orthogonal Multiset Canonical Correlation Analysis based on Fractional-Order and Its Application in Multiple Feature Extraction and Recognition , 2014, Neural Processing Letters.

[42]  Yuhong Guo,et al.  Convex Subspace Representation Learning from Multi-View Data , 2013, AAAI.

[43]  Lei Huang,et al.  Efficient semi-supervised annotation with Proxy-based Local Consistency Propagation , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[44]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[45]  Vince D. Calhoun,et al.  Joint Blind Source Separation by Multiset Canonical Correlation Analysis , 2009, IEEE Transactions on Signal Processing.

[46]  Quan-Sen Sun,et al.  A unified multiset canonical correlation analysis framework based on graph embedding for multiple feature extraction , 2015, Neurocomputing.

[47]  Lei Gao,et al.  Discriminative Multiple Canonical Correlation Analysis for Multi-feature Information Fusion , 2012, 2012 IEEE International Symposium on Multimedia.

[48]  Yong Wang,et al.  Global–local fisher discriminant approach for face recognition , 2014, Neural Computing and Applications.

[49]  Ignacio Rojas,et al.  Advances in Artificial Neural Networks and Computational Intelligence , 2015, Neural Processing Letters.

[50]  Shudong Hou,et al.  An orthogonal regularized CCA learning algorithm for feature fusion , 2014, J. Vis. Commun. Image Represent..

[51]  Gang Hua,et al.  Hierarchical-PEP model for real-world face recognition , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[52]  Jiawei Han,et al.  Orthogonal Laplacianfaces for Face Recognition , 2006, IEEE Transactions on Image Processing.

[53]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[54]  Quansen Sun,et al.  Graph regularized multiset canonical correlations with applications to joint feature extraction , 2014, Pattern Recognit..

[55]  Xiaogang Wang,et al.  Hybrid Deep Learning for Face Verification , 2013, ICCV.

[56]  Lei Huang,et al.  Online semi-supervised annotation via proxy-based local consistency propagation , 2015, Neurocomputing.

[57]  Xianglong Liu,et al.  Multiple feature kernel hashing for large-scale visual search , 2014, Pattern Recognit..

[58]  Steven C. H. Hoi,et al.  Multiview Semi-Supervised Learning with Consensus , 2012, IEEE Transactions on Knowledge and Data Engineering.

[59]  Xuelong Li,et al.  Large-Scale Unsupervised Hashing with Shared Structure Learning , 2015, IEEE Transactions on Cybernetics.

[60]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[61]  Dacheng Tao,et al.  Multi-View Learning With Incomplete Views , 2015, IEEE Transactions on Image Processing.

[62]  Keinosuke Fukunaga,et al.  Application of the Karhunen-Loève Expansion to Feature Selection and Ordering , 1970, IEEE Trans. Computers.

[63]  Qing Wang,et al.  Multi-view Sparse Embedding Analysis Based Image Feature Extraction and Classification , 2015, CCCV.

[64]  Shiliang Sun,et al.  Multi-view uncorrelated linear discriminant analysis with applications to handwritten digit recognition , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[65]  Nicolai Petkov,et al.  Comparison of texture features based on Gabor filters , 2002, IEEE Trans. Image Process..

[66]  Xiao-Yuan Jing,et al.  Intra-View and Inter-View Supervised Correlation Analysis for Multi-View Feature Learning , 2014, AAAI.

[67]  Yee Ming Chen,et al.  Face recognition using combined multiple feature extraction based on Fourier-Mellin approach for single example image per person , 2010, Pattern Recognit. Lett..

[68]  Jenny Benois-Pineau,et al.  Multi-layer Local Graph Words for Object Recognition , 2012, MMM.