A generalized multi-dictionary least squares framework regularized with multi-graph embeddings

Abstract Dimensionality reduction in high dimensional multi-view datasets is an important research topic. It can keep essential features to improve performance in subsequent tasks such as classification and clustering. This paper proposes a generalized framework, which extends the PCA idea of minimizing least squares reconstruction errors, to include data distribution and multiple dictionaries for preserving outliers-free global structures in multi-view datasets. To also preserve local manifold structures, multiple local graphs are incorporated. Finally two models, in Multi-dictionary Least Squares Framework regularized with Multi-graph Embeddings (MD-MGE), are proposed for preserving both global and local structures. Extensive experimental results on four multi-view datasets prove both methods outperform the existing comparative methods. Also, their accuracy rates improvements are statistically significant on all cases below the significance level of 0.05.

[1]  Tong Lu,et al.  Learning discriminated and correlated patches for multi-view object detection using sparse coding , 2017, Pattern Recognit..

[2]  Christophe Moulin,et al.  Fisher Linear Discriminant Analysis for text-image combination in multimedia information retrieval , 2014, Pattern Recognit..

[3]  Shuicheng Yan,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007 .

[4]  Yong Wang,et al.  L1-norm-based principal component analysis with adaptive regularization , 2016, Pattern Recognit..

[5]  Adrian Barbu,et al.  Parameterized principal component analysis , 2016, Pattern Recognit..

[6]  Songcan Chen,et al.  Locality preserving CCA with applications to data visualization and pose estimation , 2007, Image Vis. Comput..

[7]  Zhenyu He,et al.  Joint sparse principal component analysis , 2017, Pattern Recognit..

[8]  Jian Yang,et al.  Constructing PCA Baseline Algorithms to Reevaluate ICA-Based Face-Recognition Performance , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  Yongdong Zhang,et al.  Multiview Spectral Embedding , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Dao-Qing Dai,et al.  Regularized coplanar discriminant analysis for dimensionality reduction , 2017, Pattern Recognit..

[11]  Shiliang Sun,et al.  PAC-Bayes analysis of multi-view learning , 2014, Inf. Fusion.

[12]  Quan-Sen Sun,et al.  Fractional-order embedding canonical correlation analysis and its applications to multi-view dimensionality reduction and recognition , 2014, Pattern Recognit..

[13]  David Zhang,et al.  Maximal granularity structure and generalized multi-view discriminant analysis for person re-identification , 2018, Pattern Recognit..

[14]  Liang Wang,et al.  Unified subspace learning for incomplete and unlabeled multi-view data , 2017, Pattern Recognit..

[15]  Hong Yu,et al.  Multi-view clustering via multi-manifold regularized non-negative matrix factorization , 2017, Neural Networks.

[16]  Hong Qiao,et al.  An improved local tangent space alignment method for manifold learning , 2011, Pattern Recognit. Lett..

[17]  Xianglei Xing,et al.  Complete canonical correlation analysis with application to multi-view gait recognition , 2016, Pattern Recognit..

[18]  Ajay Kumar,et al.  Contactless and partial 3D fingerprint recognition using multi-view deep representation , 2018, Pattern Recognit..

[19]  Feiping Nie,et al.  Optimal mean two-dimensional principal component analysis with F-norm minimization , 2017, Pattern Recognit..

[20]  Sheng Hong,et al.  Classification of the emotional stress and physical stress using signal magnification and canonical correlation analysis , 2018, Pattern Recognit..

[21]  Jianping Gou,et al.  Dictionary-induced least squares framework for multi-view dimensionality reduction with multi-manifold embeddings , 2019, IET Comput. Vis..

[22]  Ajmal S. Mian,et al.  Learning a deeply supervised multi-modal RGB-D embedding for semantic scene and object category recognition , 2017, Robotics Auton. Syst..

[23]  Daoqiang Zhang,et al.  A New Locality-Preserving Canonical Correlation Analysis Algorithm for Multi-View Dimensionality Reduction , 2013, Neural Processing Letters.

[24]  D. Jacobs,et al.  Bypassing synthesis: PLS for face recognition with pose, low-resolution and sketch , 2011, CVPR 2011.

[25]  Hongtao Lu,et al.  Efficient linear discriminant analysis with locality preserving for face recognition , 2012, Pattern Recognit..

[26]  Rong Wang,et al.  Robust 2DPCA With Non-greedy $\ell _{1}$ -Norm Maximization for Image Analysis , 2015, IEEE Transactions on Cybernetics.

[27]  Bo Du,et al.  Ensemble manifold regularized sparse low-rank approximation for multiview feature embedding , 2015, Pattern Recognit..

[28]  Bo Yang,et al.  Multi-manifold Discriminant Isomap for visualization and classification , 2016, Pattern Recognit..

[29]  Sameer A. Nene,et al.  Columbia Object Image Library (COIL100) , 1996 .

[30]  David W. Jacobs,et al.  Generalized Multiview Analysis: A discriminative latent space , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Kaizhu Huang,et al.  Learning Locality Preserving Graph from Data , 2014, IEEE Transactions on Cybernetics.

[32]  Wei Yuan,et al.  Multi-view manifold learning with locality alignment , 2018, Pattern Recognit..

[33]  Jiawei Han,et al.  Spectral Regression for Efficient Regularized Subspace Learning , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[34]  Nenghai Yu,et al.  Neighborhood Preserving Projections (NPP): A Novel Linear Dimension Reduction Method , 2005, ICIC.

[35]  Amir Hussain,et al.  An online generalized eigenvalue version of Laplacian Eigenmaps for visual big data , 2016, Neurocomputing.

[36]  Xiaogang Wang,et al.  Stable locality sensitive discriminant analysis for image recognition , 2014, Neural Networks.

[37]  Yan Zhang,et al.  Semi-supervised local multi-manifold Isomap by linear embedding for feature extraction , 2018, Pattern Recognit..

[38]  Weifeng Liu,et al.  Multiview Hessian Regularization for Image Annotation , 2013, IEEE Transactions on Image Processing.

[39]  Meng Wang,et al.  Unified Video Annotation via Multigraph Learning , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[40]  Jiwen Lu,et al.  Regularized Locality Preserving Projections and Its Extensions for Face Recognition , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[41]  H. Hotelling Relations Between Two Sets of Variates , 1936 .

[42]  Ahmed M. Elgammal,et al.  Learning representations from multiple manifolds , 2016, Pattern Recognit..

[43]  Bo Yang,et al.  Low-rank preserving embedding , 2017, Pattern Recognit..

[44]  Geyong Min,et al.  Deep Discrete Cross-Modal Hashing for Cross-Media Retrieval , 2018, Pattern Recognit..

[45]  Jieping Ye,et al.  Canonical Correlation Analysis for Multilabel Classification: A Least-Squares Formulation, Extensions, and Analysis , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Wei Jia,et al.  Discriminant sparse neighborhood preserving embedding for face recognition , 2012, Pattern Recognit..

[47]  S. Sisson,et al.  A comparative review of dimension reduction methods in approximate Bayesian computation , 2012, 1202.3819.

[48]  Kun Zhou,et al.  Locality Sensitive Discriminant Analysis , 2007, IJCAI.

[49]  James E. Fowler,et al.  Locality-Preserving Discriminant Analysis in Kernel-Induced Feature Spaces for Hyperspectral Image Classification , 2011, IEEE Geoscience and Remote Sensing Letters.

[50]  H. Abdi,et al.  Principal component analysis , 2010 .

[51]  Xiaoyang Tan,et al.  Pattern Recognition , 2016, Communications in Computer and Information Science.

[52]  Li Liu,et al.  Breast mass classification via deeply integrating the contextual information from multi-view data , 2018, Pattern Recognit..

[53]  Xun Wang,et al.  Multi-view dimensionality reduction via subspace structure agreement , 2016, Multimedia Tools and Applications.

[54]  Shiguang Shan,et al.  Multi-View Discriminant Analysis , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[55]  Weiming Zeng,et al.  A new method for independent component analysis with priori information based on multi-objective optimization , 2017, Journal of Neuroscience Methods.

[56]  Fernando De la Torre,et al.  A Least-Squares Framework for Component Analysis , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[57]  Shanwen Zhang,et al.  Modified locally linear discriminant embedding for plant leaf recognition , 2011, Neurocomputing.

[58]  Nojun Kwak,et al.  Generalized mean for robust principal component analysis , 2016, Pattern Recognit..

[59]  Xin Xu,et al.  Reinforcement learning with automatic basis construction based on isometric feature mapping , 2014, Inf. Sci..

[60]  Feiping Nie,et al.  Detecting Coherent Groups in Crowd Scenes by Multiview Clustering , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[61]  Tao Chen,et al.  Nonlinear process monitoring and fault isolation using extended maximum variance unfolding , 2014 .

[62]  Ahmed M. Elgammal,et al.  Gait style and gait content: bilinear models for gait recognition using gait re-sampling , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..