A New Locality-Preserving Canonical Correlation Analysis Algorithm for Multi-View Dimensionality Reduction

Canonical correlation analysis (CCA) is a well-known technique for extracting linearly correlated features from multiple views (i.e., sets of features) of data. Recently, a locality-preserving CCA, named LPCCA, has been developed to incorporate the neighborhood information into CCA. Although LPCCA is proved to be better in revealing the intrinsic data structure than CCA, its discriminative power for subsequent classification is low on high-dimensional data sets such as face databases. In this paper, we propose an alternative formulation for integrating the neighborhood information into CCA and derive a new locality-preserving CCA algorithm called ALPCCA, which can better discover the local manifold structure of data and further enhance the discriminative power for high-dimensional classification. The experimental results on both synthetic and real-world data sets including multiple feature data set and face databases validate the effectiveness of the proposed method.

[1]  Bovas Abraham,et al.  Dimensionality reduction approach to multivariate prediction , 2005, Comput. Stat. Data Anal..

[2]  Colin Fyfe,et al.  Kernel and Nonlinear Canonical Correlation Analysis , 2000, IJCNN.

[3]  Samuel Kaski,et al.  Local dependent components , 2007, ICML '07.

[4]  Wei Wu,et al.  A kernelized discriminant analysis algorithm based on modified generalized singular value decomposition , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[5]  Yan Liu,et al.  A new method of feature fusion and its application in image recognition , 2005, Pattern Recognit..

[6]  Kenji Fukumizu,et al.  Consistency of Kernel Canonical Correlation Analysis , 2005 .

[7]  H. Hotelling Relations Between Two Sets of Variates , 1936 .

[8]  Ulf Brefeld,et al.  Multi-view Discriminative Sequential Learning , 2005, ECML.

[9]  Michael I. Jordan,et al.  A Probabilistic Interpretation of Canonical Correlation Analysis , 2005 .

[10]  Daoqiang Zhang,et al.  A novel ensemble construction method for multi-view data using random cross-view correlation between within-class examples , 2011, Pattern Recognit..

[11]  Vikas Sindhwani,et al.  An RKHS for multi-view learning and manifold co-regularization , 2008, ICML '08.

[12]  Carla E. Brodley,et al.  Correlation Clustering for Learning Mixtures of Canonical Correlation Models , 2005, SDM.

[13]  Kenji Fukumizu,et al.  Statistical Consistency of Kernel Canonical Correlation Analysis , 2007 .

[14]  W. Hsieh Machine Learning Methods in the Environmental Sciences: Nonlinear canonical correlation analysis , 2009 .

[15]  Dao-Qiang Zhang,et al.  Clustering Incomplete Data Using Kernel-Based Fuzzy C-means Algorithm , 2003, Neural Processing Letters.

[16]  Johan A. K. Suykens,et al.  Subset based least squares subspace regression in RKHS , 2005, Neurocomputing.

[17]  Tom Diethe,et al.  Multiview Fisher Discriminant Analysis , 2008 .

[18]  Samuel Kaski,et al.  Multi-Way, Multi-View Learning , 2009 .

[19]  Fei Wang,et al.  Multi-View Local Learning , 2008, AAAI.

[20]  Horst Bischof,et al.  Appearance models based on kernel canonical correlation analysis , 2003, Pattern Recognit..

[21]  I. Jolliffe Principal Component Analysis , 2002 .

[22]  Sergios Theodoridis,et al.  Pattern Recognition, Third Edition , 2006 .

[23]  Mahmood R. Azimi-Sadjadi,et al.  Nonlinear Signal Estimation using KernelWiener Filter in Canonical Correlation Analysis Framework , 2005, International Conference on Computational Intelligence for Modelling, Control and Automation and International Conference on Intelligent Agents, Web Technologies and Internet Commerce (CIMCA-IAWTIC'06).

[24]  Songcan Chen,et al.  Locality preserving CCA with applications to data visualization and pose estimation , 2007, Image Vis. Comput..

[25]  John Shawe-Taylor,et al.  Canonical Correlation Analysis: An Overview with Application to Learning Methods , 2004, Neural Computation.

[26]  Allan Aasbjerg Nielsen,et al.  Multiset canonical correlations analysis and multispectral, truly multitemporal remote sensing data , 2002, IEEE Trans. Image Process..

[27]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[28]  Y. Hel-Or The Canonical Correlations of Color Images and their use for Demosaicing , 2004 .

[29]  Seyed Alireza Zekavat,et al.  Feature Extraction via Kernelized Signal Fraction Analysis vs Kernelized Principal Component Analysis , 2008, DMIN.

[30]  William W. Hsieh,et al.  Nonlinear canonical correlation analysis by neural networks , 2000, Neural Networks.

[31]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[32]  Philip S. Yu,et al.  A General Model for Multiple View Unsupervised Learning , 2008, SDM.