Multiple-rank supervised canonical correlation analysis for feature extraction, fusion and recognition

A supervised two-dimensional CCA method is proposed for feature extraction.By further exploration another supervised framework is also presented.Experimental results of our methods superior/comparable to the literature. The traditional CCA and 2D-CCA algorithms are unsupervised multiple feature extraction methods. Hence, introducing the supervised information of samples into these methods should be able to promote the classification performance. In this paper, a novel method is proposed to carry out the multiple feature extraction for classification, called two-dimensional supervised canonical correlation analysis (2D-SCCA), in which the supervised information is added to the criterion function. Then, by analyzing the relationship between GCCA and 2D-SCCA, another feature extraction method called multiple-rank supervised canonical correlation analysis (MSCCA) is also developed. Different from 2D-SCCA, in MSCCA k pairs left transforms and k pairs right transforms are sought to maximize the correlation. The convergence behavior and computational complexity of the algorithms are analyzed. Experimental results on real-world databases demonstrate the viability of the formulation, they also show that the classification results of our methods are higher than the others and the computing time is competitive. In this manner, the proposed methods proved to be the competitive multiple feature extraction and classification methods. As such, the two methods may well help to improve image recognition tasks, which are essential in many advanced expert and intelligent systems.

[1]  Xianglei Xing,et al.  Complete canonical correlation analysis with application to multi-view gait recognition , 2016, Pattern Recognit..

[2]  Alejandro F. Frangi,et al.  Two-dimensional PCA: a new approach to appearance-based face representation and recognition , 2004 .

[3]  H. Hotelling.  Relations Between Two Sets of Variates , 1936 .

[4]  John Shawe-Taylor,et al.  Canonical Correlation Analysis: An Overview with Application to Learning Methods , 2004, Neural Computation.

[5]  Abdolreza Mirzaei,et al.  Probabilistic two-dimensional canonical correlation analysis for face recognition , 2014, 2014 4th International Conference on Computer and Knowledge Engineering (ICCKE).

[6]  Ning Sun,et al.  Two-dimensional canonical correlation analysis and its application in small sample size face recognition , 2010, Neural Computing and Applications.

[7]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Ognjen Arandjelovic.  Discriminative extended canonical correlation analysis for pattern set matching , 2013, Machine Learning.

[9]  Songcan Chen,et al.  Locality preserving CCA with applications to data visualization and pose estimation , 2007, Image Vis. Comput..

[10]  Feiping Nie,et al.  Multiple rank multi-linear SVM for matrix data classification , 2014, Pattern Recognit..

[11]  Haixian Wang,et al.  Local Two-Dimensional Canonical Correlation Analysis , 2010, IEEE Signal Processing Letters.

[12]  Yan Liu,et al.  A new method of feature fusion and its application in image recognition , 2005, Pattern Recognit..

[13]  T. W. Anderson.  An Introduction to Multivariate Statistical Analysis , 1959 .

[14]  W. Zheng,et al.  Facial expression recognition using kernel canonical correlation analysis (KCCA) , 2006, IEEE Transactions on Neural Networks.

[15]  Seungjin Choi,et al.  Two-Dimensional Canonical Correlation Analysis , 2007, IEEE Signal Processing Letters.

[16]  Quan-Sen Sun,et al.  Multiset Canonical Correlations Using Globality Preserving Projections With Applications to Feature Extraction and Recognition , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Sameer A. Nene,et al.  Columbia Object Image Library (COIL100) , 1996 .

[18]  Yoshihiro Yamanishi,et al.  Extraction of correlated gene clusters from multiple genomic data by generalized kernel canonical correlation analysis , 2003, ISMB.

[19]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[20]  Horst Bischof,et al.  Appearance models based on kernel canonical correlation analysis , 2003, Pattern Recognit..

[21]  Delin Chu,et al.  Sparse Canonical Correlation Analysis: New Formulation and Algorithm. , 2013, IEEE transactions on pattern analysis and machine intelligence.

[22]  Haitao Xu,et al.  A novel method for classification of matrix data using Twin Multiple Rank SMMs , 2016, Appl. Soft Comput..

[23]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[24]  Liang Xiao,et al.  Image dehazing using two-dimensional canonical correlation analysis , 2015, IET Comput. Vis..

[25]  Michel Verhaegen,et al.  Closed-loop identification using canonical correlation analysis , 1999, 1999 European Control Conference (ECC).

[26]  Michael I. Jordan,et al.  A Probabilistic Interpretation of Canonical Correlation Analysis , 2005 .

[27]  Nello Cristianini,et al.  Inferring a Semantic Representation of Text via Cross-Language Correlation Analysis , 2002, NIPS.

[28]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[29]  Xiao-Jun Wu.  2D-CCA based on pseudoinverse technique , 2009, 2009 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications.

[30]  Jieping Ye,et al.  Canonical Correlation Analysis for Multilabel Classification: A Least-Squares Formulation, Extensions, and Analysis , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Pheng-Ann Heng,et al.  A theorem on the generalized canonical projective vectors , 2005, Pattern Recognit..