Cost Sensitive Semi-Supervised Canonical Correlation Analysis for Multi-view Dimensionality Reduction

To deal with the cost sensitive and semi-supervised learning problems in Multi-view Dimensionality Reduction (MDR), we propose a Cost Sensitive Semi-Supervised Canonical Correlation Analysis $$(\hbox {CS}^{3}\hbox {CCA}). \hbox {CS}^{3}\hbox {CCA}$$(CS3CCA).CS3CCA first uses the $$L_2$$L2 norm approach to obtain the soft label for each unlabeled data, and then embed the misclassification cost into the framework of Canonical Correlation Analysis (CCA). Compared with existing CCA based methods, $$\hbox {CS}^{3}\hbox {CCA}$$CS3CCA has the following advantages: (1) It uses the $$L_2$$L2 norm approach to infer the soft label for unlabeled data, which is computationally efficient and effective, especially for cost sensitive face recognition. (2) The objective function of $$\hbox {CS}^{3}\hbox {CCA}$$CS3CCA not only maximizes the soft cost sensitive within-class correlations and minimizes the soft cost sensitive between-class correlations in the inter-view, but also considers the class imbalance problem simultaneously. With the discriminant projections learned by $$\hbox {CS}^{3}\hbox {CCA}$$CS3CCA, we employ it for cost sensitive face recognition. The experimental results on four well-known face data sets, including AR, Extended Yale B, PIE and ORL, demonstrate the effectiveness of $$\hbox {CS}^{3}\hbox {CCA}$$CS3CCA.

[1]  Chun Chen,et al.  Multi-view based multi-label propagation for image annotation , 2015, Neurocomputing.

[2]  Feiping Nie,et al.  Multiple view semi-supervised dimensionality reduction , 2010, Pattern Recognit..

[3]  Daoqiang Zhang,et al.  Cost-sensitive feature selection with application in software defect prediction , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[4]  Senén Barro,et al.  Do we need hundreds of classifiers to solve real world classification problems? , 2014, J. Mach. Learn. Res..

[5]  Anders P. Eriksson,et al.  Is face recognition really a Compressive Sensing problem? , 2011, CVPR 2011.

[6]  John Shawe-Taylor,et al.  Sparse canonical correlation analysis , 2009, Machine Learning.

[7]  Shiguang Shan,et al.  Multi-view Discriminant Analysis , 2012, ECCV.

[8]  Pengfei Shi,et al.  A Novel Method of Combined Feature Extraction for Recognition , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[9]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[10]  A. Martínez,et al.  The AR face databasae , 1998 .

[11]  Ping Li,et al.  Hypergraph canonical correlation analysis for multi-label classification , 2014, Signal Process..

[12]  Zhi-Hua Zhou,et al.  Cost-sensitive face recognition , 2008, CVPR.

[13]  Andy Harter,et al.  Parameterisation of a stochastic model for human face identification , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[14]  Zhi-Hua Zhou,et al.  The Influence of Class Imbalance on Cost-Sensitive Learning: An Empirical Study , 2006, Sixth International Conference on Data Mining (ICDM'06).

[15]  Colin Fyfe,et al.  Kernel and Nonlinear Canonical Correlation Analysis , 2000, IJCNN.

[16]  Shiliang Sun,et al.  A survey of multi-view machine learning , 2013, Neural Computing and Applications.

[17]  Hiroyuki Arai,et al.  Alternating Co-Quantization for Cross-Modal Hashing , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[18]  Ming Yang,et al.  Discriminative cost sensitive Laplacian score for face recognition , 2015, Neurocomputing.

[19]  Jieping Ye,et al.  Canonical Correlation Analysis for Multilabel Classification: A Least-Squares Formulation, Extensions, and Analysis , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Kai Ming Ting,et al.  An Instance-weighting Method to Induce Cost-sensitive Trees , 2001 .

[21]  Ming Yang,et al.  Pairwise Costs in Semisupervised Discriminant Analysis for Face Recognition , 2014, IEEE Transactions on Information Forensics and Security.

[22]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[23]  Daoqiang Zhang,et al.  A New Locality-Preserving Canonical Correlation Analysis Algorithm for Multi-View Dimensionality Reduction , 2013, Neural Processing Letters.

[24]  Tom Diethe,et al.  Multiview Fisher Discriminant Analysis , 2008 .

[25]  Shiliang Sun,et al.  Multiview Uncorrelated Discriminant Analysis , 2016, IEEE Transactions on Cybernetics.

[26]  Daoqiang Zhang,et al.  A New Canonical Correlation Analysis Algorithm with Local Discrimination , 2010, Neural Processing Letters.

[27]  Quan-Sen Sun,et al.  Fractional-order embedding canonical correlation analysis and its applications to multi-view dimensionality reduction and recognition , 2014, Pattern Recognit..

[28]  Jun Yu,et al.  Pairwise constraints based multiview features fusion for scene classification , 2013, Pattern Recognit..

[29]  Quan-Sen Sun,et al.  A novel semi-supervised canonical correlation analysis and extensions for multi-view dimensionality reduction , 2014, J. Vis. Commun. Image Represent..

[30]  Shiliang Sun,et al.  Multi-view uncorrelated linear discriminant analysis with applications to handwritten digit recognition , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[31]  Alvin C. Rencher,et al.  Methods of multivariate analysis (second edition) , 2002 .

[32]  Xuelong Li,et al.  Spectral Multimodal Hashing and Its Application to Multimedia Retrieval , 2016, IEEE Transactions on Cybernetics.

[33]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Jiwen Lu,et al.  Cost-Sensitive Semi-Supervised Discriminant Analysis for Face Recognition , 2012, IEEE Transactions on Information Forensics and Security.

[35]  Delin Chu,et al.  Sparse Canonical Correlation Analysis: New Formulation and Algorithm. , 2013, IEEE transactions on pattern analysis and machine intelligence.

[36]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[37]  H. Hotelling Relations Between Two Sets of Variates , 1936 .

[38]  Songcan Chen,et al.  Locality preserving CCA with applications to data visualization and pose estimation , 2007, Image Vis. Comput..

[39]  Dacheng Tao,et al.  A Survey on Multi-view Learning , 2013, ArXiv.

[40]  Jiwen Lu,et al.  Cost-sensitive subspace learning for face recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[41]  Xiaohong Chen,et al.  A unified dimensionality reduction framework for semi-paired and semi-supervised multi-view data , 2012, Pattern Recognit..

[42]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.