Robust Manifold Learning Based Ordinal Discriminative Correlation Regression

Canonical correlation analysis (CCA) is a typical learning paradigm of capturing the correlation components across multi-views of the same data. When countered with such data with ordinal labels, the accuracy performance yielded by traditional CCA is usually not desirable because of ignoring the ordinal relationships among data labels. In order to incorporate the ordinal information into the objective function of CCA, the so-called ordinal discriminative CCA (OR-DisCCA) was presented. Although OR-DisCCA can yield better ordinal regression results, its performance will be deteriorated when the data are corrupted with outliers because the ordered class centers easily tend to be biased by the outliers. To address this issue, in this work we construct robust manifold ordinal discriminative correlation regression (rmODCR) by replacing the traditional (\(l_2\)-norm) class centers with \(l_p\)-norm centers in objective optimization. Finally, we experimentally evaluate the effectiveness of the proposed method.

[1]  Qing Tian,et al.  Cross-heterogeneous-database age estimation through correlation representation learning , 2017, Neurocomputing.

[2]  Lin Feng,et al.  Spectral embedding-based multiview features fusion for content-based image retrieval , 2017, J. Electronic Imaging.

[3]  Zexuan Ji,et al.  Sparse Discrimination based Multiset Canonical Correlation Analysis for Multi-Feature Fusion and Recognition , 2015, BMVC.

[4]  John Shawe-Taylor,et al.  Sparse canonical correlation analysis , 2009, Machine Learning.

[5]  Ruohan Meng A fusion steganographic algorithm based on Faster R-CNN , 2018 .

[6]  J. Kettenring,et al.  Canonical Analysis of Several Sets of Variables , 2022 .

[7]  Tatsuya Harada,et al.  Probabilistic Semi-Canonical Correlation Analysis , 2015, ACM Multimedia.

[8]  A. Murat Tekalp,et al.  Audiovisual Synchronization and Fusion Using Canonical Correlation Analysis , 2007, IEEE Transactions on Multimedia.

[9]  H. Hotelling Relations Between Two Sets of Variates , 1936 .

[10]  Colin Fyfe,et al.  Kernel and Nonlinear Canonical Correlation Analysis , 2000, IJCNN.

[11]  D. Tritchler,et al.  Sparse Canonical Correlation Analysis with Application to Genomic Data Integration , 2009, Statistical applications in genetics and molecular biology.

[12]  Robert P. W. Duin,et al.  Handwritten digit recognition by combined classifiers , 1998, Kybernetika.

[13]  Feiping Nie,et al.  Multiple view semi-supervised dimensionality reduction , 2010, Pattern Recognit..

[14]  Yueting Zhuang,et al.  Sparse Unsupervised Dimensionality Reduction for Multiple View Data , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Paul T. Boggs,et al.  Sequential Quadratic Programming , 1995, Acta Numerica.

[16]  E. S. Pearson,et al.  THE EFFICIENCY OF STATISTICAL TOOLS AND A CRITERION FOR THE REJECTION OF OUTLYING OBSERVATIONS , 1936 .

[17]  Tae-Kyun Kim,et al.  Canonical Correlation Analysis of Video Volume Tensors for Action Categorization and Detection , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Nello Cristianini,et al.  Inferring a Semantic Representation of Text via Cross-Language Correlation Analysis , 2002, NIPS.

[19]  A. Murat Tekalp,et al.  Multimodal Speaker Identification Using Canonical Correlation Analysis , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[20]  R. Sherratt,et al.  Adversarial learning for distant supervised relation extraction , 2018 .

[21]  Pengfei Shi,et al.  A Novel Method of Combined Feature Extraction for Recognition , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[22]  Miki Haseyama,et al.  A rating prediction method for e-commerce application using ordinal regression based on LDA with multi-modal features , 2013, 2013 IEEE 2nd Global Conference on Consumer Electronics (GCCE).

[23]  Songcan Chen,et al.  Joint representation classification for collective face recognition , 2015, Pattern Recognit..

[24]  Xiao Li,et al.  Image classification by semisupervised sparse coding with confident unlabeled samples , 2017, J. Electronic Imaging.

[25]  Jing-Yu Yang,et al.  Kernelized discriminative canonical correlation analysis , 2007, 2007 International Conference on Wavelet Analysis and Pattern Recognition.

[26]  Junping Zhang,et al.  Super-resolution of human face image using canonical correlation analysis , 2010, Pattern Recognit..

[27]  Elena Parkhomenko,et al.  Sparse Canonical Correlation Analysis , 2008 .

[28]  Horst Bischof,et al.  Appearance models based on kernel canonical correlation analysis , 2003, Pattern Recognit..

[29]  Craig T. Lawrence,et al.  A Computationally Efficient Feasible Sequential Quadratic Programming Algorithm , 2000, SIAM J. Optim..

[30]  Dunja Mladenic,et al.  Cross-lingual search over 22 european languages , 2008, SIGIR '08.

[31]  Xiaoming Zhang,et al.  Kernel Discriminant Learning for Ordinal Regression , 2010, IEEE Transactions on Knowledge and Data Engineering.

[32]  Marios Savvides,et al.  NIR-VIS heterogeneous face recognition via cross-spectral joint dictionary learning and reconstruction , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[33]  Takumi Kobayashi,et al.  Image Feature Extraction Using Gradient Local Auto-Correlations , 2008, ECCV.