Image Set-Oriented Dual Linear Discriminant Regression Classification and Its Kernel Extension

Along with the rapid development of computer and image processing technology, it is definitely convenient to obtain various images for subjects, which can be more robust to classification as more feature information is contained. However, how to effectively exploit the rich discriminative information within image sets is the key problem. In this paper, based on the concept of dual linear regression classification method for image set classification, we propose a novel discriminative framework to exploit the superiority of discriminant regression mechanism. We aim to learn a projection matrix to force the represented image points from the same class to be close and those from different class are better separated. The feature extraction strategy in our discriminative framework can appropriately work with the corresponding classification strategy, thus, better classification performance can be achieved. Moreover, we propose a kernel discriminative extension method to address the non-linearity problem by adopting the kernel trick. From the experimental results, our proposed method can obtain competitive recognition rates on face recognition tasks via mapping the original image sets into a more discriminative feature space. Besides, it also shows the effectiveness for object classification task with small image sizes and different number of frames.

[1]  Josef Kittler,et al.  Discriminative Learning and Recognition of Image Set Classes Using Canonical Correlations , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  György Kovács,et al.  Matching by Monotonic Tone Mapping , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Zhong-Qiu Zhao,et al.  A review of image set classification , 2019, Neurocomputing.

[4]  Eli Shechtman,et al.  In defense of Nearest-Neighbor based image classification , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Naftali Tishby,et al.  Margin based feature selection - theory and algorithms , 2004, ICML.

[6]  Jian Yang,et al.  Sparse Representation Classifier Steered Discriminative Projection With Applications to Face Recognition , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Chris H. Q. Ding,et al.  Extended linear regression for undersampled face recognition , 2014, J. Vis. Commun. Image Represent..

[8]  Vladimir Pavlovic,et al.  Face tracking and recognition with visual constraints in real-world videos , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Sheng Huang,et al.  Discriminative Probabilistic Latent Semantic Analysis with Application to Single Sample Face Recognition , 2018, Neural Processing Letters.

[10]  Liang Chen,et al.  Dual Linear Regression Based Classification for Face Cluster Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Xiaoli Zhang,et al.  Quaternion Based Maximum Margin Criterion Method for Color Face Recognition , 2017, Neural Processing Letters.

[12]  Ying Gao,et al.  Patch-Based Principal Covariance Discriminative Learning for Image Set Classification , 2017, IEEE Access.

[13]  Ken-ichi Maeda,et al.  Face recognition using temporal image sequence , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[14]  Lei Zhang,et al.  Face recognition based on regularized nearest points between image sets , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[15]  Zhong Jin,et al.  Heteroscedastic Sparse Representation Based Classification for Face Recognition , 2012, Neural Processing Letters.

[16]  Wen Gao,et al.  Manifold-Manifold Distance with application to face recognition based on image set , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Shiguang Shan,et al.  Prototype Discriminative Learning for Image Set Classification , 2017, IEEE Signal Processing Letters.

[18]  Wen Gao,et al.  Locally Linear Regression for Pose-Invariant Face Recognition , 2007, IEEE Transactions on Image Processing.

[19]  Biao Wang,et al.  Adaptive linear regression for single-sample face recognition , 2013, Neurocomputing.

[20]  Trevor Darrell,et al.  Face recognition with image sets using manifold density divergence , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[21]  György Kovács,et al.  Translation Invariance in the Polynomial Kernel Space and Its Applications in kNN Classification , 2013, Neural Processing Letters.

[22]  Xuelong Li,et al.  Parameter Free Large Margin Nearest Neighbor for Distance Metric Learning , 2017, AAAI.

[23]  Shiguang Shan,et al.  Prototype Discriminative Learning for Face Image Set Classification , 2016, ACCV.

[24]  Hakan Cevikalp,et al.  Face recognition based on image sets , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[25]  Koby Crammer,et al.  Margin Analysis of the LVQ Algorithm , 2002, NIPS.

[26]  Victor J. Yohai,et al.  Robust and sparse estimators for linear regression models , 2015, Comput. Stat. Data Anal..

[27]  Nanning Zheng,et al.  Large Margin Learning in Set-to-Set Similarity Comparison for Person Reidentification , 2017, IEEE Transactions on Multimedia.

[28]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[29]  David Zhang,et al.  From Point to Set: Extend the Learning of Distance Metrics , 2013, 2013 IEEE International Conference on Computer Vision.

[30]  Dit-Yan Yeung,et al.  Locally Linear Models on Face Appearance Manifolds with Application to Dual-Subspace Based Classification , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[31]  Hongtao Lu,et al.  Efficient linear discriminant analysis with locality preserving for face recognition , 2012, Pattern Recognit..

[32]  Masashi Nishiyama,et al.  Face Recognition with the Multiple Constrained Mutual Subspace Method , 2003, AVBPA.

[33]  Ajmal S. Mian,et al.  Sparse approximated nearest points for image set classification , 2011, CVPR 2011.

[34]  Josef Kittler,et al.  Incremental Learning of Locally Orthogonal Subspaces for Set-based Object Recognition , 2006, BMVC.

[35]  Jar-Ferr Yang,et al.  Linear Discriminant Regression Classification for Face Recognition , 2013, IEEE Signal Processing Letters.

[36]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[37]  Mohammed Bennamoun,et al.  Efficient Image Set Classification Using Linear Regression Based Image Reconstruction , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[38]  Liang Chen,et al.  A Quantum Probability Inspired Framework for Image-Set Based Face Identification , 2017, 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017).

[39]  Daniel D. Lee,et al.  Grassmann discriminant analysis: a unifying view on subspace-based learning , 2008, ICML '08.

[40]  Zhengtao Yu,et al.  Locality Preserving Collaborative Representation for Face Recognition , 2017, Neural Processing Letters.

[41]  Tae-Kyun Kim,et al.  Boosted manifold principal angles for image set-based recognition , 2007, Pattern Recognit..

[42]  Yacov Hel-Or,et al.  Matching by Tone Mapping: Photometric Invariant Template Matching , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Ruiping Wang,et al.  Manifold Discriminant Analysis , 2009, CVPR.

[44]  Jiwen Lu,et al.  Multi-manifold metric learning for face recognition based on image sets , 2014, J. Vis. Commun. Image Represent..

[45]  Licheng Jiao,et al.  Integrating Spectral Kernel Learning and Constraints in Semi-Supervised Classification , 2012, Neural Processing Letters.

[46]  Mohammed Bennamoun,et al.  Linear Regression for Face Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  LinLin Shen,et al.  Joint regularized nearest points for image set based face recognition , 2017, Image Vis. Comput..

[48]  David J. Kriegman,et al.  Video-based face recognition using probabilistic appearance manifolds , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[49]  Gang Wang,et al.  Localized Multifeature Metric Learning for Image-Set-Based Face Recognition , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[50]  Masayuki Mukunoki,et al.  Collaboratively Regularized Nearest Points for Set Based Recognition , 2013, BMVC.

[51]  Jing-Yu Yang,et al.  Two-dimensional color uncorrelated discriminant analysis for face recognition , 2013, Neurocomputing.

[52]  David J. Crisp,et al.  A Geometric Interpretation of v-SVM Classifiers , 1999, NIPS.

[53]  Yicong Zhou,et al.  Pairwise Linear Regression Classification for Image Set Retrieval , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[54]  H. Hotelling Relations Between Two Sets of Variates , 1936 .

[55]  Ralph Gross,et al.  The CMU Motion of Body (MoBo) Database , 2001 .

[56]  Trevor Darrell,et al.  Face Recognition from Long-Term Observations , 2002, ECCV.

[57]  Geng Yang,et al.  Adaptive linear discriminant regression classification for face recognition , 2016, Digit. Signal Process..

[58]  Geng Yang,et al.  Fuzzy Linear Regression Discriminant Projection for Face Recognition , 2017, IEEE Access.