Discriminative multiview nonnegative matrix factorization with large margin for image classification

Image classification has attracted lots of attentions in recent years. To improve classification accuracy, multiple features are usually extracted to represent the context of images, which imposes a challenge for the combination of those features. To address this problem, we present a discriminative nonnegative multi-view learning approach for image classification based on the observation that those features are often nonnegative. For discrimination, we utilize class label as an auxiliary information to learn discriminative common representations through a set of nonnegative basis vectors with large margin. Meanwhile, view consistency constraint is imposed on the low-dimensional representations and correntropy-induced metric (CIM) is adopted for the measurement of reconstruction errors. We utilized half-quadratic optimization technique to solve the optimization problem and obtain an effective multiplicative update rule. Experimental results demonstrate the learned common latent representations by the proposed method are more efficient than other methods.

[1]  Dacheng Tao,et al.  Large-Cone Nonnegative Matrix Factorization , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Xuan Li,et al.  Robust Nonnegative Matrix Factorization via Half-Quadratic Minimization , 2012, 2012 IEEE 12th International Conference on Data Mining.

[3]  Ming Yang,et al.  Multi-View Representation Learning: A Survey from Shallow Methods to Deep Methods , 2016, ArXiv.

[4]  Xinge You,et al.  Kernel normalized mixed-norm algorithm for system identification , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[5]  Ke Tang,et al.  Enhanced Maximum AUC Linear Classifier , 2010, 2010 Seventh International Conference on Fuzzy Systems and Knowledge Discovery.

[6]  Xin Liu,et al.  Document clustering based on non-negative matrix factorization , 2003, SIGIR.

[7]  Tom Diethe,et al.  Constructing Nonlinear Discriminants from Multiple Data Views , 2010, ECML/PKDD.

[8]  Zheng Cao,et al.  Robust linear discriminant analysis with a Laplacian assumption on projection distribution , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  C. L. Philip Chen,et al.  Robust Nonnegative Patch Alignment for Dimensionality Reduction , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Ran He,et al.  Maximum Correntropy Criterion for Robust Face Recognition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Chris H. Q. Ding,et al.  Nonnegative matrix factorization using a robust error function , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Bao-Gang Hu,et al.  Robust feature extraction via information theoretic learning , 2009, ICML '09.

[13]  Weihua Ou,et al.  Robust Discriminative Nonnegative Patch Alignment for Occluded Face Recognition , 2015, ICONIP.

[14]  Zhenyu He,et al.  Connected Component Model for Multi-Object Tracking , 2016, IEEE Transactions on Image Processing.

[15]  Donald Geman,et al.  Constrained Restoration and the Recovery of Discontinuities , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Weihua Ou,et al.  Multi-view non-negative matrix factorization by patch alignment framework with view consistency , 2016, Neurocomputing.

[17]  Raymond H. Chan,et al.  The Equivalence of Half-Quadratic Minimization and the Gradient Linearization Iteration , 2007, IEEE Transactions on Image Processing.

[18]  Zhenyu He,et al.  Unified Sparse Subspace Learning via Self-Contained Regression , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Yu-Chiang Frank Wang,et al.  Multi-view Nonnegative Matrix Factorization for Clothing Image Characterization , 2014, 2014 22nd International Conference on Pattern Recognition.

[20]  Fei Long,et al.  Co-regularized multiview nonnegative matrix factorization with correlation constraint for representation learning , 2017, Multimedia Tools and Applications.

[21]  Josef Kittler,et al.  Learning Discriminative Canonical Correlations for Object Recognition with Image Sets , 2006, ECCV.

[22]  Jiawei Han,et al.  Multi-View Clustering via Joint Nonnegative Matrix Factorization , 2013, SDM.

[23]  Yuan Yan Tang,et al.  Multiview Hessian discriminative sparse coding for image annotation , 2013, Comput. Vis. Image Underst..

[24]  John Shawe-Taylor,et al.  MahNMF: Manhattan Non-negative Matrix Factorization , 2012, ArXiv.

[25]  Hyunsoo Kim,et al.  Sparse Non-negative Matrix Factorizations via Alternating Non-negativity-constrained Least Squares , 2006 .

[26]  Weifeng Liu,et al.  Correntropy: Properties and Applications in Non-Gaussian Signal Processing , 2007, IEEE Transactions on Signal Processing.

[27]  Zhenyu He,et al.  Robust Object Tracking via Key Patch Sparse Representation , 2017, IEEE Transactions on Cybernetics.

[28]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[29]  Ziqiang Wang,et al.  Multiview Discriminative Geometry Preserving Projection for Image Classification , 2014, TheScientificWorldJournal.

[30]  John Shawe-Taylor,et al.  Canonical Correlation Analysis: An Overview with Application to Learning Methods , 2004, Neural Computation.

[31]  Shiguang Shan,et al.  Multi-View Discriminant Analysis , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Xinge You,et al.  Diverse Expected Gradient Active Learning for Relative Attributes , 2014, IEEE Transactions on Image Processing.

[33]  Dacheng Tao,et al.  Multi-View Intact Space Learning , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Shiliang Sun,et al.  Multi-view learning overview: Recent progress and new challenges , 2017, Inf. Fusion.

[35]  Xiaolei Wang,et al.  Non-negative matrix factorization by maximizing correntropy for cancer clustering , 2013, BMC Bioinformatics.

[36]  Wentao Mao,et al.  Online sequential prediction of imbalance data with two-stage hybrid strategy by extreme learning machine , 2017, Neurocomputing.

[37]  Xinge You,et al.  Dynamically Modulated Mask Sparse Tracking , 2017, IEEE Transactions on Cybernetics.

[38]  David W. Jacobs,et al.  Generalized Multiview Analysis: A discriminative latent space , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.