Semi-supervised Sparsity Pairwise Constraint Preserving Projections based on GA

The deficiency of the ability for preserving global geometric structure information of data is the main problem of existing semi-supervised dimensionality reduction with pairwise constraints. A dimensionality reduction algorithm called Semi-supervised Sparsity Pairwise Constraint Preserving Projections based on Genetic Algorithm (SSPCPPGA) is proposed. On the one hand, the algorithm fuses unsupervised sparse reconstruction feature information and supervised pairwise constraint feature information in the process of dimensionality reduction, preserving geometric structure in samples and constraint relation of samples simultaneously. On the other hand , the algorithm introduces the genetic algorithm to set automatically the weighted trade-off parameter for full fusion. Experiments operated on real world datasets show, in contrast to the existing typical semi-supervised dimensionality reduction algorithms with pairwise constraints and other semi-supervised dimensionality reduction algorithms on sparse representation, the proposed algorithm is more efficient.

[1]  Jui-Chung Hung,et al.  Hybridization of Genetic Algorithm and IBMUSIC applied to DOA estimation under coherent signals , 2012 .

[2]  Wei Tang,et al.  Pairwise Constraints-Guided Dimensionality Reduction , 2007 .

[3]  Xiaoyang Tan,et al.  Pattern Recognition , 2016, Communications in Computer and Information Science.

[4]  Kaijun Leng,et al.  A Genetic Algorithm Approach for TOC-based Supply Chain Coordination , 2012 .

[5]  Jia Wei,et al.  Neighbourhood preserving based semi-supervised dimensionality reduction , 2008 .

[6]  Michael I. Jordan,et al.  Distance Metric Learning with Application to Clustering with Side-Information , 2002, NIPS.

[7]  Hakan Cevikalp,et al.  Semi-Supervised Dimensionality Reduction Using Pairwise Equivalence Constraints , 2008, VISAPP.

[8]  Zhang Dao.  Semi-Supervised Canonical Correlation Analysis Algorithm , 2008 .

[9]  Richard G. Baraniuk,et al.  The smashed filter for compressive classification and target recognition , 2007, Electronic Imaging.

[10]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Masashi Sugiyama,et al.  Dimensionality Reduction of Multimodal Labeled Data by Local Fisher Discriminant Analysis , 2007, J. Mach. Learn. Res..

[12]  Feiping Nie,et al.  A unified framework for semi-supervised dimensionality reduction , 2008, Pattern Recognit..

[13]  Hong Qiao,et al.  Discriminative Sparsity Preserving Projections for Semi-Supervised Dimensionality Reduction , 2012, IEEE Signal Processing Letters.

[14]  Andrew Starr,et al.  A Review of data fusion models and architectures: towards engineering guidelines , 2005, Neural Computing & Applications.

[15]  Daoqiang Zhang,et al.  Semi-Supervised Dimensionality Reduction ∗ , 2007 .

[16]  Qianli Ma,et al.  Robust Locality Preserving Projections with Pairwise Constraints , 2010 .

[18]  Tomer Hertz,et al.  Learning a Mahalanobis Metric from Equivalence Constraints , 2005, J. Mach. Learn. Res..

[19]  R. Tibshirani,et al.  Sparse Principal Component Analysis , 2006 .

[20]  Yaakov Tsaig,et al.  Fast Solution of $\ell _{1}$ -Norm Minimization Problems When the Solution May Be Sparse , 2008, IEEE Transactions on Information Theory.

[21]  Rong Yan,et al.  A discriminative learning framework with pairwise constraints for video object classification , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Pramode K. Verma,et al.  Vehicle Identification Via Sparse Representation , 2012, IEEE Transactions on Intelligent Transportation Systems.

[23]  Ayaz Isazadeh,et al.  A Learning based Evolutionary Approach for Minimization of Matrix Bandwidth Problem , 2012 .

[24]  Jing Hua,et al.  Incorporating User Provided Constraints into Document Clustering , 2007, Seventh IEEE International Conference on Data Mining (ICDM 2007).

[25]  Vu N. Duong,et al.  Principal Component Analysis with Weighted Sparsity Constraint , 2010 .

[26]  Ian Davidson,et al.  Knowledge Driven Dimension Reduction for Clustering , 2009, IJCAI.

[27]  Tanaya Guha,et al.  Learning Sparse Representations for Human Action Recognition , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.