MSAFC: matrix subspace analysis with fuzzy clustering ability

In this paper, based on the maximum margin criterion (MMC) together with the fuzzy clustering and the tensor theory, a novel matrix based fuzzy maximum margin criterion (MFMMC) is proposed and based upon which a matrix subspace analysis method with fuzzy clustering ability (MSAFC) is derived. Besides, according to the intuitive geometry, a proper method of setting the adjustable parameter $$\gamma $$γ in the proposed criterion MFMMC is given and its rationale is provided. The proposed method MSAFC can simultaneously realize unsupervised feature extraction and fuzzy clustering for matrix data (e.g. image data). As to the running efficiency of MSAFC, a two-directional orthogonal method of dealing with matrix data without any iteration is developed to improve it. Experimental results on UCI datasets, hand-written digit datasets, face image datasets and gene datasets show the distinctive performance of MSAFC.

[1]  Liu Zheng-guang,et al.  Multi-modal Face Rec ognition Based on Local Binary Pattern and Fisherfaces , 2009 .

[2]  Jian-Huang Lai,et al.  Face representation using independent component analysis , 2002, Pattern Recognit..

[3]  Shengcai Liao,et al.  Face Recognition by Discriminant Analysis with Gabor Tensor Representation , 2007, ICB.

[4]  Euntai Kim,et al.  A transformed input-domain approach to fuzzy modeling , 1998, IEEE Trans. Fuzzy Syst..

[5]  David Zhang,et al.  Adaptive Classification Algorithm Based on Maximum Scatter Difference Discriminant Criterion , 2006 .

[6]  Chia-Wei Hsu,et al.  A Linear Feature Extraction for Multiclass Classification Problems Based on Class Mean and Covariance Discriminant Information , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Xiaogang Wang,et al.  A unified framework for subspace face recognition , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[9]  Hau-San Wong,et al.  Face recognition based on 2D Fisherface approach , 2006, Pattern Recognit..

[10]  R. Fisher.  THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[11]  Ying Wu,et al.  Query-Driven Locally Adaptive Fisher Faces and Expert-Model for Face Recognition , 2007, 2007 IEEE International Conference on Image Processing.

[12]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[13]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Haiping Lu,et al.  Uncorrelated Multilinear Discriminant Analysis With Regularization and Aggregation for Tensor Object Recognition , 2009, IEEE Transactions on Neural Networks.

[15]  Daizhan Cheng,et al.  Solving Fuzzy Relational Equations Via Semitensor Product , 2012, IEEE Transactions on Fuzzy Systems.

[16]  Daoqiang Zhang,et al.  Pattern Representation in Feature Extraction and Classifier Design: Matrix Versus Vector , 2008, IEEE Transactions on Neural Networks.

[17]  Wankou Yang,et al.  Two-directional maximum scatter difference discriminant analysis for face recognition , 2008, Neurocomputing.

[18]  Alejandro F. Frangi,et al.  Two-dimensional PCA: a new approach to appearance-based face representation and recognition , 2004 .

[19]  Tao Jiang,et al.  Efficient and robust feature extraction by maximum margin criterion , 2003, IEEE Transactions on Neural Networks.

[20]  Dong Xu,et al.  Multilinear Discriminant Analysis for Face Recognition , 2007, IEEE Transactions on Image Processing.

[21]  Jing-Yu Yang,et al.  Face recognition using Complete Fuzzy LDA , 2008, 2008 19th International Conference on Pattern Recognition.

[22]  Jieping Ye,et al.  Two-Dimensional Linear Discriminant Analysis , 2004, NIPS.

[23]  Haiping Lu,et al.  MPCA: Multilinear Principal Component Analysis of Tensor Objects , 2008, IEEE Transactions on Neural Networks.

[24]  Jing Peng,et al.  Discriminant Learning Analysis , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  Dao-Qing Dai,et al.  Incremental learning of bidirectional principal components for face recognition , 2010, Pattern Recognit..

[26]  Daoqiang Zhang,et al.  Feature extraction approaches based on matrix pattern: MatPCA and MatFLDA , 2005, Pattern Recognit. Lett..

[27]  Jin Young Choi,et al.  Theoretical analysis on feature extraction capability of class-augmented PCA , 2009, Pattern Recognit..

[28]  L Sirovich,et al.  Low-dimensional procedure for the characterization of human faces. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[29]  Jieping Ye,et al.  GPCA: an efficient dimension reduction scheme for image compression and retrieval , 2004, KDD.

[30]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[31]  Ming Li,et al.  2D-LDA: A statistical linear discriminant analysis for image matrix , 2005, Pattern Recognit. Lett..

[32]  Jian Yu,et al.  A novel fuzzy clustering algorithm based on a fuzzy scatter matrix with optimality tests , 2005, Pattern Recognit. Lett..

[33]  Jie Li,et al.  A Prior Neurophysiologic Knowledge Free Tensor-Based Scheme for Single Trial EEG Classification , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[34]  Xuelong Li,et al.  General Tensor Discriminant Analysis and Gabor Features for Gait Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Jieping Ye,et al.  Generalized Low Rank Approximations of Matrices , 2005, Machine Learning.

[36]  Daoqiang Zhang,et al.  Efficient and robust feature extraction by maximum margin criterion , 2003, IEEE Transactions on Neural Networks.

[37]  Chin-Teng Lin,et al.  LDA-Based Clustering Algorithm and Its Application to an Unsupervised Feature Extraction , 2011, IEEE Transactions on Fuzzy Systems.

[38]  Constantine Kotropoulos,et al.  Non-Negative Multilinear Principal Component Analysis of Auditory Temporal Modulations for Music Genre Classification , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[39]  Seungjin Choi,et al.  Color Face Tensor Factorization and Slicing for Illumination-Robust Recognition , 2007, ICB.

[40]  Shuicheng Yan,et al.  A Convengent Solution to Tensor Subspace Learning , 2007, IJCAI.

[41]  Haiping Lu,et al.  A survey of multilinear subspace learning for tensor data , 2011, Pattern Recognit..

[42]  Gao Jun.  Fuzzy Maximum Scatter Difference Discriminant Criterion Based Clustering Algorithm , 2009 .

[43]  Witold Pedrycz,et al.  Face recognition using a fuzzy fisherface classifier , 2005, Pattern Recognit..

[44]  Lei Zhang,et al.  Feature extraction based on fuzzy 2DLDA , 2010, Neurocomputing.

[45]  Jun Gao,et al.  Fuzzy Maximum Scatter Difference Discriminant Criterion Based Clustering Algorithm: Fuzzy Maximum Scatter Difference Discriminant Criterion Based Clustering Algorithm , 2009 .

[46]  Fei Wang,et al.  Neighborhood discriminant tensor mapping , 2009, Neurocomputing.

[47]  Wenming Zheng,et al.  Weighted maximum margin discriminant analysis with kernels , 2005, Neurocomputing.

[48]  I. Jolliffe.  Principal Component Analysis , 2002 .

[49]  Daoqiang Zhang,et al.  (2D)2PCA: Two-directional two-dimensional PCA for efficient face representation and recognition , 2005, Neurocomputing.

[50]  Pierre Comon,et al.  Handbook of Blind Source Separation: Independent Component Analysis and Applications , 2010 .

[51]  M. Omair Ahmad,et al.  Two-dimensional FLD for face recognition , 2005, Pattern Recognit..

[52]  Zhaohong Deng,et al.  Clustering Analysis of Gene Expression Data based on Semi-supervised Visual Clustering Algorithm , 2006, Soft Comput..