Multiple Matrix Learning Machine with Five Aspects of Pattern Information

This paper proposes an effective Multiple Matrix Learning Machine with Five Aspects of Pattern Information (MMFI). First aspect lies in the class label of each training or validation pattern. Second aspect is the values of components for each pattern. Third aspect is the relationship between patterns in the local regions of input space. Fourth aspect is the representation information and discriminant roles of different matrix representations for patterns. Fifth aspect is the information of patterns in each matrix representation learning. The innovations of the proposed MMFI are: (1) establishing a pattern-dependent function in the matrix learning so as to realize different roles of patterns for the first time; (2) adopting five aspects of pattern information so that a more feasible learning machine can be trained. The advantages of MMFI are: (1) proposing a new nonlinear learning machine which is different from the state-of-the-art kernelization one; (2) achieving a statistically superior classification performance than those learning machines without the introduction of five aspects of pattern information; (3) possessing a lower or comparable computational-complexity than other compared multiple matrix learning machines.

[1]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[2]  Sayan Mukherjee,et al.  Choosing Multiple Parameters for Support Vector Machines , 2002, Machine Learning.

[3]  Daoqiang Zhang,et al.  Feature extraction approaches based on matrix pattern: MatPCA and MatFLDA , 2005, Pattern Recognit. Lett..

[4]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[5]  Shan Suthaharan,et al.  Support Vector Machine , 2016 .

[6]  Gavin C. Cawley,et al.  On Over-fitting in Model Selection and Subsequent Selection Bias in Performance Evaluation , 2010, J. Mach. Learn. Res..

[7]  Gao Daqi,et al.  Kernel Fisher Discriminants and Kernel Nearest Neighbor Classifiers: A Comparative Study for Large-Scale Learning Problems , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[8]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[9]  Alejandro F. Frangi,et al.  Two-dimensional PCA: a new approach to appearance-based face representation and recognition , 2004 .

[10]  Jacek M. Łȩski,et al.  Ho--Kashyap classifier with generalization control , 2003 .

[11]  Rameswar Debnath,et al.  A decision based one-against-one method for multi-class support vector machine , 2004, Pattern Analysis and Applications.

[13]  Siuli Mukhopadhyay,et al.  Response surface methodology , 2010 .

[14]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[15]  Narendra Ahuja,et al.  Rank-R approximation of tensors using image-as-matrix representation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[16]  Ming Li,et al.  2D-LDA: A statistical linear discriminant analysis for image matrix , 2005, Pattern Recognit. Lett..

[17]  Michael I. Jordan,et al.  Multiple kernel learning, conic duality, and the SMO algorithm , 2004, ICML.

[18]  Ethem Alpaydin.  Multiple Kernel Machines Using Localized Kernels , 2009 .

[19]  William Stafford Noble,et al.  Support vector machine , 2013 .

[20]  Yves Grandvalet,et al.  Y.: SimpleMKL , 2008 .

[21]  Jieping Ye,et al.  Generalized Low Rank Approximations of Matrices , 2004, Machine Learning.

[22]  Jie Ding,et al.  Optimization of culture conditions for hydrogen production by Ethanoligenens harbinense B49 using response surface methodology. , 2009, Bioresource technology.

[23]  Jin Xu,et al.  Regularized multi-view learning machine based on response surface technique , 2012, Neurocomputing.

[24]  Songcan Chen,et al.  Matrix-pattern-oriented Ho-Kashyap classifier with regularization learning , 2007, Pattern Recognit..

[25]  Douglas C. Montgomery,et al.  Response Surface Methodology: Process and Product Optimization Using Designed Experiments , 1995 .

[26]  Songcan Chen,et al.  New Least Squares Support Vector Machines Based on Matrix Patterns , 2007, Neural Processing Letters.

[27]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[28]  Ethem Alpaydin,et al.  Localized Multiple Kernel Regression , 2010, 2010 20th International Conference on Pattern Recognition.

[29]  Robert Sabourin,et al.  “One Against One” or “One Against All”: Which One is Better for Handwriting Recognition with SVMs? , 2006 .

[30]  Guiqiang Ni,et al.  One-Class Support Vector Machines Based on Matrix Patterns , 2011 .

[31]  A. Zinatizadeh,et al.  Application of response surface methodology (RSM) to optimize coagulation-flocculation treatment of leachate using poly-aluminum chloride (PAC) and alum. , 2009, Journal of hazardous materials.

[32]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[33]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[34]  Ethem Alpaydin,et al.  Localized multiple kernel learning , 2008, ICML '08.

[35]  David G. Stork,et al.  Pattern Classification , 1973 .

[36]  Songcan Chen,et al.  A novel multi-view learning developed from single-view patterns , 2011, Pattern Recognit..