Texture descriptors for representing feature vectors

Abstract Pattern representation affects classification performance. Although discovering “universal” features that work for many classification problems is ideal, most representations are problem specific. In this paper, we improve the classification performance of a classifier system by transforming a one-dimensional input descriptor into a two-dimensional space so that effective texture extractors can be extracted to capture hidden data information. We develop two new methods for matrix representation where features are extracted that are more generalizable. The first method for generating a two-dimensional representation of patterns is based on trees, the objective being to reshape the feature vector into a matrix, and the second method performs mathematical operations to build a matrix representation. The proposed framework is then evaluated for its specific power on three medical problems. To evaluate generalizability, we compare the proposed approaches with several other baseline methods across some well-known benchmark datasets that reflect a diversity of classification problems. Not only does our approach show high robustness, but it also exhibits low sensitivity to parameters. When different approaches for transforming a vector into a matrix are combined with several texture descriptors, the resulting system often works well without requiring any ad-hoc optimization. The performance of the tested systems is compared by Wilcoxon signed rank test and Friedman's test.

[1]  Ville Ojansivu,et al.  Blur Insensitive Texture Classification Using Local Phase Quantization , 2008, ICISP.

[2]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[3]  Guiqiang Ni,et al.  One-Class Support Vector Machines Based on Matrix Patterns , 2011 .

[4]  Loris Nanni,et al.  A reliable method for cell phenotype image classification , 2008, Artif. Intell. Medicine.

[5]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[7]  El-Sayed M. El-Alfy,et al.  AdaBoost-based artificial neural network learning , 2017, Neurocomputing.

[8]  Zhen Gao,et al.  Predict drug permeability to blood‐brain‐barrier from clinical phenotypes: drug side effects and drug indications , 2016, Bioinform..

[9]  Walter Kolch,et al.  Comparison of different statistical approaches for urinary peptide biomarker detection in the context of coronary artery disease , 2016, BMC Bioinformatics.

[10]  Songcan Chen,et al.  Matrix-pattern-oriented least squares support vector classifier with AdaBoost , 2008, Pattern Recognit. Lett..

[11]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[12]  Krzysztof J. Cios,et al.  Multi-objective genetic programming for feature extraction and data visualization , 2015, Soft Computing.

[13]  Alexandre César Muniz de Oliveira,et al.  Classification of breast tissues using Moran's index and Geary's coefficient as texture signatures and SVM , 2009, Comput. Biol. Medicine.

[14]  Daoqiang Zhang,et al.  Feature extraction approaches based on matrix pattern: MatPCA and MatFLDA , 2005, Pattern Recognit. Lett..

[15]  Tomaso Poggio,et al.  Image Representations for Visual Learning , 1996, Science.

[16]  Chong-Ho Choi,et al.  A discriminant analysis using composite features for classification problems , 2007, Pattern Recognit..

[17]  Reshma Khemchandani,et al.  Twin Support Vector Machines for Pattern Classification , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[19]  Xuelong Li,et al.  Supervised Tensor Learning , 2005, ICDM.

[20]  Dongdong Li,et al.  Regularized Matrix-Pattern-Oriented Classification Machine with Universum , 2017, Neural Processing Letters.

[21]  H. Singh,et al.  UWIT: underwater image toolbox for optical image processing and mosaicking in MATLAB , 2002, Proceedings of the 2002 Interntional Symposium on Underwater Technology (Cat. No.02EX556).

[22]  Jieping Ye,et al.  Two-Dimensional Linear Discriminant Analysis , 2004, NIPS.

[23]  David Zhang,et al.  Biometric Image Discrimination Technologies , 2006 .

[24]  Loris Nanni,et al.  Multilayer descriptors for medical image classification , 2016, Comput. Biol. Medicine.

[25]  Tin Kam Ho,et al.  The Random Subspace Method for Constructing Decision Forests , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Robert J. Olson,et al.  Automated taxonomic classification of phytoplankton sampled with imaging‐in‐flow cytometry , 2007 .

[27]  Loris Nanni,et al.  Local binary patterns variants as texture descriptors for medical image analysis , 2010, Artif. Intell. Medicine.

[28]  Feiping Nie,et al.  Multiple rank multi-linear SVM for matrix data classification , 2014, Pattern Recognit..

[29]  Julian J. McAuley,et al.  Fast Inference with Min-Sum Matrix Product , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Nikhil R. Pal,et al.  Identification of a small set of plasma signalling proteins using neural network for prediction of Alzheimer's disease , 2015, Bioinform..

[31]  Alejandro F. Frangi,et al.  Two-dimensional PCA: a new approach to appearance-based face representation and recognition , 2004 .

[32]  Jianjun Hu,et al.  DeepMHC: Deep Convolutional Neural Networks for High-performance peptide-MHC Binding Affinity Prediction , 2017, bioRxiv.

[33]  Songcan Chen,et al.  Matrix-pattern-oriented Ho-Kashyap classifier with regularization learning , 2007, Pattern Recognit..

[34]  David G. Stork,et al.  Pattern Classification , 1973 .

[35]  D. Gaylor,et al.  Metabolic Imbalance Associated with Methylation Dysregulation and Oxidative Damage in Children with Autism , 2012, Journal of autism and developmental disorders.

[36]  Loris Nanni,et al.  Texture descriptors for generic pattern classification problems , 2011, Expert Syst. Appl..

[37]  Jun Liu,et al.  Non-iterative generalized low rank approximation of matrices , 2006, Pattern Recognit. Lett..

[38]  Haitao Xu,et al.  A novel method for classification of matrix data using Twin Multiple Rank SMMs , 2016, Appl. Soft Comput..

[39]  Uwe Kruger,et al.  Classification and adaptive behavior prediction of children with autism spectrum disorder based upon multivariate data analysis of markers of oxidative stress and DNA methylation , 2017, PLoS Comput. Biol..

[40]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[41]  Gavin C. Cawley,et al.  Sparse Multinomial Logistic Regression via Bayesian L1 Regularisation , 2006, NIPS.

[42]  L. Nanni,et al.  Protein classification using texture descriptors extracted from the protein backbone image. , 2010, Journal of theoretical biology.

[43]  Antonio Cerasa,et al.  Combining multiple approaches for the early diagnosis of Alzheimer's Disease , 2016, Pattern Recognit. Lett..

[44]  Chun-Xia Zhang,et al.  RotBoost: A technique for combining Rotation Forest and AdaBoost , 2008, Pattern Recognit. Lett..

[45]  Saeid Nahavandi,et al.  A novel aggregate gene selection method for microarray data classification , 2015, Pattern Recognit. Lett..

[46]  Changming Zhu,et al.  Entropy-based matrix learning machine for imbalanced data sets , 2017, Pattern Recognit. Lett..

[47]  Patrick J. F. Groenen,et al.  Modern Multidimensional Scaling: Theory and Applications , 2003 .

[48]  Jason Weston,et al.  Inference with the Universum , 2006, ICML.

[49]  Richard Kronland-Martinet,et al.  Reading and Understanding Continuous Wavelet Transforms , 1989 .

[50]  Songcan Chen,et al.  New Least Squares Support Vector Machines Based on Matrix Patterns , 2007, Neural Processing Letters.

[51]  R. Tibshirani,et al.  Classification and prediction of clinical Alzheimer's diagnosis based on plasma signaling proteins , 2007, Nature Medicine.

[52]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[53]  Ethem Alpaydin,et al.  Cost-conscious comparison of supervised learning algorithms over multiple data sets , 2012, Pattern Recognit..

[54]  Narendra Ahuja,et al.  Rank-R approximation of tensors using image-as-matrix representation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[55]  Loris Nanni,et al.  Matrix representation in pattern classification , 2012, Expert Syst. Appl..

[56]  Thomas Hofmann,et al.  Predicting CNS Permeability of Drug Molecules: Comparison of Neural Network and Support Vector Machine Algorithms , 2002, J. Comput. Biol..