Hidden discriminative features extraction for supervised high-order time series modeling

In this paper, an orthogonal Tucker-decomposition-based extraction of high-order discriminative subspaces from a tensor-based time series data structure is presented, named as Tensor Discriminative Feature Extraction (TDFE). TDFE relies on the employment of category information for the maximization of the between-class scatter and the minimization of the within-class scatter to extract optimal hidden discriminative feature subspaces that are simultaneously spanned by every modality for supervised tensor modeling. In this context, the proposed tensor-decomposition method provides the following benefits: i) reduces dimensionality while robustly mining the underlying discriminative features, ii) results in effective interpretable features that lead to an improved classification and visualization, and iii) reduces the processing time during the training stage and the filtering of the projection by solving the generalized eigenvalue issue at each alternation step. Two real third-order tensor-structures of time series datasets (an epilepsy electroencephalogram (EEG) that is modeled as channel×frequency bin×time frame and a microarray data that is modeled as gene×sample×time) were used for the evaluation of the TDFE. The experiment results corroborate the advantages of the proposed method with averages of 98.26% and 89.63% for the classification accuracies of the epilepsy dataset and the microarray dataset, respectively. These performance averages represent an improvement on those of the matrix-based algorithms and recent tensor-based, discriminant-decomposition approaches; this is especially the case considering the small number of samples that are used in practice.

[1]  Alioune Ngom,et al.  Classification of Clinical Gene-Sample-Time Microarray Expression Data via Tensor Decomposition Methods , 2010, CIBB.

[2]  W. Art Chaovalitwongse,et al.  Adaptive epileptic seizure prediction system , 2003, IEEE Transactions on Biomedical Engineering.

[3]  Patrick Dupont,et al.  Canonical decomposition of ictal scalp EEG reliably detects the seizure onset zone , 2007, NeuroImage.

[4]  F Wendling,et al.  EEG extended source localization: Tensor-based vs. conventional methods , 2014, NeuroImage.

[5]  Christa Neuper,et al.  EEG-Based Brain-Computer Interface , 2006, Neuroergonomics.

[6]  Tak-Chung Fu,et al.  A review on time series data mining , 2011, Eng. Appl. Artif. Intell..

[7]  Jian Pei,et al.  Mining gene–sample–time microarray data: a coherent gene cluster discovery approach , 2007, Knowledge and Information Systems.

[8]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[9]  Xiaoou Tang,et al.  Tensor linear Laplacian discrimination (TLLD) for feature extraction , 2009, Pattern Recognit..

[10]  Tamara G. Kolda,et al.  Scalable Tensor Decompositions for Multi-aspect Data Mining , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[11]  G. Golub,et al.  A tensor higher-order singular value decomposition for integrative analysis of DNA microarray data from different studies , 2007, Proceedings of the National Academy of Sciences.

[12]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[13]  Wim Van Paesschen,et al.  Canonical Decomposition of Ictal Scalp EEG and Accurate Source Localisation: Principles and Simulation Study , 2007, Comput. Intell. Neurosci..

[14]  Andrzej Cichocki,et al.  Extended HALS algorithm for nonnegative Tucker decomposition and its applications for multiway analysis and classification , 2011, Neurocomputing.

[15]  Alioune Ngom,et al.  Non-negative matrix and tensor factorization based classification of clinical microarray gene expression data , 2010, 2010 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[16]  Rasmus Bro,et al.  Multiway analysis of epilepsy tensors , 2007, ISMB/ECCB.

[17]  Lars Kai Hansen,et al.  Parallel Factor Analysis as an exploratory tool for wavelet transformed event-related EEG , 2006, NeuroImage.

[18]  Sabine Van Huffel,et al.  ResearchArticle Canonical Decomposition of Ictal Scalp EEG and Accurate Source Localisation: Principles and Simulation Study , 2007 .

[19]  Apdullah Yayik,et al.  Epileptic State Detection: Pre-ictal, Inter-ictal, Ictal , 2015 .

[20]  A. Cichocki 脳機能計測と生体信号入出力(第7回)Tensor Decompositions: New Concepts in Brain Data Analysis? , 2011 .

[21]  Hanghang Tong,et al.  Facets: Fast Comprehensive Mining of Coevolving High-order Time Series , 2015, KDD.

[22]  Eric Laciar,et al.  Review: A Survey of Performance and Techniques for Automatic Epilepsy Detection , 2013 .

[23]  Qiquan Shi,et al.  Learning Tensor-Based Features for Whole-Brain fMRI Classification , 2015, MICCAI.

[24]  Jiasong Mu,et al.  Throat polyp detection based on compressed big data of voice with support vector machine algorithm , 2014, EURASIP Journal on Advances in Signal Processing.

[25]  Gert Pfurtscheller,et al.  EEG-based Brain-Computer Interface Using Subject-Specific Spatial Filters , 1999, IWANN.

[26]  Xiaofeng Gong,et al.  Tensor decomposition of EEG signals: A brief review , 2015, Journal of Neuroscience Methods.

[27]  Hong Wang,et al.  Tumor Classification Using High-Order Gene Expression Profiles Based on Multilinear ICA , 2009, Adv. Bioinformatics.

[28]  Philip S. Yu,et al.  Incremental tensor analysis: Theory and applications , 2008, TKDD.

[29]  K Lehnertz,et al.  Indications of nonlinear deterministic and finite-dimensional structures in time series of brain electrical activity: dependence on recording region and brain state. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[30]  Andrzej Cichocki,et al.  Tensor Decompositions for Signal Processing Applications: From two-way to multiway component analysis , 2014, IEEE Signal Processing Magazine.

[31]  Haiping Lu,et al.  Multilinear Subspace Learning: Dimensionality Reduction of Multidimensional Data , 2013 .

[32]  Marko Filipovic,et al.  Supervised feature extraction for tensor objects based on maximization of mutual information , 2013, Pattern Recognit. Lett..

[33]  Bülent Yener,et al.  Unsupervised Multiway Data Analysis: A Literature Survey , 2009, IEEE Transactions on Knowledge and Data Engineering.

[34]  A. Cichocki,et al.  Tensor decompositions for feature extraction and classification of high dimensional datasets , 2010 .

[35]  Mohammad T. Manzuri Shalmani,et al.  Three-dimensional modular discriminant analysis (3DMDA): A new feature extraction approach for face recognition , 2011, Comput. Electr. Eng..

[36]  Yunus Emre Kara,et al.  Probabilistic Latent Tensor Factorization for 3-way Microarray Data Analysis with Missing Values , 2012 .

[37]  Philip S. Yu,et al.  DuSK: A Dual Structure-preserving Kernel for Supervised Tensor Learning with Applications to Neuroimages , 2014, SDM.

[38]  Dong Xu,et al.  Trace Ratio vs. Ratio Trace for Dimensionality Reduction , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  Ben Taskar,et al.  Regularized Tensor Factorization for Multi-Modality Medical Image Classification , 2011, MICCAI.

[40]  Wim Van Paesschen,et al.  Block term decomposition for modelling epileptic seizures , 2014, EURASIP J. Adv. Signal Process..

[41]  Feiping Nie,et al.  Extracting the optimal dimensionality for local tensor discriminant analysis , 2009, Pattern Recognit..

[42]  Andrzej Cichocki,et al.  Multiway array decomposition analysis of EEGs in Alzheimer's disease , 2012, Journal of Neuroscience Methods.

[43]  Christos Faloutsos,et al.  Fast mining and forecasting of complex time-stamped events , 2012, KDD.