An experimental analysis on time series transductive classification on graphs

Graph-based semi-supervised learning (SSL) algorithms perform well when the data lie on a low-dimensional manifold. Although these methods achieved satisfactory performance on a variety of domains, they have not been effectively evaluated on time series classification. In this paper, we provide a comprehensive empirical comparison of state-of-the-art graph-based SSL algorithms combined with a variety of graph construction methods in order to evaluate them on time series transductive classification tasks. Through a detailed experimental analysis using recently proposed empirical evaluation models, we show strong and weak points of these classifiers concerning both performance and stability with respect to graph construction and parameter selection. Our results show that some hypotheses raised on previous work do not hold in the time series domain while others may only hold under mild conditions.

[1]  Celso André R. de Sousa,et al.  An overview on the Gaussian Fields and Harmonic Functions method for semi-supervised learning , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[2]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[3]  Gustavo E. A. P. A. Batista,et al.  Robust Multi-class Graph Transduction with higher order regularization , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[4]  Matthias Hein,et al.  Manifold Denoising , 2006, NIPS.

[5]  Celso André R. de Sousa,et al.  Influence of Graph Construction on Semi-supervised Learning , 2013, ECML/PKDD.

[6]  Li Wei,et al.  Semi-supervised time series classification , 2006, KDD '06.

[7]  Wei Liu,et al.  Large Graph Construction for Scalable Semi-Supervised Learning , 2010, ICML.

[8]  Celso André R. de Sousa,et al.  Time Series Transductive Classification on Imbalanced Data Sets: An Experimental Study , 2014, 2014 22nd International Conference on Pattern Recognition.

[9]  Eamonn J. Keogh,et al.  Experimental comparison of representation methods and distance measures for time series data , 2010, Data Mining and Knowledge Discovery.

[10]  Xiaojin Zhu,et al.  --1 CONTENTS , 2006 .

[11]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[12]  Ulrike von Luxburg,et al.  Graph Laplacians and their Convergence on Random Neighborhood Graphs , 2006, J. Mach. Learn. Res..

[13]  Shih-Fu Chang,et al.  Graph construction and b-matching for semi-supervised learning , 2009, ICML '09.

[14]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[15]  Hui Ding,et al.  Querying and mining of time series data: experimental comparison of representations and distance measures , 2008, Proc. VLDB Endow..

[16]  Mikhail Belkin,et al.  Laplacian Support Vector Machines Trained in the Primal , 2009, J. Mach. Learn. Res..

[17]  Zoubin Ghahramani,et al.  Combining active learning and semi-supervised learning using Gaussian fields and harmonic functions , 2003, ICML 2003.

[18]  Bernhard Schölkopf,et al.  Learning with Local and Global Consistency , 2003, NIPS.

[19]  Wei Liu,et al.  Robust multi-class transductive learning with graphs , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Tong Zhang,et al.  On the Effectiveness of Laplacian Normalization for Graph Semi-supervised Learning , 2007, J. Mach. Learn. Res..