Genetic Algorithms and Support Vector Machines for Time Series Classification

We introduce an algorithm for classifying time series data. Since our initial application is for lightning data, we call the algorithm Zeus. Zeus is a hybrid algorithm that employs evolutionary computation for feature extraction, and a support vector machine for the final backend classification. Support vector machines have a reputation for classifying in high-dimensional spaces without overfitting, so the utility of reducing dimensionality with an intermediate feature selection step has been questioned. We address this question by testing Zeus on a lightning classification task using data acquired from the Fast On-orbit Recording of Transient Events (FORTE) satellite.

[1]  Victor L. Brailovsky,et al.  On domain knowledge and feature selection using a support vector machine , 1999, Pattern Recognit. Lett..

[2]  Dustin Boswell,et al.  Introduction to Support Vector Machines , 2002 .

[3]  Vladimir Cherkassky,et al.  The Nature Of Statistical Learning Theory , 1997, IEEE Trans. Neural Networks.

[4]  Neal R. Harvey,et al.  Feature extraction from multiple data sources using genetic programming , 2002, SPIE Defense + Commercial Sensing.

[5]  Neal R. Harvey,et al.  Comparison of GENIE and conventional supervised classifiers for multispectral image feature extraction , 2002, IEEE Trans. Geosci. Remote. Sens..

[6]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[7]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[8]  P. L. Klingner,et al.  Innovative use of DSP technology in space: FORTE event classifier , 1994 .

[9]  Neal R. Harvey,et al.  Genetic algorithm for combining new and existing image processing tools for multispectral imagery , 2000, SPIE Defense + Commercial Sensing.

[10]  Neal R. Harvey,et al.  Evolving retrieval algorithms with a genetic programming scheme , 1999, Optics & Photonics.

[11]  Francis Eng Hock Tay,et al.  A comparative study of saliency analysis and genetic algorithm for feature selection in support vector machines , 2001, Intell. Data Anal..

[12]  Kurt R. Moore,et al.  Classification of rf transients in space using digital signal processing and neural network techniques , 1995, SPIE Defense + Commercial Sensing.

[13]  Joachim M. Buhmann,et al.  Feature selection for support vector machines , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[14]  Peter Nordin,et al.  Genetic programming - An Introduction: On the Automatic Evolution of Computer Programs and Its Applications , 1998 .

[15]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[16]  Peter E. Hart,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.