Time series classification using Gaussian mixture models of reconstructed phase spaces

A new signal classification approach is presented that is based upon modeling the dynamics of a system as they are captured in a reconstructed phase space. The modeling is done using full covariance Gaussian mixture models of time domain signatures, in contrast with current and previous work in signal classification that is typically focused on either linear systems analysis using frequency content or simple nonlinear machine learning models such as artificial neural networks. The proposed approach has strong theoretical foundations based on dynamical systems and topological theorems, resulting in a signal reconstruction, which is asymptotically guaranteed to be a complete representation of the underlying system, given properly chosen parameters. The algorithm automatically calculates these parameters to form appropriate reconstructed phase spaces, requiring only the number of mixtures, the signals, and their class labels as input. Three separate data sets are used for validation, including motor current simulations, electrocardiogram recordings, and speech waveforms. The results show that the proposed method is robust across these diverse domains, significantly outperforming the time delay neural network used as a baseline.

[1]  Eamonn J. Keogh,et al.  On the Need for Time Series Data Mining Benchmarks: A Survey and Empirical Demonstration , 2002, Data Mining and Knowledge Discovery.

[2]  Gabriel B. Mindlin,et al.  TOPOLOGICAL STRUCTURE OF CHAOTIC FLOWS FROM HUMAN SPEECH DATA , 1999 .

[3]  Carroll,et al.  Predicting physical variables in time-delay embedding. , 1994, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[4]  H. Kantz,et al.  Nonlinear time series analysis , 1997 .

[5]  J. Doyne Farmer,et al.  Exploiting Chaos to Predict the Future and Reduce Noise , 1989 .

[6]  D. Barone,et al.  Speaker identification using nonlinear dynamical features , 2002 .

[7]  C. S. George Lee,et al.  Neural fuzzy systems: a neuro-fuzzy synergism to intelligent systems , 1996 .

[8]  H.F.V. Boshoff,et al.  The fractal dimension of fricative speech sounds , 1991, COMSIG 1991 Proceedings: South African Symposium on Communications and Signal Processing.

[9]  F. Takens Detecting strange attractors in turbulence , 1981 .

[10]  H. Stanley,et al.  Magnitude and sign correlations in heartbeat fluctuations. , 2000, Physical review letters.

[11]  James B. Kadtke,et al.  CLASSIFICATION OF HIGHLY NOISY SIGNALS USING GLOBAL DYNAMICAL MODELS , 1995 .

[12]  Martin Casdagli,et al.  Nonlinear prediction of chaotic time series , 1989 .

[13]  J. R. Buchler,et al.  Nonlinear Analysis of the Light Curve of the Variable Star R Scuti , 1996 .

[14]  Jonathan G. Fiscus,et al.  Darpa Timit Acoustic-Phonetic Continuous Speech Corpus CD-ROM {TIMIT} | NIST , 1993 .

[15]  L Glass,et al.  Noise effects on the complex patterns of abnormal heartbeats. , 2000, Physical review letters.

[16]  T. Moon The expectation-maximization algorithm , 1996, IEEE Signal Process. Mag..

[17]  Mohamed Benbouzid,et al.  Bibliography on induction motors faults detection and diagnosis , 1999 .

[18]  Nust Naming,et al.  Application of the chaos, fractal and wavelet theories to the feature extraction of passive acoustic signal , 1999 .