Time-Series Segmentation Using Predictive Modular Neural Networks

A predictive modular neural network method is applied to the problem of unsupervised time-series segmentation. The method consists of the concurrent application of two algorithms: one for source identification, the other for time-series classification. The source identification algorithm discovers the sources generating the time series, assigns data to each source, and trains one predictor for each source. The classification algorithm recursively computes a credit function for each source, based on the competition of the respective predictors, according to their predictive accuracy; the credit function is used for classification of the time-series observation at each time step. The method is tested by numerical experiments.

[1]  D. Lainiotis,et al.  Recursive algorithm for the calculation of the adaptive Kalman filter weighting coefficients , 1969 .

[2]  Demetrios G. Lainiotis,et al.  Unsupervised Learning Minimum Risk Pattern Classification for Dependent Hypotheses and Dependent Measurements , 1969, IEEE Trans. Syst. Sci. Cybern..

[3]  D. Lainiotis.  Optimal adaptive estimation: Structure and parameter adaptation , 1970 .

[4]  D. Lainiotis.  Optimal adaptive estimation: Structure and parameter adaption , 1971 .

[5]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[6]  A. Wennberg,et al.  Computer analysis of EEG signals with parametric models , 1981, Proceedings of the IEEE.

[7]  Teuvo Kohonen,et al.  Self-organization and associative memory: 3rd edition , 1989 .

[8]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[9]  Patrick Kenny,et al.  A linear predictive HMM for vector-valued observations with applications to speech recognition , 1990, IEEE Trans. Acoust. Speech Signal Process..

[10]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[11]  Geoffrey E. Hinton,et al.  Adaptive Mixtures of Local Experts , 1991, Neural Computation.

[12]  Simon Haykin,et al.  Classification of radar clutter using neural networks , 1991, IEEE Trans. Neural Networks.

[13]  Steven J. Nowlan,et al.  Mixtures of Controllers for Jump Linear and Non-Linear Plants , 1993, NIPS.

[14]  Robert A. Jacobs,et al.  Hierarchical Mixtures of Experts and the EM Algorithm , 1993, Neural Computation.

[15]  Michael I. Jordan,et al.  Convergence results for the EM approach to mixtures of experts architectures , 1995, Neural Networks.

[16]  Klaus-Robert Müller,et al.  Annealed Competition of Experts for a Segmentation and Classification of Switching Dynamics , 1996, Neural Computation.

[17]  Athanasios Kehagias,et al.  Modular neural networks for MAP classification of time series and the partition algorithm , 1996, IEEE Trans. Neural Networks.

[18]  Michael I. Jordan,et al.  On Convergence Properties of the EM Algorithm for Gaussian Mixtures , 1996, Neural Computation.

[19]  Athanasios Kehagias,et al.  A Recurrent Network Implementation of Time Series Classification , 1996, Neural Computation.

[20]  T. Sejnowski,et al.  Self-organized segmentation of time series: separating growth hormone secretion in acromegaly from normal controls. , 1996, Biophysical journal.

[21]  Athanasios Kehagias,et al.  Predictive Modular Neural Networks for Time Series Classification , 1997, Neural Networks.

[22]  Vassilios Petridis,et al.  Identification of switching dynamical systems using multiple models , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[23]  Athanasios Kehagias,et al.  A hybrid neural-genetic multimodel parameter estimation algorithm , 1998, IEEE Trans. Neural Networks.