A fuzzy-set-based Reconstructed Phase Space method for identification of temporal patterns in complex time series

The new time series data mining framework proposed in this paper applies Reconstructed Phase Space (RPS) to identify temporal patterns that are characteristic and predictive of significant events in a complex time series. The new framework utilizes the fuzzy set and the Gaussian-shaped membership function to define temporal patterns in the time-delay embedding phase space. The resulting objective function represents not only the overall value of the event function, but also the weight of the vector in the temporal pattern cluster to which it contributes. Also, the new objective function is continuously differentiate so the gradient descent optimization such as quasiNewton's method can be applied to search the optimal temporal patterns with much faster speed of convergence. The computational stability is significantly improved over the genetic algorithm originally used in our early framework. A new simple but effective two-step optimization strategy is proposed which further improves the search performance. Another significant contribution is the use of mutual information and false neighbors methods to estimate the time delay and the phase space dimension. We also implemented two experimental applications to demonstrate the effectiveness of the new framework with comparisons to the original framework and to the neural network prediction approach.

[1]  Xiaojun Chen,et al.  Convergence of the BFGS Method for LC 1 Convex Constrained Optimization , 1996 .

[2]  Martin T. Hagan,et al.  Neural network design , 1995 .

[3]  Kenneth Levenberg A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[4]  J. D. Farmer,et al.  State space reconstruction in the presence of noise" Physica D , 1991 .

[5]  Richard J. Povinelli,et al.  A New Temporal Pattern Identification Method for Characterization and Prediction of Complex Time Series Events , 2003, IEEE Trans. Knowl. Data Eng..

[6]  Lotfi A. Zadeh,et al.  Outline of a New Approach to the Analysis of Complex Systems and Decision Processes , 1973, IEEE Trans. Syst. Man Cybern..

[7]  Donald C. Wunsch,et al.  Advanced neural network training methods for low false alarm stock trend prediction , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[8]  Fraser,et al.  Independent coordinates for strange attractors from mutual information. , 1986, Physical review. A, General physics.

[9]  Richard J. Povinelli,et al.  Identifying Temporal Patterns for Characterization and Prediction of Financial Time Series Events , 2000, TSDM.

[10]  Roberto Battiti,et al.  First- and Second-Order Methods for Learning: Between Steepest Descent and Newton's Method , 1992, Neural Computation.

[11]  Mehmet Emre Çek,et al.  Analysis of observed chaotic data , 2004 .

[12]  Paul Armand,et al.  A Feasible BFGS Interior Point Algorithm for Solving Convex Minimization Problems , 2000, SIAM J. Optim..

[13]  Richard J. Povinelli,et al.  TEMPORAL PATTERN IDENTIFICATION OF TIME SERIES DATA USING PATTERN WAVELETS AND GENETIC ALGORITHMS , 1999 .

[14]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[15]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[16]  D. Goldfarb A family of variable-metric methods derived by variational means , 1970 .

[17]  Stephen L. Chiu,et al.  Fuzzy Model Identification Based on Cluster Estimation , 1994, J. Intell. Fuzzy Syst..

[18]  Alfonso M Albano,et al.  Data Requirements for Reliable Estimation of Correlation Dimensions , 1987 .

[19]  F. Takens Detecting strange attractors in turbulence , 1981 .

[20]  Richard J. Povinelli,et al.  IMPROVING GENETIC ALGORITHMS PERFORMANCE BY HASHING FITNESS VALUES , 1999 .

[21]  Richard J. Povinelli Using Genetic Algorithms To Find Temporal Patterns Indicative Of Time Series Events , 2000 .

[22]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[23]  Elizabeth Bradley Analysis of time series , 2003 .

[24]  H. Abarbanel,et al.  Determining embedding dimension for phase-space reconstruction using a geometrical construction. , 1992, Physical review. A, Atomic, molecular, and optical physics.

[25]  P. Armand,et al.  A Feasible BFGS Interior Point Algorithm for Solving Strongly Convex Minimization Problems , 1999 .

[26]  E. Mizutani,et al.  Neuro-Fuzzy and Soft Computing-A Computational Approach to Learning and Machine Intelligence [Book Review] , 1997, IEEE Transactions on Automatic Control.

[27]  Richard J. Povinelli,et al.  DATA MINING OF MULTIPLE NONSTATIONARY TIME SERIES , 1999 .

[28]  T. M. Williams,et al.  Practical Methods of Optimization. Vol. 1: Unconstrained Optimization , 1980 .

[29]  J. A. Stewart,et al.  Nonlinear Time Series Analysis , 2015 .