Kernel Methods for Detecting the Direction of Time Series

We propose two kernel based methods for detecting the time direction in empirical time series. First we apply a Support Vector Machine on the finite-dimensional distributions of the time series (classification method) by embedding these distributions into a Reproducing Kernel Hilbert Space. For the ARMA method we fit the observed data with an autoregressive moving average process and test whether the regression residuals are statistically independent of the past values. Whenever the dependence in one direction is significantly weaker than in the other we infer the former to be the true one. Both approaches were able to detect the direction of the true generating model for simulated data sets. We also applied our tests to a large number of real world time series. The ARMA method made a decision for a significant fraction of them, in which it was mostly correct, while the classification method did not perform as well, but still exceeded chance level.

[1]  Bernhard Schölkopf,et al.  Measuring Statistical Dependence with Hilbert-Schmidt Norms , 2005, ALT.

[2]  P. Spirtes,et al.  Causation, prediction, and search , 1993 .

[3]  Matthias Hein,et al.  Hilbertian Metrics and Positive Definite Kernels on Probability Measures , 2005, AISTATS.

[4]  Michael Eichler,et al.  Causal Reasoning in Graphical Time Series Models , 2007, UAI.

[5]  L. Elton,et al.  THE DIRECTION OF TIME , 1978 .

[6]  Richard A. Davis,et al.  TIME‐REVERSIBILITY, IDENTIFIABILITY AND INDEPENDENCE OF INNOVATIONS FOR STATIONARY TIME SERIES , 1992 .

[7]  G. Weiss TIME-REVERSIBILITY OF LINEAR STOCHASTIC PROCESSES , 1975 .

[8]  Bernhard Schölkopf,et al.  A Kernel Method for the Two-Sample-Problem , 2006, NIPS.

[9]  Bernhard Schölkopf,et al.  Injective Hilbert Space Embeddings of Probability Measures , 2008, COLT.

[10]  Le Song,et al.  A Hilbert Space Embedding for Distributions , 2007, Discovery Science.

[11]  Richard A. Davis,et al.  Time Series: Theory and Methods (2nd ed.). , 1992 .

[12]  J. Peters Asymmetries of Time Series under Inverting their Direction , 2008 .

[13]  Howard M. Taylor,et al.  On the Distribution of Stock Price Differences , 1967, Oper. Res..

[14]  Illtyd Trethowan Causality , 1938 .

[15]  Richard A. Davis,et al.  Time Series: Theory and Methods , 2013 .

[16]  Anil K. Bera,et al.  A test for normality of observations and regression residuals , 1987 .

[17]  Aapo Hyvärinen,et al.  A Linear Non-Gaussian Acyclic Model for Causal Discovery , 2006, J. Mach. Learn. Res..

[18]  R. Balian From microphysics to macrophysics , 1991 .