While we are usually focused on forecasting future values of time series, it is often valuable to additionally predict their entire probability distributions, e.g. to evaluate risk, Monte Carlo simulations. On example of time series of $\approx$ 30000 Dow Jones Industrial Averages, there will be presented application of hierarchical correlation reconstruction for this purpose: MSE estimating polynomial as joint density for (current value, context), where context is for example a few previous values. Then substituting the currently observed context and normalizing density to 1, we get predicted probability distribution for the current value. In contrast to standard machine learning approaches like neural networks, optimal polynomial coefficients here have inexpensive direct formula, have controllable accuracy, are unique and independently calculated, each has a specific cumulant-like interpretation, and such approximation can asymptotically approach complete description of any real joint distribution - providing universal tool to quantitatively describe and exploit statistical dependencies in time series, systematically enhancing ARMA/ARCH-like approaches, also based on different distributions than Gaussian which turns out improper for daily log returns. There is also discussed application for non-stationary time series like calculating linear time trend, or adapting coefficients to local statistical behavior.
[1]
B. Mandelbrot.
THE PARETO-LEVY LAW AND THE DISTRIBUTION OF INCOME*
,
1960
.
[2]
M. Rosenblatt.
Remarks on Some Nonparametric Estimates of a Density Function
,
1956
.
[3]
C. Sempi,et al.
Copula Theory: An Introduction
,
2010
.
[4]
Jarek Duda.
Rapid parametric density estimation
,
2017,
ArXiv.
[5]
Guillermo Sapiro,et al.
The LOCO-I lossless image compression algorithm: principles and standardization into JPEG-LS
,
2000,
IEEE Trans. Image Process..
[6]
Erkki Oja,et al.
Independent component analysis: algorithms and applications
,
2000,
Neural Networks.
[7]
M. Varanasi,et al.
Parametric generalized Gaussian density estimation
,
1989
.
[8]
J. Duda,et al.
Modeling joint probability distribution of yield curve parameters
,
2018,
1807.11743.
[9]
Jarek Duda,et al.
Hierarchical correlation reconstruction with missing data, for example for biology-inspired neuron
,
2018
.
[10]
Terence C. Mills,et al.
Time series techniques for economists
,
1990
.
[11]
Jarek Duda,et al.
Credibility evaluation of income data with hierarchical correlation reconstruction
,
2018,
ArXiv.
[12]
Peter Christoffersen,et al.
Elements of Financial Risk Management
,
2003
.
[13]
Liqun Qi,et al.
Eigenvalues of a real supersymmetric tensor
,
2005,
J. Symb. Comput..
[14]
Jarek Duda.
Hierarchical correlation reconstruction with missing data
,
2018,
ArXiv.