Hidden Markov Models as a Tool for the Assessment of Dependence of Phenomena of Economic Nature

The assessment of dependence between time series is a common dilemma, which is often solved by the use of the Pearson’s correlation coefficient. Unfortunately, sometimes, the results may be highly misleading. In this paper, an alternative measure is presented. It is based on hidden Markov models and Viterbi paths. The proposed method is in no way universal but seems to provide quite an accurate image of the similarities between time series, by disclosing the periods of convergence and divergence. The usefulness of this new measure is verified by specially crafted examples and real‑life macroeconomic data. There are some definite advantages to this method: the weak assumptions of applicability, ease of interpretation of the results, possibility of easy generalization, and high effectiveness in assessing the dependence of different time series of an economic nature. It should not be treated as a substitute for the Pearson’s correlation, but rather as a complementary method of dependence measure.

[1]  Andrew J. Viterbi,et al.  Error bounds for convolutional codes and an asymptotically optimum decoding algorithm , 1967, IEEE Trans. Inf. Theory.

[2]  T. Vogelsang.  Unit Roots, Cointegration, and Structural Change , 2001 .

[3]  Maria L. Rizzo,et al.  Measuring and testing dependence by correlation of distances , 2007, 0803.4101.

[4]  H. Joe.  Multivariate models and dependence concepts , 1998 .

[5]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .

[6]  Divyakant Agrawal,et al.  A comparison of DFT and DWT based similarity search in time-series databases , 2000, CIKM '00.

[7]  Phoebus J. Dhrymes.  Time series, unit roots, and cointegration , 1998 .

[8]  R. Nelsen.  An Introduction to Copulas , 1998 .

[9]  Maurice G. Kendall,et al.  The Advanced Theory of Statistics, Vol. 2: Inference and Relationship , 1979 .

[10]  Joan Serrà,et al.  An empirical evaluation of similarity measures for time series classification , 2014, Knowl. Based Syst..

[11]  Emanuel Parzen,et al.  MODELING, DEPENDENCE, CLASSIFICATION, UNITED STATISTICAL SCIENCE, MANY CULTURES , 2012, 1204.4699.

[12]  D. Tjøstheim,et al.  Local Gaussian correlation: A new measure of dependence , 2013 .

[13]  Karl Pearson,et al.  ON THE DISTRIBUTION OF THE CORRELATION COEFFICIENT IN SMALL SAMPLES. APPENDIX II TO THE PAPERS OF “STUDENT” AND R. A. FISHER. A COOPERATIVE STUDY , 1917 .

[14]  W. Verstraeten,et al.  A comparison of time series similarity measures for classification and change detection of ecosystem dynamics , 2011 .

[15]  Eric Moulines,et al.  Inference in Hidden Markov Models (Springer Series in Statistics) , 2005 .

[16]  Joseph Zubin,et al.  Fundamental statistics in psychology and education , 1943 .